You're out of your mind. The amount of work that had to be done just to feed yourself varied wildly based on location. At absolute best, yes, you only had to work a couple of hours a day. At worst, and much more common, you were perpetually on the edge of starvation and constantly looking for food. You are whatever you could find or kill. Today your local grocery store has a larger variety of foods that any king could have ever wished for a couple of hundred years ago.
You also leave out the complete lack of effective medical treatment. Any scrape you got could get infected and kill you. Everyone was perpetually infested with lice and other kinds of insects feeding off of you, not to mention all of the species of fungus that would live in your crevices. If you were lucky, your toilet was a river.
Sure everyone was almost equal, equally shitty.