That's a myth. For most of human history, "working" 10-12 hours/week used to be the norm. There are still isolated tribes living as hunter gatherers and they are far from miserable!
Not only that, but "work" was often fun back then. These people were basically doing for work what people today do for fun: hunting, crafting, cooking, exercising, etc.