That doesn't really make sense. The population in most of the west is vaguely around replacement. A given individual can only make use of so much housing at once. Sure if you're rolling in cash throw in a vacation home or two. There's a pretty quick falloff in terms of utility, status, desire, any metric that's coming to mind as I type this.
It seems to me that at least in the US the issue is location. There's cheap stock in places without jobs and ridiculously expensive stock where the good jobs are located. It doesn't have to be this way.
Millennia before Adam Smith was born, pretty much every human societies which built "houses" (be they crude tents, igloos, lean-tos, thatched huts, or whatever) made a point of building enough of those to house all their members.
Capitalism has financialized housing, and that seems to be a major cause of the "can't actually build housing" problem.
In general, in pre-industrial societies families built their own houses rather than "society" building them for them. Of course this was because 1) many tribal societies had no concept of land ownership so you could just build wherever someone else wasn't using, and often these were temporary for a season or two anyway 2) later feudal societies where there was land ownership had land mostly owned by a nobleman who allowed his serfs to build their cottages on his land.
The reason we need non stop housing construction is because the underlying issue is capitalism's demand for infinite growth.