In most cases, the real problem has become the cost of k-12 education.
Because the cost of educating one student is often more than the tax revenue from a home, towns do everything they can to discourage families moving into town.
Zoning rules have resulted in McMansions only, with even "affordable housing" being out of reach of the cost to the average young family starting out. Rules require at least an acre of land, huge fees to attach to utilities, and discourage
multi-bedroom apartments (to limit apartments to singles or couples).
Thus, the only housing for the upcoming generation is what comes from the elderly passing away. We will have a bubble of those available in 25-30 years as the baby-boomer generation passes, but thats far in the future.