The COL increases are real, but are largely driven by growth in average wages. (Techies moving into your town, and outbidding you on rent.)

You are correct to observe that people at the bottom are being left behind.