> who have very limited mobility in the job market

The solution to that problem is to relax immigration restrictions to make it easier for immigrant workers to switch jobs so they have more leverage. Not go the other direction and further torture immigrants by making their lives harder.