One thing that's interesting is that it actually doesn't tell you if more people are moving in or out, despite the title. The size of SF doesn't change when I click inbound/outbound.
You're right. The size of the selected city is fixed, just to be visually prominent, while the size of the red/blue related cities is determined by how many searches are happening to/from there.