>This is precisely the sort of situation where taking the average is an awful way to ignore injustice - the poor get much poorer and the rich get much richer but everything is ‘neutral’ on average.

That has nothing to do with the ethics of capitalism, though. The poor becoming poorer and the rich becoming richer is not a foregone conclusion of a capitalist society, nor is it guaranteed not to happen in a non-capitalist society.