So imagine a situation where due to actual prejudice (for example, redlining, segregated, inferior schools, employment discrimination), outcomes and circumstances are clearly predictable by race. If you're not careful with your algorithms, your algorithm and see the world 'as it is' and see it 'as it must be' or 'as it should be'.