Yeah but baby, bathwater, throw.

Importantly the baby in that idiom is presumed to have value.

Notably, the GP didn't say "we don't use them because they don't have value".

That's a tar-baby.