I can in fact fire an LLM. It's even easier than firing a junior developer.

Or rather, it's more like a contractor. If I don't like the job they did, I don't give them the next job.