But then your LB is a single point of failure! Even if you were to spin up duplicate copies of the LB that could be failed-over-to in real time, there is still the drawback that you are bounded by the number of requests you can store on a single machine.

I think what you actually built is a message queue engine that forwards the data to the consumers, not a load balancer.