I also imagine it is a space where...you very quickly get to a product that seems magical...but you can see in the data the places where your magical product will regularly be unable to make clear decisions. Unlike a lot of traditional product development, that knowledge makes it very hard for you to release, because the liability and ethical problems are very real.

It's somewhat unfair because we used to simply collect less comprehensive data on performance and therefore know less about our corner cases - but you don't get to live in the future without dealing with the problems of the future.