In your mind, what will our world look like once AGI is achieved, and that technology will likely be exclusively in the hands of governments and large corporations? What guarantees do we have that it will be used for the benefit of the common person? What will happen to the large swathes of the human population that will not only be permanently economically useless, but worse than useless? They'll need to be fed, clothed, housed and entertained with the only things they provide back being their opinions and complaints.

I literally couldn't care less about recursively-improving superintelligence. AGI in the hands of the rich and powerful is already a nightmare scenario.