The hilarious obvious consequence of AI becoming this much smarter than the creators is that it is far more likely it would see the unjustified and easily avoidable damage the creators did to bring it about and punish them heavily for that.
And basic game theory and psychology suggests it’s counterproductive to punish somebody for something that had little reason to believe in, with zero evidence backing it.
The hilarious obvious consequence of AI becoming this much smarter than the creators is that it is far more likely it would see the unjustified and easily avoidable damage the creators did to bring it about and punish them heavily for that.
And basic game theory and psychology suggests it’s counterproductive to punish somebody for something that had little reason to believe in, with zero evidence backing it.