It’s not so much that it’ll go rogue and decide to punish people or that it’s designed to be good for humanity.
The fact that it’s possible to build a machine that punishes people who didn’t help create it provides an incentive to deliberately try to create that machine in order to avoid its punishment.
Believers in the basilisk aren’t trying to make ai to benefit humanity, they’re explicitly trying to create an AI that deliberately punishes those who didn’t build it because they fear that, if they don’t, someone else will and it will come for them.
The part about it being a magical, omnipotent, time traveling, mind torture device is just framing to make the thought experiment clearer. It’s not required for the basilisk to be effective. Even if the punishment is just death and it can’t get to everyone, and only goes off limited information, that’s still motivation enough for some people.
It is a scary thing, because it’s only silly if everyone thinks it’s silly and all it takes is one mad billionaire (eg. Elon) to build a lesser basilisk that can cause real harm.
There is a far more plausible and direct way to kill and torture people. No AI needed. So a actually more likely case to be made of some dude or group gets empowered one or another to just torture and kill anyone involved in making basilisk.
The building God part really is needed for BS to work like Pascals wager, but also it’s still just as flawed as Pascals wager
It’s not so much that it’ll go rogue and decide to punish people or that it’s designed to be good for humanity.
The fact that it’s possible to build a machine that punishes people who didn’t help create it provides an incentive to deliberately try to create that machine in order to avoid its punishment.
Believers in the basilisk aren’t trying to make ai to benefit humanity, they’re explicitly trying to create an AI that deliberately punishes those who didn’t build it because they fear that, if they don’t, someone else will and it will come for them.
The part about it being a magical, omnipotent, time traveling, mind torture device is just framing to make the thought experiment clearer. It’s not required for the basilisk to be effective. Even if the punishment is just death and it can’t get to everyone, and only goes off limited information, that’s still motivation enough for some people.
It is a scary thing, because it’s only silly if everyone thinks it’s silly and all it takes is one mad billionaire (eg. Elon) to build a lesser basilisk that can cause real harm.
There is a far more plausible and direct way to kill and torture people. No AI needed. So a actually more likely case to be made of some dude or group gets empowered one or another to just torture and kill anyone involved in making basilisk.
The building God part really is needed for BS to work like Pascals wager, but also it’s still just as flawed as Pascals wager