I’ve never seen the basilisk (and I have just about resisted the very powerful urge to seek it out), but if one of us came up with a dangerous idea, is it not likely that an AI would do the same. Taking into account the vastly greater possibility of an AI to cause harm if ‘infected’, might we not gain more from looking at the problem now in case we can find a resolution (perhaps a better decision theory) and use that to avert a genuinely catastrophic outcome. Even if our hopes of solving the problem are not high, the probabilities and utilities may still advise it.
Of course, since I haven’t seen it, I might be totally misunderstanding the situation, or maybe there is an excellent reason why the above is wrong that I can’t understand without exposing myself to the basilisk. Even if this isn’t the case, it might still be best for a few people who have already seen it to work on the problem, rather than informing someone like me who probably wouldn’t be much help anyway.
If it’s not too much trouble, could you at least sate my burning curiosity by telling me which of the three options above, if any, is correct.
I’ve never seen the basilisk (and I have just about resisted the very powerful urge to seek it out), but if one of us came up with a dangerous idea, is it not likely that an AI would do the same. Taking into account the vastly greater possibility of an AI to cause harm if ‘infected’, might we not gain more from looking at the problem now in case we can find a resolution (perhaps a better decision theory) and use that to avert a genuinely catastrophic outcome. Even if our hopes of solving the problem are not high, the probabilities and utilities may still advise it.
Of course, since I haven’t seen it, I might be totally misunderstanding the situation, or maybe there is an excellent reason why the above is wrong that I can’t understand without exposing myself to the basilisk. Even if this isn’t the case, it might still be best for a few people who have already seen it to work on the problem, rather than informing someone like me who probably wouldn’t be much help anyway.
If it’s not too much trouble, could you at least sate my burning curiosity by telling me which of the three options above, if any, is correct.
You’re totally misunderstanding the situation.
Thanks.