Which open problems are safe to discuss, and which are potentially dangerous?
I’d say all of the problem are unsafe not to discuss (at this point). Probability of disaster because of missing essential things or getting them wrong due to lack of independent review seems much higher than because of dangerous knowledge in wrong hands.
Which problems do we need to solve, and which ones can we have an AI solve?
We need to solve all of our problems. AI needs to ensure this happens.
What different kinds of Oracle AI are there, and are any of them both safe and feasible?
This is being discussed on LW, productively I think.
How much should we be worried about “metacomputational hazards”?
These look low-hanging to me:
I’d say all of the problem are unsafe not to discuss (at this point). Probability of disaster because of missing essential things or getting them wrong due to lack of independent review seems much higher than because of dangerous knowledge in wrong hands.
We need to solve all of our problems. AI needs to ensure this happens.
This is being discussed on LW, productively I think.
Not much. It’s way too early.