My objection isn’t that I can’t imagine how it might happen. Maybe we can get AI systems to do our alignment homework. But I think it is wild to stake our future on this plan working.
I think it is wild to essentially say, “This problem is so difficult that I don’t even have a roadmap for solving it, but I am quite confident that it will be solved by this new type of being that we are creating, and about which we know very little, and that might want to kill us.”
(very late response but)
My objection isn’t that I can’t imagine how it might happen. Maybe we can get AI systems to do our alignment homework. But I think it is wild to stake our future on this plan working.
I think it is wild to essentially say, “This problem is so difficult that I don’t even have a roadmap for solving it, but I am quite confident that it will be solved by this new type of being that we are creating, and about which we know very little, and that might want to kill us.”