I guess I just think it’s pretty unreasonable to have p(doom) of 10% or less at this point, if you are familiar with the field, timelines, etc.
I totally agree the topic is important and neglected. I only said “arguably” deferrable, I have less than 50% credence that it is deferrable. As for why I’m not working on it myself, well, aaaah I’m busy idk what to do aaaaaaah! There’s a lot going on that seems important. I think I’ve gotten wrapped up in more OAI-specific things since coming to OpenAI, and maybe that’s bad & I should be stepping back and trying to go where I’m most needed even if that means leaving OpenAI. But yeah. I’m open to being convinced!
I guess part of the problem is that the people who are currently most receptive to my message are already deeply enmeshed in other x-risk work, and I don’t know how to reach others for whom the message might be helpful (such as academic philosophers just starting to think about AI?). If on reflection you think it would be worth spending some of your time on this, one particularly useful thing might be to do some sort of outreach/field-building, like writing a post or paper describing the problem, presenting it at conferences, and otherwise attracting more attention to it.
(One worry I have about this is, if someone is just starting to think about AI at this late stage, maybe their thinking process just isn’t very good, and I don’t want them to be working on this topic! But then again maybe there’s a bunch of philosophers who have been worried about AI for a while, but have stayed away due to the overton window thing?)
I guess I just think it’s pretty unreasonable to have p(doom) of 10% or less at this point, if you are familiar with the field, timelines, etc.
I totally agree the topic is important and neglected. I only said “arguably” deferrable, I have less than 50% credence that it is deferrable. As for why I’m not working on it myself, well, aaaah I’m busy idk what to do aaaaaaah! There’s a lot going on that seems important. I think I’ve gotten wrapped up in more OAI-specific things since coming to OpenAI, and maybe that’s bad & I should be stepping back and trying to go where I’m most needed even if that means leaving OpenAI. But yeah. I’m open to being convinced!
I guess part of the problem is that the people who are currently most receptive to my message are already deeply enmeshed in other x-risk work, and I don’t know how to reach others for whom the message might be helpful (such as academic philosophers just starting to think about AI?). If on reflection you think it would be worth spending some of your time on this, one particularly useful thing might be to do some sort of outreach/field-building, like writing a post or paper describing the problem, presenting it at conferences, and otherwise attracting more attention to it.
(One worry I have about this is, if someone is just starting to think about AI at this late stage, maybe their thinking process just isn’t very good, and I don’t want them to be working on this topic! But then again maybe there’s a bunch of philosophers who have been worried about AI for a while, but have stayed away due to the overton window thing?)
Somehow there are 4 copies of this post