If you can’t enthusiastically endorse that outcome, were it to happen, then you should be yelling at us to stop.
I don’t think it’s that simple. I’m not enthusiastic about transhumanism, so I can’t enthusiastically endorse that outcome, but I can’t bring myself to say, “Don’t build AI because it’ll make transhumanism possible sooner.” If anything, I expect that having a friendly-to-everyone ASI would make it a lot easier to transition into a world where some people are Jupiter-brained.
I am quite willing to say, “Don’t build AI until you can make sure it’s friendly-to-everyone,” of course.
Does “prefer this outcome to extinction or disempowerment, though I wish there were more pleasant current-human futures available” count as “enthusiastically endorse”?
Not the way I’d use those words, nope. The first is a low bar; the second is extremely high, and includes a specific emotional reaction in it. I haven’t seen any plausible vision of 2040 that I’d enthusiastically endorse, whether it’s business-as-usual or dismantling stars, but it’s not hard to come up with futures that are preferable to the end of love in the universe.
I don’t think it’s that simple. I’m not enthusiastic about transhumanism, so I can’t enthusiastically endorse that outcome, but I can’t bring myself to say, “Don’t build AI because it’ll make transhumanism possible sooner.” If anything, I expect that having a friendly-to-everyone ASI would make it a lot easier to transition into a world where some people are Jupiter-brained.
I am quite willing to say, “Don’t build AI until you can make sure it’s friendly-to-everyone,” of course.
Does “prefer this outcome to extinction or disempowerment, though I wish there were more pleasant current-human futures available” count as “enthusiastically endorse”?
Not the way I’d use those words, nope. The first is a low bar; the second is extremely high, and includes a specific emotional reaction in it. I haven’t seen any plausible vision of 2040 that I’d enthusiastically endorse, whether it’s business-as-usual or dismantling stars, but it’s not hard to come up with futures that are preferable to the end of love in the universe.