Do we really need both? It seems like either a technical solution OR competent global governance would mostly suffice.
Do we need both? Perhaps not, in the theoretical case where we get a perfect instance of one. I disagree that we should aim for one or the other, because I don’t expect we will reach anywhere near perfection on either. I think we should expect to have to muddle through somehow with very imperfect versions of each.
I think we’ll likely see some janky poorly-organized international AI governance attempt combined with just good enough tool AI and software and just-aligned-enough sorta-general AI to maintain an uneasy temporary state of suppressing rogue AI explosions.
How long will we manage to stay on top under such circumstances? Hopefully long enough to realize the danger we’re in and scrape together some better governance and alignment solutions.
Edit: I later saw that Max H said he thought we should pursue both. So we disagree less than I thought. There is some difference, in that I still think we can’t really afford a failure in either category. Mainly because I don’t expect us to do well enough in either for that single semi-success to carry us through.
Do we need both? Perhaps not, in the theoretical case where we get a perfect instance of one. I disagree that we should aim for one or the other, because I don’t expect we will reach anywhere near perfection on either. I think we should expect to have to muddle through somehow with very imperfect versions of each.
I think we’ll likely see some janky poorly-organized international AI governance attempt combined with just good enough tool AI and software and just-aligned-enough sorta-general AI to maintain an uneasy temporary state of suppressing rogue AI explosions.
How long will we manage to stay on top under such circumstances? Hopefully long enough to realize the danger we’re in and scrape together some better governance and alignment solutions.
Edit: I later saw that Max H said he thought we should pursue both. So we disagree less than I thought. There is some difference, in that I still think we can’t really afford a failure in either category. Mainly because I don’t expect us to do well enough in either for that single semi-success to carry us through.