Doesn’t the first example require full-blown molecular nanotechnology? [ETA: apparently Eliezer says he thinks it can be done with “very primitive nanotechnology” but it doesn’t sound that primitive to me.] Maybe I’m misinterpreting the example, but advanced nanotech is what I’d consider extremely impressive.
I currently expect we won’t have that level of tech until after human labor is essentially obsolete. In effect, it sounds like you would not update until well after AIs already run the world, basically.
I’m not sure I understand the second example. Perhaps you can make it more concrete.
Those are pretty impressive tasks. I’m optimistic that we can achieve existential safety via automating alignment research, and I think that’s a less difficult task than those.
I admire sarcasm, but there are at least two examples of not-very-impressive tasks, like:
Put two identical on cellular level strawberries on a plate;
Develop and deploy biotech 10 year ahead of SOTA (from famous “Safely aligning powerful AGI is difficult” thread).
Doesn’t the first example require full-blown molecular nanotechnology? [ETA: apparently Eliezer says he thinks it can be done with “very primitive nanotechnology” but it doesn’t sound that primitive to me.] Maybe I’m misinterpreting the example, but advanced nanotech is what I’d consider extremely impressive.
I currently expect we won’t have that level of tech until after human labor is essentially obsolete. In effect, it sounds like you would not update until well after AIs already run the world, basically.
I’m not sure I understand the second example. Perhaps you can make it more concrete.
Those are pretty impressive tasks. I’m optimistic that we can achieve existential safety via automating alignment research, and I think that’s a less difficult task than those.