Yes, by default alignment looks much like today when we reache the level of SueprClaude as I outlined it. The point of the article is how things go from there. I agree that it couldn’t trigger a full FOOM but it could still be able to outmaneuver humanity as a whole. Or hopefully not, and it’s a warning shot.
AGI is a clumsy term now since it’s defined and redefined frequently. I did define what I meant by it in the essay, so whether or not people happened to call it that wouldn’t make much difference.
A jump in capabilities from moderate scaling isn’t at all what I meant by “phase shift” I just noticed that was part of the definition of the term suggested by AI. I took that all out after noticing how it had probably caused your confusion, because it had got that wrong, and I’d defined the important terms already
Yes, by default alignment looks much like today when we reache the level of SueprClaude as I outlined it. The point of the article is how things go from there. I agree that it couldn’t trigger a full FOOM but it could still be able to outmaneuver humanity as a whole. Or hopefully not, and it’s a warning shot.
AGI is a clumsy term now since it’s defined and redefined frequently. I did define what I meant by it in the essay, so whether or not people happened to call it that wouldn’t make much difference.
A jump in capabilities from moderate scaling isn’t at all what I meant by “phase shift” I just noticed that was part of the definition of the term suggested by AI. I took that all out after noticing how it had probably caused your confusion, because it had got that wrong, and I’d defined the important terms already