Another worry with continual learning:
A misaligned superhuman AI still has to solve the alignment problem, or else the next-gen AI will be misaligned to itself. A continual-learning superhuman AI only has to solve the value drift problem, which seems easier.
Another worry with continual learning:
A misaligned superhuman AI still has to solve the alignment problem, or else the next-gen AI will be misaligned to itself. A continual-learning superhuman AI only has to solve the value drift problem, which seems easier.