It’s hard to guess, but it happened when the only one known to us general intelligence was created by a hill-climbing process.
I think it’s inappropriate to call evolution a “hill-climbing process” in this context, since those words seem optimized to sneak in parallels to SGD. Separately, I think that evolution is a bad analogy for AGI training.
This seems super important to the argument! Do you know if it’s been discussed in detail anywhere else?
It’s hard to guess, but it happened when the only one known to us general intelligence was created by a hill-climbing process.
I think it’s inappropriate to call evolution a “hill-climbing process” in this context, since those words seem optimized to sneak in parallels to SGD. Separately, I think that evolution is a bad analogy for AGI training.
This seems super important to the argument! Do you know if it’s been discussed in detail anywhere else?