I think a lot of the intuition right now is “there is an argument that inner optimizers will arise by default; we don’t know how likely it is but evolution is one example so it’s not non-negligible”.
For the argument part, have you read Morerealistic tales of doom? Part 2 is a good explanation of why inner optimizers might arise.
I think a lot of the intuition right now is “there is an argument that inner optimizers will arise by default; we don’t know how likely it is but evolution is one example so it’s not non-negligible”.
For the argument part, have you read More realistic tales of doom? Part 2 is a good explanation of why inner optimizers might arise.
I have read that post; it makes sense, but I’m not sure how to distinguish “correct” from “persuasive but wrong” in this case without other evidence