I’m not sure what job “unexpected” is doing here. Any self-improvement is going to be incomprehensible to humans (humans can’t even understand the human brain, nor current AI connectomes, and we definitely wont understand superhuman improvements). Comprehensible self-improvement seems fake to me. Are people really going around thinking they understood how any of the improvements of the past 5 years really work, or what their limits or ramifications are. These things weren’t understood before being implemented. They just tried them and then the number went up and then they made up principles and explanations many years after the fact.
I’m not sure what job “unexpected” is doing here. Any self-improvement is going to be incomprehensible to humans (humans can’t even understand the human brain, nor current AI connectomes, and we definitely wont understand superhuman improvements). Comprehensible self-improvement seems fake to me.
Are people really going around thinking they understood how any of the improvements of the past 5 years really work, or what their limits or ramifications are. These things weren’t understood before being implemented. They just tried them and then the number went up and then they made up principles and explanations many years after the fact.