This raises interesting off-topic question: does ‘intelligence’ itself confer significant advantage over such methods (which can certainly be implemented without anything resembling agent’s real world utility)?
We are transitioning to being bottlenecked (in our technological progress, at least) by optimization software implementing such methods, rather than being bottlenecked by our intelligence (that is in part how the exponential growth is sustained despite constant human intelligence); if the AI can’t do a whole lot better than our brainstorming, it probably won’t have upper hand over dedicated optimization software.
This raises interesting off-topic question: does ‘intelligence’ itself confer significant advantage over such methods (which can certainly be implemented without anything resembling agent’s real world utility)?
We are transitioning to being bottlenecked (in our technological progress, at least) by optimization software implementing such methods, rather than being bottlenecked by our intelligence (that is in part how the exponential growth is sustained despite constant human intelligence); if the AI can’t do a whole lot better than our brainstorming, it probably won’t have upper hand over dedicated optimization software.