I think this actually a really important point—there was a regime change somewhere in this “tool optimization” process in which the bulk of the optimization was being done by the humans and not evolution. Whereas for AI, no such regime changes exist, the optimizers themselves are’t being optimized.
So maybe we should be more careful about what specific optimization processes we use to anchor our thoughts about AI developement, seems like similar kinds of regime changes might occur in some other natural processes that won’t show up in AI.
Yes, very true, and I like calling it a regime change. As I was researching stone tools, I came across several mentions about mankind’s increasing cognitive capacity and how crucial it was to advance the technology. Once the evolutionary brain-size foundation was set, the jet fuel that powered the next few thousand years of technological advancement was almost entirely capital accumulation and societal technology.
I think this actually a really important point—there was a regime change somewhere in this “tool optimization” process in which the bulk of the optimization was being done by the humans and not evolution. Whereas for AI, no such regime changes exist, the optimizers themselves are’t being optimized.
So maybe we should be more careful about what specific optimization processes we use to anchor our thoughts about AI developement, seems like similar kinds of regime changes might occur in some other natural processes that won’t show up in AI.
Yes, very true, and I like calling it a regime change. As I was researching stone tools, I came across several mentions about mankind’s increasing cognitive capacity and how crucial it was to advance the technology. Once the evolutionary brain-size foundation was set, the jet fuel that powered the next few thousand years of technological advancement was almost entirely capital accumulation and societal technology.