“choosing better experiments” is a relatively advanced skill, which will likely not emerge until well after experiment implementation skills
I have a draft discussing this. (Facepalm, should publish more often...)
Certainly choosing better experiments requires at least one of:
large scaleup in experimental observations (to get the experience to drive taste acquisition)
superhuman sample efficiency in taste acquisition
extreme reasoning/deliberation on top of weak taste, adding up to greater taste (I think there are likely very diminishing returns to this, but superspeed might yield it)
I think your claim is betting on the first one, and also assuming that you can only get that by increasing throughput.
But maybe you could slurp enough up from existing research logs, or from interviews with existing researchers, or something like that. Then you’d be competing with the still overall larger, but more tacit and more distributed-between-brains research experience of all the humans in the org.
I have a draft discussing this. (Facepalm, should publish more often...)
Certainly choosing better experiments requires at least one of:
large scaleup in experimental observations (to get the experience to drive taste acquisition)
superhuman sample efficiency in taste acquisition
extreme reasoning/deliberation on top of weak taste, adding up to greater taste (I think there are likely very diminishing returns to this, but superspeed might yield it)
I think your claim is betting on the first one, and also assuming that you can only get that by increasing throughput.
But maybe you could slurp enough up from existing research logs, or from interviews with existing researchers, or something like that. Then you’d be competing with the still overall larger, but more tacit and more distributed-between-brains research experience of all the humans in the org.
I polished and published the draft
Introducing exploration and experimentation
Why does exploration matter?
Research and taste
From play to experimentation
Exploration in AI, past and future
Research by AI: AI with research taste?
Opportunities