a) I do basically expect the LLMs to get the right answer, and for it to be easily checkable. (like, I do in fact have a lot of boilerplate code to write)
and/or b) my current task is sufficiently tree structured, that it’s pretty cheap to spin up an LLM to tackle one random subproblem while I mostly focus on a different thing. And the speedup from this is pretty noticeable. Sometimes the subproblem is something I expect it to get right, sometimes I don’t really expect it to, BUT, there’s a chance it will, and meanwhile I have something else to do.
(During a recent project, I had 3 different copies of my git repo open, and spent ~half my time managing 3 different “junior dev LLM employees”)
I’m also just trying to specialize a bit in “be an early LLM adopter/pioneer who tries to anticipate what more powerful llm+human pairs will be able to do in 6 months. Try to figure out what cognitive habits are adaptive for that world, so that I can distill out tips/tools for others as capabilities rise.”
I’m often in situations where either
a) I do basically expect the LLMs to get the right answer, and for it to be easily checkable. (like, I do in fact have a lot of boilerplate code to write)
and/or b) my current task is sufficiently tree structured, that it’s pretty cheap to spin up an LLM to tackle one random subproblem while I mostly focus on a different thing. And the speedup from this is pretty noticeable. Sometimes the subproblem is something I expect it to get right, sometimes I don’t really expect it to, BUT, there’s a chance it will, and meanwhile I have something else to do.
(During a recent project, I had 3 different copies of my git repo open, and spent ~half my time managing 3 different “junior dev LLM employees”)
I’m also just trying to specialize a bit in “be an early LLM adopter/pioneer who tries to anticipate what more powerful llm+human pairs will be able to do in 6 months. Try to figure out what cognitive habits are adaptive for that world, so that I can distill out tips/tools for others as capabilities rise.”