The biggest issue I think is agency. In 2024 large improvements will be made to memory (a lot is happening in this regard). I agree that GPT-4 already has a lot of capability. Especially with fine-tuning it should do well on a lot of individual tasks relevant to AI development.
But the executive function is probably still lacking in 2024. Combining the tasks to a whole job will be challenging. Improving data is agency intensive (less intelligence intensive). You need to contact organizations, scrape the web, sift through the data etc. Also it would need to order the training run, get the compute for inference time, pay the bills etc. These require more agency than intelligence.
Absolutely. Even with GPT-4′s constrained “short term memory”, it is remarkably proficient at managing sizable tasks using external systems like AutoGPT or Baby AGI that take on the role of extensive “planning” on behalf of GPT-4. Such tools equip GPT-4 with the capacity to contemplate and evaluate ideas—facets akin to “planning” and “agency”—and subsequently execute individual tasks derived from the plan through separate prompts.
This strategy could allow even GPT-4 to undertake larger responsibilities such as conducting scientific experiments or coding full-scale applications, not just snippets of code. If future iterations like GPT-5 or later were to incorporate a much larger token window (i.e., “short-term memory”), they might be able to execute tasks, while also keeping the larger scale planning in memory at the same time? Thus reducing the reliance on external systems for planning and agency.
However, humans can help with the planning etc. And GPT-5 will probably boost productivity of AI developers.
Note: depending on your definition of intelligence, agency or the executive function would/should be part of intelligence.
Agreed. Though, communication speed is a significant concern. AI-to-Human interaction is inherently slower than AI-to-AI or even AI-to-Self, due to factors such as the need to translate actions and decisions into human-understandable language, and the overall pace of Human cognition and response.
To optimize GPT-5′s ability in solving complex issues quickly, it may be necessary to minimize Human involvement in the process. The role of Humans could then be restricted to evaluating and validating the final outcome, thus not slowing down the ideation or resolution process? Though, depending on the size of the token window, GPT-5 might not have the ability to do the planning and execution at the same time. It might require GPT-6 or subsequent versions to get to that point.
Agree, human in the loop systems are very valuable and probably temporary. HITL systems provide valuable data for training allowing the next step. AI alone is indeed much faster and cheaper.
Absolutely. Even with GPT-4′s constrained “short term memory”, it is remarkably proficient at managing sizable tasks using external systems like AutoGPT or Baby AGI that take on the role of extensive “planning” on behalf of GPT-4. Such tools equip GPT-4 with the capacity to contemplate and evaluate ideas—facets akin to “planning” and “agency”—and subsequently execute individual tasks derived from the plan through separate prompts.
This strategy could allow even GPT-4 to undertake larger responsibilities such as conducting scientific experiments or coding full-scale applications, not just snippets of code. If future iterations like GPT-5 or later were to incorporate a much larger token window (i.e., “short-term memory”), they might be able to execute tasks, while also keeping the larger scale planning in memory at the same time? Thus reducing the reliance on external systems for planning and agency.
Agreed. Though, communication speed is a significant concern. AI-to-Human interaction is inherently slower than AI-to-AI or even AI-to-Self, due to factors such as the need to translate actions and decisions into human-understandable language, and the overall pace of Human cognition and response.
To optimize GPT-5′s ability in solving complex issues quickly, it may be necessary to minimize Human involvement in the process. The role of Humans could then be restricted to evaluating and validating the final outcome, thus not slowing down the ideation or resolution process? Though, depending on the size of the token window, GPT-5 might not have the ability to do the planning and execution at the same time. It might require GPT-6 or subsequent versions to get to that point.
Agree, human in the loop systems are very valuable and probably temporary. HITL systems provide valuable data for training allowing the next step. AI alone is indeed much faster and cheaper.