One aspect of these goal-driven agents is that there are plenty of goals where you can clearly measure performance. This allows you to judge the quality of the involved text that was generated and use those cases where the agent was good at its task as training data.
That means that if you have enough compute available to use the system to perform tasks, you get as much training data as you desire. This in turn allows bigger better trained models.
One aspect of these goal-driven agents is that there are plenty of goals where you can clearly measure performance. This allows you to judge the quality of the involved text that was generated and use those cases where the agent was good at its task as training data.
That means that if you have enough compute available to use the system to perform tasks, you get as much training data as you desire. This in turn allows bigger better trained models.