As I read the thread, people don’t seem to be arguing that you can’t make pure data-predictors that don’t turn agentic, but instead are arguing that they’re going to be heavily limited due to lacking unbounded agency. Which seems basically correct to me.
There’s the Gwern-style argument that successive generations AIs will get more agentive as a side of effect of the market demanding more powerful AIs. There’s a counterargument that non-one wants power that they can’t control, so that AIs will never be more than force multipliers .. although that’s still fairly problematic.
As I read the thread, people don’t seem to be arguing that you can’t make pure data-predictors that don’t turn agentic, but instead are arguing that they’re going to be heavily limited due to lacking unbounded agency. Which seems basically correct to me.
There’s the Gwern-style argument that successive generations AIs will get more agentive as a side of effect of the market demanding more powerful AIs. There’s a counterargument that non-one wants power that they can’t control, so that AIs will never be more than force multipliers .. although that’s still fairly problematic.
People will probably want to be ahead in the race for power, while still maintaining control.