I go back and forth on how big a deal this is. On the one hand I think it’s a real capability and near-term threat (if not today than in 3-6 months from now). Think swarms of agents trying to socially hack you.[1]
On the other I’m not sure how much persuasion capabilities in practice scale with inference-time thinking within the normal human range, it’s plausibly not actually that much.
(Jason’s tweet is about swarms at individually peak human levels but you can also imagine a story where they individually are lower but still work together productively).
I go back and forth on how big a deal this is. On the one hand I think it’s a real capability and near-term threat (if not today than in 3-6 months from now). Think swarms of agents trying to socially hack you.[1]
On the other I’m not sure how much persuasion capabilities in practice scale with inference-time thinking within the normal human range, it’s plausibly not actually that much.
(Jason’s tweet is about swarms at individually peak human levels but you can also imagine a story where they individually are lower but still work together productively).