This is kinda tangential maybe, but there are AI advantages that make some types of superhuman persuasion very plausible, and maybe already happening at scale (twitter bot networks). In particular, AI has the advantage of being easily parallelizable, which makes sum-threshold attacks and astroturfing / Sybil attacks on social trust networks feasible. Like, part of how we make decisions is through intuitions about what people around us think; we usually give at least some weight to channels that we didn’t verify carefully; when we don’t verify carefully, we’re open to bots; when bots are coordinated, they can pump a large total quantity of social gradient through the social networks of trust.
(This is pretty different from a sustained one-on-one conversation.)
This is kinda tangential maybe, but there are AI advantages that make some types of superhuman persuasion very plausible, and maybe already happening at scale (twitter bot networks). In particular, AI has the advantage of being easily parallelizable, which makes sum-threshold attacks and astroturfing / Sybil attacks on social trust networks feasible. Like, part of how we make decisions is through intuitions about what people around us think; we usually give at least some weight to channels that we didn’t verify carefully; when we don’t verify carefully, we’re open to bots; when bots are coordinated, they can pump a large total quantity of social gradient through the social networks of trust.
(This is pretty different from a sustained one-on-one conversation.)