Yes—I consider this one of the main risks, and when I force myself to rollout plausible stories where superintelligence takes over the world, it often involves a soft takeover via persuasion—but the persuasion really is culture/media domination. We seem to be moving towards a future where most media is created by AI, most knowledge is produced by AI, where even our children are effectively raised by AI. When that AI becomes superintelligent, it could takeover the world very subtlety, without us ever noticing until it’s far too late.
Yes—I consider this one of the main risks, and when I force myself to rollout plausible stories where superintelligence takes over the world, it often involves a soft takeover via persuasion—but the persuasion really is culture/media domination. We seem to be moving towards a future where most media is created by AI, most knowledge is produced by AI, where even our children are effectively raised by AI. When that AI becomes superintelligent, it could takeover the world very subtlety, without us ever noticing until it’s far too late.