Like if I’m choosing which pair of shoes to buy, and I ask the AI for help, and no matter what preferences I had for shoes to begin with, I end up buying blue shoes, then I’m probably being manipulated.
Manipulation 101: tell people “We only have blue shoes in stock. Take it or leave it.”
EDIT: This example was intentionally chosen because it could be true. How do we distinguish between ‘effects of the truth’ and ‘manipulation’?
Speculative: It’s possible that things we see as maladaptive (why ‘resist the truth?’ - “it is never rational to do so”) may exist because of difficulties we have distinguishing the two.
Manipulation 101: tell people “We only have blue shoes in stock. Take it or leave it.”
EDIT: This example was intentionally chosen because it could be true. How do we distinguish between ‘effects of the truth’ and ‘manipulation’?
Speculative: It’s possible that things we see as maladaptive (why ‘resist the truth?’ - “it is never rational to do so”) may exist because of difficulties we have distinguishing the two.