I think you’re systematically failing to appreciate how things that have been optimized to look good to you can predictably behave differently in domains where they haven’t been optimized to look good to you—
My girlfriend’s cat doesn’t appear cute to me because I’m not the one feeding it. From the outside, it’s really obvious to see that the cat performs experiments to see what elicits desired behaviors. If I started feeding it it would bother at all trying to optimize at me. If you generalize house cats you get torture of billions of sentient creatures.
My girlfriend’s cat doesn’t appear cute to me because I’m not the one feeding it. From the outside, it’s really obvious to see that the cat performs experiments to see what elicits desired behaviors. If I started feeding it it would bother at all trying to optimize at me. If you generalize house cats you get torture of billions of sentient creatures.