Yes! Finally someone gets it. And this isn’t just from things that people consider bad, but from what they consider good also. For most of my life “good” meant what people talk about when they are about to make things worse for everyone, and it’s only recently that I had enough hope to even consider cryonics, thinking that anyone having power over me would reliably cause situation worse than death regardless of how good their intentions were.
Elieser is trying to code in a system of ethics that would remain valid even if the programmers are wrong about important things, and therefore is one of very few people with even a chance of successfully designing a good AI, but almost everyone else is just telling the AI what they should do. That’s why I oppose the halt in AI research he wants.
Yes! Finally someone gets it. And this isn’t just from things that people consider bad, but from what they consider good also. For most of my life “good” meant what people talk about when they are about to make things worse for everyone, and it’s only recently that I had enough hope to even consider cryonics, thinking that anyone having power over me would reliably cause situation worse than death regardless of how good their intentions were.
Elieser is trying to code in a system of ethics that would remain valid even if the programmers are wrong about important things, and therefore is one of very few people with even a chance of successfully designing a good AI, but almost everyone else is just telling the AI what they should do. That’s why I oppose the halt in AI research he wants.