the best you can do is what you think is personally good
As far as you’re an ideal optimizing agent with consistent values and full knowledge, otherwise actions based on your thoughts may end up worse than using social heuristics.
That there are no bugs when it comes to values. That you should care about exactly what you want to care about. That if you want to team up and save the world from AI or poverty or mortality, you can, but you don’t have to.
Locally invalid. Values can be terminal (what you care about) and instrumental, and saving the world for most people is actually instrumental.
There’s value in giving explicit permission to confused newcomers to not get trapped in moral chains, because it’s really easy to hurt yourself doing that.
I think that’s true since memes can be harmful, but there is also value in reminding that if more people worked to save improve the world on average, it would be better, and often a simpler way is to do that yourself instead of pushing that meme+responsibility out.
Save the world if you want to, but please don’t if you don’t want to.
I’d continue that with “but please don’t destroy the world whichever option you choose, since that will interfere with my terminal goals and I’ll care about your non-existence”.
As far as you’re an ideal optimizing agent with consistent values and full knowledge, otherwise actions based on your thoughts may end up worse than using social heuristics.
Locally invalid. Values can be terminal (what you care about) and instrumental, and saving the world for most people is actually instrumental.
I think that’s true since memes can be harmful, but there is also value in reminding that if more people worked to
saveimprove the world on average, it would be better, and often a simpler way is to do that yourself instead of pushing that meme+responsibility out.I’d continue that with “but please don’t destroy the world whichever option you choose, since that will interfere with my terminal goals and I’ll care about your non-existence”.