Humans (at least most of us, including all I’ve talked deeply with) don’t actually have utility functions which are consistent over time (nor reflectively consistent at points in time, but that’s a different point). You almost certainly have preference curves over multiple timeframes and levels of abstraction.
You can choose to reinforce some conceptions of your preference sets and suppress or override others, and over time these will become habit, and your “true” utility function will be different than you used to think.
You probably can’t fully rewrite yourself completely arbitrarily, but you CAN over time “become better” by adjusting your instincts and your interpretation of experiences to more closely match your intellectual meta-preferences.
Humans (at least most of us, including all I’ve talked deeply with) don’t actually have utility functions which are consistent over time (nor reflectively consistent at points in time, but that’s a different point). You almost certainly have preference curves over multiple timeframes and levels of abstraction.
You can choose to reinforce some conceptions of your preference sets and suppress or override others, and over time these will become habit, and your “true” utility function will be different than you used to think.
You probably can’t fully rewrite yourself completely arbitrarily, but you CAN over time “become better” by adjusting your instincts and your interpretation of experiences to more closely match your intellectual meta-preferences.