I think all the leading theories of human value struggle to explain all the observations.
The “godshatter” theory of 100s of tiny genetic values is really flexible and can predict anything, but I don’t have a compelling explanation of why someone would satisfy their genetic drive to help strangers with sperm rather than bed nets.
The “shard theory” of learned values primed by a handful of basic signals is a bit better, I can tell a story about someone having a masturbation shard and a helping others shard and a making babies shard and a making money shard. But it’s also really bad about being able to predict anything.
I also have some basic confusions about what a good theory of human value looks like given that we are very small and have been optimized away from self-knowledge.
Yeah, I don’t have a good theory. Another piece of the puzzle: https://en.wikipedia.org/wiki/Cognitive_miser ; organisms will be evolved to be guided as heavily as possible, with a minimum of online compute, to behaviors that increase IGF; you avoid thinking about things (and un-sharding your values) as much as you can get away with.
I think all the leading theories of human value struggle to explain all the observations.
The “godshatter” theory of 100s of tiny genetic values is really flexible and can predict anything, but I don’t have a compelling explanation of why someone would satisfy their genetic drive to help strangers with sperm rather than bed nets.
The “shard theory” of learned values primed by a handful of basic signals is a bit better, I can tell a story about someone having a masturbation shard and a helping others shard and a making babies shard and a making money shard. But it’s also really bad about being able to predict anything.
I also have some basic confusions about what a good theory of human value looks like given that we are very small and have been optimized away from self-knowledge.
Yeah, I don’t have a good theory. Another piece of the puzzle: https://en.wikipedia.org/wiki/Cognitive_miser ; organisms will be evolved to be guided as heavily as possible, with a minimum of online compute, to behaviors that increase IGF; you avoid thinking about things (and un-sharding your values) as much as you can get away with.