I don’t think 2 accurately reflects Eliezer’s Preservation target. CEV doesn’t ensure beforehand that any of those core values aren’t thrown out. What’s important is the process by which we decide to adopt or reject values, how that process changes when we learn more, and things like that.
That is also one thing that could now change as the direct result of choices we make, through brain modification, or genetic engineering, or AI’s with whole new value-adoption systems. Our intuition tends to treat this as stable even when we know we’re dealing with ‘different’ cultures.
I don’t think 2 accurately reflects Eliezer’s Preservation target. CEV doesn’t ensure beforehand that any of those core values aren’t thrown out. What’s important is the process by which we decide to adopt or reject values, how that process changes when we learn more, and things like that.
That is also one thing that could now change as the direct result of choices we make, through brain modification, or genetic engineering, or AI’s with whole new value-adoption systems. Our intuition tends to treat this as stable even when we know we’re dealing with ‘different’ cultures.