I don’t see the usual commonsense understanding of “values” (or the understanding used in economics or ethics) as relying on values being ontologically fundamental in any way, though. But you’ve the fact that they’re not to make a seemingly unjustified rhetorical leap to “values are just habituations or patterns of action”, which just doesn’t seem to be true.
Most importantly, because the “values” that people are concerned with then they talk about “value drift” are idealized values (ala. extrapolated volition), not instantaneous values or opinions or habituations.
For instance, philosophers such as EY consider that changing one’s mind in response to a new moral argument is not value drift because it preserves one’s idealized values, and that it is generally instrumentally positive because (if it brings one’s instantaneous opinions closer to their idealized values) it makes one better at accomplishing their idealized values. So indeed, we should let the EAs “drift” in that sense.
On the other hand, getting hit with a cosmic ray which alters your brain, or getting hacked by a remote code execution exploit is value drift because it does not preserve one’s idealized values (and is therefore bad, according to the usual decision theoretic argument, because it makes you worse at accomplishing them). And those are the kind of problems we worry about with AI.
.
If what you want is to do the right thing, there’s no conflict here.
Conversely, if you don’t want to do the right thing, maybe it would be prudent to reconsider doing it...?