To me this sort of approach feels like a non-starter because you’re ignoring the thing that generates the policy in favor of the policy itself, which would seem to expose you to Goodharting that would be even worse than the Goodharting we expect in terms of values since policy is a grosser instrument. Is there some way in which you think this is not that case, namely that focusing on policy alignment would help us better avoid Goodharting than is possible with value alignment?
To me this sort of approach feels like a non-starter because you’re ignoring the thing that generates the policy in favor of the policy itself, which would seem to expose you to Goodharting that would be even worse than the Goodharting we expect in terms of values since policy is a grosser instrument. Is there some way in which you think this is not that case, namely that focusing on policy alignment would help us better avoid Goodharting than is possible with value alignment?