But it illustrates the general idea: the potential poison, in interacting with the complicated human machine, takes on a complicated boundary that doesn’t match the grain of any local boundaries you would draw around substances.
Compared to ‘actions that are right’, even ‘poisons’ seems like a pretty obvious boundary to draw. Where’s the grain around ‘right’? Unlucky for Eliezer, we seem to find some pretty bizarre boundaries ‘useful’.
But it illustrates the general idea: the potential poison, in interacting with the complicated human machine, takes on a complicated boundary that doesn’t match the grain of any local boundaries you would draw around substances.
Compared to ‘actions that are right’, even ‘poisons’ seems like a pretty obvious boundary to draw. Where’s the grain around ‘right’? Unlucky for Eliezer, we seem to find some pretty bizarre boundaries ‘useful’.