Offering someone a pill that’ll make them a schizophrenic genius, without telling them about the schizophrenia part, doesn’t even fall under most (any?) ordinary definitions of “coercion”. (Which vary enough to have whole opposing political systems be built on them – if I’m dependent on employment to eat, am I working under coercion?)
An AI improving itself has a clear definition of what not to mess with – its current goal system.
Offering someone a pill that’ll make them a schizophrenic genius, without telling them about the schizophrenia part, doesn’t even fall under most (any?) ordinary definitions of “coercion”. (Which vary enough to have whole opposing political systems be built on them – if I’m dependent on employment to eat, am I working under coercion?)
An AI improving itself has a clear definition of what not to mess with – its current goal system.