Humans may wish for the creation of new sentient beings. But then a paradox arises, because the new beings should also be part of CEV. Then either CEV gives preference to humans existing before CEV was calculated, or CEV fails to converge as a consequence, or CEV finds a solution which can work for both humans and all potential newly created sentient beings.
CEV might work on humans, but then somebody creates a new artificial being with unnatural preferences specifically for the purpose of preventing CEV from converging
Some new ideas which I have not seen previously.
Humans may wish for the creation of new sentient beings. But then a paradox arises, because the new beings should also be part of CEV. Then either CEV gives preference to humans existing before CEV was calculated, or CEV fails to converge as a consequence, or CEV finds a solution which can work for both humans and all potential newly created sentient beings.
CEV might work on humans, but then somebody creates a new artificial being with unnatural preferences specifically for the purpose of preventing CEV from converging