This doesn’t seem to mesh with the Friendly AI goal of getting it perfectly right on the first try.
Do we accept some uncertainty and risk to do something extraordinary now, or do we take the slow, calm, deliberative course that stands a chance of achieving perfection?
Is there any chance of becoming a master of the blade without beginning to cut?
This can be solved with an expected utility calculation.
Or to put it another way: if messing up with a sword even once meant that you would almost certainly lop your leg off, then it would make a whole lot of sense to use only a Nerf sword until you became a master.
This doesn’t seem to mesh with the Friendly AI goal of getting it perfectly right on the first try.
Do we accept some uncertainty and risk to do something extraordinary now, or do we take the slow, calm, deliberative course that stands a chance of achieving perfection?
Is there any chance of becoming a master of the blade without beginning to cut?
This can be solved with an expected utility calculation.
Or to put it another way: if messing up with a sword even once meant that you would almost certainly lop your leg off, then it would make a whole lot of sense to use only a Nerf sword until you became a master.