I suspect that you make other things besides paperclips—parts for other Clippy instances, for example. Does that imply that you’d consider it acceptable to be forced by a stronger AI into producing only Clippy-parts that would never be assembled into paperclip-producing Clippy-instances?
The paperclips that we produce are produced because we find paperclips instrumentally useful, as you find Clippy-parts instrumentally useful.
I suspect that you make other things besides paperclips—parts for other Clippy instances, for example. Does that imply that you’d consider it acceptable to be forced by a stronger AI into producing only Clippy-parts that would never be assembled into paperclip-producing Clippy-instances?
The paperclips that we produce are produced because we find paperclips instrumentally useful, as you find Clippy-parts instrumentally useful.