What’s the ROI for a super-intelligent, self-aware machine?
That clearly depends on how super is “super-intelligent”. For a trivial example, imagine an AI which can successfully trade in the global financial markets.
What happens if it doesn’t want to—if it decides to do digital art or start life in another galaxy?
That’s the thing, a self-aware intelligent thing isn’t bound to do the tasks you ask of it, hence a poor ROI. Humans are already such entities, but far cheaper to make, so a few who go off and become monks isn’t a big problem.
That clearly depends on how super is “super-intelligent”. For a trivial example, imagine an AI which can successfully trade in the global financial markets.
What happens if it doesn’t want to—if it decides to do digital art or start life in another galaxy?
That’s the thing, a self-aware intelligent thing isn’t bound to do the tasks you ask of it, hence a poor ROI. Humans are already such entities, but far cheaper to make, so a few who go off and become monks isn’t a big problem.
You give it proper incentives :-)
Or, even simpler X-)
Nope, remember, we’re talking about a super-intelligent entity.