I am concerned about it, and I do advocate better computer security—there are good reasons for it regardless of whether human-level AI is around the corner. The macro-scale trends still don’t look good (iOS is a tiny fraction of the internet’s install base), but things do seem to be improving slowly. I still expect a huge number of networked computers to remain soft targets for at least the next decade, probably two. I agree that once that changes, this Obviously Scary Scenario will be much less scary (though the “Hannibal Lecter running orders of magnitude faster than realtime” scenario remains obviously scary, and I personally find the more general Foom arguments to be compelling).
I am concerned about it, and I do advocate better computer security—there are good reasons for it regardless of whether human-level AI is around the corner. The macro-scale trends still don’t look good (iOS is a tiny fraction of the internet’s install base), but things do seem to be improving slowly. I still expect a huge number of networked computers to remain soft targets for at least the next decade, probably two. I agree that once that changes, this Obviously Scary Scenario will be much less scary (though the “Hannibal Lecter running orders of magnitude faster than realtime” scenario remains obviously scary, and I personally find the more general Foom arguments to be compelling).