I should have made that more clear: I still think Weak-Friendliness is a very difficult problem. My point is simply that we only need an AI that solves the big problems, not an AI that can do our taxes. My second point was that humans seem to already implement weak-friendliness, barring a few historical exceptions, whereas so far we’ve completely failed at implementing strong-friendliness.
I’m using Weak vs Strong here in the sense of Weak being a “SysOP” style AI that just handles catastrophes, whereas Strong is the “ushers in the Singularity” sort that usually gets talked about here, and can do your taxes :)
I should have made that more clear: I still think Weak-Friendliness is a very difficult problem. My point is simply that we only need an AI that solves the big problems, not an AI that can do our taxes. My second point was that humans seem to already implement weak-friendliness, barring a few historical exceptions, whereas so far we’ve completely failed at implementing strong-friendliness.
I’m using Weak vs Strong here in the sense of Weak being a “SysOP” style AI that just handles catastrophes, whereas Strong is the “ushers in the Singularity” sort that usually gets talked about here, and can do your taxes :)