Yeah, spikiness has been an issue, but the floor is starting to get mopped up. The “unable to correctly cite a reference” thing isn’t quite fair anymore, though even current SOTA systems aren’t reliable in that regard.
The point about needing background is good, though the AI might need specialized training/instructions for specialized tasks in the same way a human would. There’s no way it could know a particular organization’s classified operating procedures from the factory, for example. Defining (strong) AGI as being able to perform every computer task at the level of the median human who has been given appropriate training (once it’s had the same training a human would get, if necessary) seems sensible. (I guess you could argue that that’s technically covered under the simpler definition.)
Yeah, spikiness has been an issue, but the floor is starting to get mopped up. The “unable to correctly cite a reference” thing isn’t quite fair anymore, though even current SOTA systems aren’t reliable in that regard.
The point about needing background is good, though the AI might need specialized training/instructions for specialized tasks in the same way a human would. There’s no way it could know a particular organization’s classified operating procedures from the factory, for example. Defining (strong) AGI as being able to perform every computer task at the level of the median human who has been given appropriate training (once it’s had the same training a human would get, if necessary) seems sensible. (I guess you could argue that that’s technically covered under the simpler definition.)