No voice recognition, and the mechanical buzzer pushing thing was kinda silly, but still, not bad. Certainly at least a decent step in natural language processing, right?
I know this is not at all anything like general AI (though I gather from the descriptions that there’s at least some form of reinforcement learning going on when it gets stuff wrong. I may be wrong on that though), but still, I feel at least a bit impressed. (I wish there’d been auditory speech processing too, instead of receiving text, but...)
Certainly at least a decent step in natural language processing, right?
It’s substantially better than other question answering systems, so in that sense yes. On the other hand, it’s probably still movement towards a local maximum, rather than a robust, general strategy.
Robust, general natural language processing requires a proper grammar and parser, to get back an actionable semantic representation. That’s the kind of language processing module you’ll be able to reuse in lots of different applications.
Watson probably isn’t doing that. The system probably cherry-picks keywords, and uses a statistical classifier to predict the category of answer expected. Maybe a syntactic parse is used to help find clues, but I doubt it’s the main method.
I did my PhD on statistical parsing and am continuing to work on it as a post-doc. We’re getting better, but it’s still usually less practical than an ad hoc strategy for any given task. That doesn’t mean Watson isn’t impressive, of course. Watson shows us what can be done right now, and apparently what can be done is pretty damn sweet.
Though it’s doing more than just individual keyword stuff. I think one major point is that it’s looking at context (ie, I think it’s supposed to have at least a basic ability to deal with puns and such.)
Also, I think it is set up to learn the theme of a category if it’s not initially sure (via associated questions and answers), and using that info to get an idea of what types of answers are being sought in a particular category.
If it’s not parsing, if it’s just keyword analysis rather than any analysis of grammar, it’s going way beyond just judging the keywords individually. (Not to mention, it’s parsing enough to at least figure out which words are the ones to use for its keyword search, I think.)
Do you think that Watson is anywhere near the local maximum associated with the strategies you think is being used by that system, incidentally?
Having looked through their overview paper, I’m no longer sure. They do have modules that do parsing and semantic role labelling and such. But their model is a mixture of dozens of individual models. So it’s tough to say much about how things are fitting together. They use more sophisticated techniques than I thought, although I don’t know how much contribution those techniques actually make in the final decision.
I know this is not at all anything like general AI
I’ll confess that I still have a hard time shaking the intuition that this is how general AI will be arrived at, if and when it is: a bunch of things like this, more impressive with each generation, until it gradually occurs to us over the course a few decades or centuries that our computers can do everything we can do.
No voice recognition, and the mechanical buzzer pushing thing was kinda silly, but still, not bad. Certainly at least a decent step in natural language processing, right?
I know this is not at all anything like general AI (though I gather from the descriptions that there’s at least some form of reinforcement learning going on when it gets stuff wrong. I may be wrong on that though), but still, I feel at least a bit impressed. (I wish there’d been auditory speech processing too, instead of receiving text, but...)
EDIT: either way, it’s still just plain cool! :)
It’s substantially better than other question answering systems, so in that sense yes. On the other hand, it’s probably still movement towards a local maximum, rather than a robust, general strategy.
Robust, general natural language processing requires a proper grammar and parser, to get back an actionable semantic representation. That’s the kind of language processing module you’ll be able to reuse in lots of different applications.
Watson probably isn’t doing that. The system probably cherry-picks keywords, and uses a statistical classifier to predict the category of answer expected. Maybe a syntactic parse is used to help find clues, but I doubt it’s the main method.
I did my PhD on statistical parsing and am continuing to work on it as a post-doc. We’re getting better, but it’s still usually less practical than an ad hoc strategy for any given task. That doesn’t mean Watson isn’t impressive, of course. Watson shows us what can be done right now, and apparently what can be done is pretty damn sweet.
Huh, thanks.
Though it’s doing more than just individual keyword stuff. I think one major point is that it’s looking at context (ie, I think it’s supposed to have at least a basic ability to deal with puns and such.)
Also, I think it is set up to learn the theme of a category if it’s not initially sure (via associated questions and answers), and using that info to get an idea of what types of answers are being sought in a particular category.
If it’s not parsing, if it’s just keyword analysis rather than any analysis of grammar, it’s going way beyond just judging the keywords individually. (Not to mention, it’s parsing enough to at least figure out which words are the ones to use for its keyword search, I think.)
Do you think that Watson is anywhere near the local maximum associated with the strategies you think is being used by that system, incidentally?
Having looked through their overview paper, I’m no longer sure. They do have modules that do parsing and semantic role labelling and such. But their model is a mixture of dozens of individual models. So it’s tough to say much about how things are fitting together. They use more sophisticated techniques than I thought, although I don’t know how much contribution those techniques actually make in the final decision.
Thanks for looking at the paper and passing on the info about what’s actually going in inside it, btw.
I’ll confess that I still have a hard time shaking the intuition that this is how general AI will be arrived at, if and when it is: a bunch of things like this, more impressive with each generation, until it gradually occurs to us over the course a few decades or centuries that our computers can do everything we can do.
That describes the notion of non-sentient actors that adapt perfectly to the human living environment. A somewhat terrifying idea.