Thanks for your answer. Would it be fair to say that both of them are oversimplifying the other’s position and that they are both, to some extent, right?
Yes. Also it says on Marcus’s Wikipedia page he founded 2 AI startups, one in 2015 and another in 2019. It is an unreasonable view to believe he doesn’t understand transformers.
Marcus tried other techniques that evidently didn’t work well enough (SOTA for robotics is now a variation on transformers).
Hinton seems to have partial credit for back propagation and recent credit for capsule networks which work but also didn’t work well enough.
Of course Marcus also calls Hinton old in his response, Hinton is 24 years older.
Thanks for your answer. Would it be fair to say that both of them are oversimplifying the other’s position and that they are both, to some extent, right?
Yes. Also it says on Marcus’s Wikipedia page he founded 2 AI startups, one in 2015 and another in 2019. It is an unreasonable view to believe he doesn’t understand transformers.
Marcus tried other techniques that evidently didn’t work well enough (SOTA for robotics is now a variation on transformers).
Hinton seems to have partial credit for back propagation and recent credit for capsule networks which work but also didn’t work well enough.
Of course Marcus also calls Hinton old in his response, Hinton is 24 years older.