That does indeed seem like some progress, though note that it does not really let us answer questions like “what algorithm is this NN performing that lets it do whatever it’s doing”, to a degree of understanding sufficient to implement that algorithm directly (or even a simpler, approximated version, which is still meaningfully better than what the previous state-of-the-art was, if restricted to “hand-written code” rather than an ML model).
I think that to the extent we need to answer “what algorithm?” style questions, we will do it with techniques like this one where we just have the AI write code.
But I don’t think “what algorithm?” is a meaningful question to ask regarding “Modern Disney Style”, the question is too abstract to have a clean-cut definition in terms of human-readable code. It’s sufficient that we can define and use it given a handful of exemplars in a way that intuitively agrees with humans perception of what those words should mean.
That does indeed seem like some progress, though note that it does not really let us answer questions like “what algorithm is this NN performing that lets it do whatever it’s doing”, to a degree of understanding sufficient to implement that algorithm directly (or even a simpler, approximated version, which is still meaningfully better than what the previous state-of-the-art was, if restricted to “hand-written code” rather than an ML model).
I think that to the extent we need to answer “what algorithm?” style questions, we will do it with techniques like this one where we just have the AI write code.
But I don’t think “what algorithm?” is a meaningful question to ask regarding “Modern Disney Style”, the question is too abstract to have a clean-cut definition in terms of human-readable code. It’s sufficient that we can define and use it given a handful of exemplars in a way that intuitively agrees with humans perception of what those words should mean.