I think this puts a lot of weight on a bespoke definition of “interesting” and that kind of obscures what you’re saying. I feel similar about your use of the concept of creativity.
I think that current LLMs are extremely “creative” for many plausible definitions of that word, so I guess it doesn’t really carve things at the joints for me. Visual art, stories, plausible baby names, what sorts of recipes you can try with x ingredients. All written-ont-the-tin use cases for these things.
I do not believe that LLMs think very much in the manner that we do at all. I just don’t think I would pitch that as lacking some true spark of creativity or something. It is too opaque to me what you’re saying.
I read what I thought were the relevant excerpts in what you linked there. I hadn’t really crossed paths with you before, but you seem to have a rich ontology and lexicon when it comes to theory of mind.
I am not sure if that pinpoints the disagreement or not. We might just be talking past each other. I’ll tell you what I think creativity is and then I’ll restate my objection to your prediction.
I do think “creativity” is a useful word, just maybe not a load bearing one in my ontology.
Like, if I really like a story and it has a lot of unexpected elements that I think it uses really well, that is what I might call creative. Or anything like that if it feels novel, exciting, clever sort of thing… Maybe if someone were giving something high praise and wanted to say it is very deep and clever they could say it is “very creative”. Especially if it was artistic or novel.
Also sometimes when it is just a lot of whacky things are together even if it’s not that clever. Like, when a kid combines a lot of elements into their pretend world or story.
Ya, I know it has something to do with a minds ability to keep learning and improving. Your “trajectory of creativity” concept is about a minds ability to continue to improve beyond the minds around it. I don’t resonate with those usages as much, but I can also kind of understand where it’s coming from and how you’re using the word.
I think my original objection / pushback was partly that it feels hard to operationalize this because what you find interesting is kind of just your thing and it doesn’t seem like a meaningful proxy for intelligence or something. I guess I would add that surely some people are already impressed and interested with some math ideas that chatbots can come up with. Also, perhaps if you could visualize extremely high dimensional spaces you would think that AlphaEvolves proofs were beautiful, elegant, and crisp. I’m not saying there’s no information/signal in what you’re saying; I just found it left a lot unclear for me when I first read it I guess.
I get that LLMs clearly aren’t as good at publishing new top tier math papers or whatever. I guess, gun to my head, I would put most of that down to, like… lacking many of the cognitive abilities needed to independently execute on large scale, messy tasks independently. Or some mix of attributes like that. I would also expect them to have really bad vibes based planning abilities… And plus by the time off the shelf AIs can write math papers of a given quality tier, the goalposts for interestingness will move accordingly… Maybe there is something to the idea that they are not generally inclined towards effing the ineffable and carving structure from reality, but also I doubt they’d have trouble with eg. neologisms.
I agree that it’s hard to operationalize; that’s part of what my OP was saying. And then I think it’s relatively easier to operationalize in mathematics, where it is in large part explicitly about creativity in my sense (but maybe not especially much in your sense). So that’s where I’m getting my prediction; if you don’t see what I mean by creativity, or wouldn’t make the same prediction, then fair enough, we’ll have to agree to disagree.
I think this puts a lot of weight on a bespoke definition of “interesting” and that kind of obscures what you’re saying. I feel similar about your use of the concept of creativity.
I think that current LLMs are extremely “creative” for many plausible definitions of that word, so I guess it doesn’t really carve things at the joints for me. Visual art, stories, plausible baby names, what sorts of recipes you can try with x ingredients. All written-ont-the-tin use cases for these things.
I do not believe that LLMs think very much in the manner that we do at all. I just don’t think I would pitch that as lacking some true spark of creativity or something. It is too opaque to me what you’re saying.
So basically you just don’t think creativity is a thing? That’s one impasse we could be at. What I mean is gestured at here:
https://tsvibt.blogspot.com/2022/08/structure-creativity-and-novelty.html
More discussion here:
https://tsvibt.blogspot.com/2023/01/the-voyage-of-novelty.html
https://tsvibt.blogspot.com/2023/01/endo-dia-para-and-ecto-systemic-novelty.html
https://tsvibt.blogspot.com/2023/01/a-strong-mind-continues-its-trajectory.html
Hey, thanks for engaging.
I read what I thought were the relevant excerpts in what you linked there. I hadn’t really crossed paths with you before, but you seem to have a rich ontology and lexicon when it comes to theory of mind.
I am not sure if that pinpoints the disagreement or not. We might just be talking past each other. I’ll tell you what I think creativity is and then I’ll restate my objection to your prediction.
I do think “creativity” is a useful word, just maybe not a load bearing one in my ontology.
Like, if I really like a story and it has a lot of unexpected elements that I think it uses really well, that is what I might call creative. Or anything like that if it feels novel, exciting, clever sort of thing… Maybe if someone were giving something high praise and wanted to say it is very deep and clever they could say it is “very creative”. Especially if it was artistic or novel.
Also sometimes when it is just a lot of whacky things are together even if it’s not that clever. Like, when a kid combines a lot of elements into their pretend world or story.
Ya, I know it has something to do with a minds ability to keep learning and improving. Your “trajectory of creativity” concept is about a minds ability to continue to improve beyond the minds around it. I don’t resonate with those usages as much, but I can also kind of understand where it’s coming from and how you’re using the word.
I think my original objection / pushback was partly that it feels hard to operationalize this because what you find interesting is kind of just your thing and it doesn’t seem like a meaningful proxy for intelligence or something. I guess I would add that surely some people are already impressed and interested with some math ideas that chatbots can come up with. Also, perhaps if you could visualize extremely high dimensional spaces you would think that AlphaEvolves proofs were beautiful, elegant, and crisp. I’m not saying there’s no information/signal in what you’re saying; I just found it left a lot unclear for me when I first read it I guess.
I get that LLMs clearly aren’t as good at publishing new top tier math papers or whatever. I guess, gun to my head, I would put most of that down to, like… lacking many of the cognitive abilities needed to independently execute on large scale, messy tasks independently. Or some mix of attributes like that. I would also expect them to have really bad vibes based planning abilities… And plus by the time off the shelf AIs can write math papers of a given quality tier, the goalposts for interestingness will move accordingly… Maybe there is something to the idea that they are not generally inclined towards effing the ineffable and carving structure from reality, but also I doubt they’d have trouble with eg. neologisms.
I agree that it’s hard to operationalize; that’s part of what my OP was saying. And then I think it’s relatively easier to operationalize in mathematics, where it is in large part explicitly about creativity in my sense (but maybe not especially much in your sense). So that’s where I’m getting my prediction; if you don’t see what I mean by creativity, or wouldn’t make the same prediction, then fair enough, we’ll have to agree to disagree.