There’s a cluster of people, including but not limited to Eliezer, Critch, and Nate, who (according to me) have what I internally call “trustworthy inside views,” another name for which might be the ability to reliably generate useful gears models, and act based on them. This is the thing they do instead of using modest epistemology; it’s the thing that allowed Eliezer to write HPMoR, among many other things. And what all of the people who seem to me to have this ability have in common is that they all have strong backgrounds in a technical subject like math, physics, or computer science (in addition to something else, this isn’t sufficient).
What makes you think this is the result of the technical background rather than a selection effect (where the kind of people who are good at thinking chooses to read technical subjects)?
Good question. So I don’t believe this very strongly at all, but it’s the hypothesis that affords more to do compared to the selection hypothesis so it’s more worth testing. One thing I could learn from running experiments like this repeatedly is that even doing quite a good job teaching math to most people won’t cause them to acquire the inside view skill, which would be an important negative result.
It feels to me like the actual math I know is an important component of my inside view skill. More complicated gears models do in fact have components that resemble components of models in math, physics, etc. and it’s in fact useful to know what kinds of components are out there. Also I think learning math in a particular way was very useful for training the skill in a particular way. But I would not be surprised if it turns out that the skill starts with a nucleus that was determined by some mostly hereditary personality trait that gets nurtured or not depending on exposure to things like math.
I think that it is more of a causal effect than a selection effect (don’t currently have super much time for writing all of it up, but wanted to highlight that while I do think selection effects play a role, there is a large causal effect here as well).
I think the great filter for being this kind of person happens before you’re 8 years old. Do you disagree with that?
To the extent that I am similar, I think I’ve been that way since I was a young child. I was more curious, more interested in numbers, and more pedantic than the other kids my age, at least by kindergarten. I’d be surprised if Eliezer, Critch, and Nate weren’t pretty distinct from other kids by age 5.
FYI, just talked to Critch. According to him, when he was six years old he learned to read by reading an entire encyclopedia, the first actual “book” he read was A Brief History of Time, which had a big impact on him. He was doing things like checking his understanding of reality at multiple layers of abstraction (i.e. couch is made out of leather which is made out of dead skin which is made out of cells, etc) and making sure the models were harmonious with each other sometime soon after.
When he was 4 he had clear memories of being 2 (and still does). In early teens he set out to become an idealized agent.
He says he thinks having the math-thing was necessary but probably not sufficient.
I think in his particular case, there was definitely a lot of unusual stuff going on. (i.e. he needed some amount of nurture in order for the stuff to take root, i.e. parents who bought him an encyclopedia, helped him learn math, but you clearly don’t get the same outcome by giving those same inputs to an arbitrary child)
Eliezer’s written up a lot of his early childhood stuff and AFAICT has a sort of similar thing going on (in his case the nurture stuff seems a bit more relevant, but again, lots of kids seem to get fairly similar nurture and not turn out the same)
What this all means depends a lot on “are you trying to find the best model-builders in the world” vs “are you trying to teach arbitrary pretty smart people how to model build.”
I think the math thing is most likely quite important for learning how to model build, but it’s not obvious in advance to me which sorts of people would be worth investing the effort for it.
So, as a contrast, I claim I also have the ability I’m describing, and I was unusually good at math as a kid (increasingly more so as I got older) and just very smart overall but that was about it. I was in a gifted program in elementary school and a different gifted program in middle school; they did a good job developing my ability to think but I didn’t really use it on anything except math and schoolwork. The thing that unlocked me was my first CFAR workshop, which is when it first occurred to me that I could enjoy using the parts of my brain I’d developed to think about math to think about anything at all.
What makes you think this is the result of the technical background rather than a selection effect (where the kind of people who are good at thinking chooses to read technical subjects)?
Good question. So I don’t believe this very strongly at all, but it’s the hypothesis that affords more to do compared to the selection hypothesis so it’s more worth testing. One thing I could learn from running experiments like this repeatedly is that even doing quite a good job teaching math to most people won’t cause them to acquire the inside view skill, which would be an important negative result.
It feels to me like the actual math I know is an important component of my inside view skill. More complicated gears models do in fact have components that resemble components of models in math, physics, etc. and it’s in fact useful to know what kinds of components are out there. Also I think learning math in a particular way was very useful for training the skill in a particular way. But I would not be surprised if it turns out that the skill starts with a nucleus that was determined by some mostly hereditary personality trait that gets nurtured or not depending on exposure to things like math.
I think it’s almost certainly a selection effect. I was surprised by the apparent implication that it wasn’t.
I think that it is more of a causal effect than a selection effect (don’t currently have super much time for writing all of it up, but wanted to highlight that while I do think selection effects play a role, there is a large causal effect here as well).
I think the great filter for being this kind of person happens before you’re 8 years old. Do you disagree with that?
To the extent that I am similar, I think I’ve been that way since I was a young child. I was more curious, more interested in numbers, and more pedantic than the other kids my age, at least by kindergarten. I’d be surprised if Eliezer, Critch, and Nate weren’t pretty distinct from other kids by age 5.
Hmm, yeah. I think there is a significant chance the great filter is afterwards.
FYI, just talked to Critch. According to him, when he was six years old he learned to read by reading an entire encyclopedia, the first actual “book” he read was A Brief History of Time, which had a big impact on him. He was doing things like checking his understanding of reality at multiple layers of abstraction (i.e. couch is made out of leather which is made out of dead skin which is made out of cells, etc) and making sure the models were harmonious with each other sometime soon after.
When he was 4 he had clear memories of being 2 (and still does). In early teens he set out to become an idealized agent.
He says he thinks having the math-thing was necessary but probably not sufficient.
I think in his particular case, there was definitely a lot of unusual stuff going on. (i.e. he needed some amount of nurture in order for the stuff to take root, i.e. parents who bought him an encyclopedia, helped him learn math, but you clearly don’t get the same outcome by giving those same inputs to an arbitrary child)
Eliezer’s written up a lot of his early childhood stuff and AFAICT has a sort of similar thing going on (in his case the nurture stuff seems a bit more relevant, but again, lots of kids seem to get fairly similar nurture and not turn out the same)
What this all means depends a lot on “are you trying to find the best model-builders in the world” vs “are you trying to teach arbitrary pretty smart people how to model build.”
I think the math thing is most likely quite important for learning how to model build, but it’s not obvious in advance to me which sorts of people would be worth investing the effort for it.
Thanks for writing this up!
So, as a contrast, I claim I also have the ability I’m describing, and I was unusually good at math as a kid (increasingly more so as I got older) and just very smart overall but that was about it. I was in a gifted program in elementary school and a different gifted program in middle school; they did a good job developing my ability to think but I didn’t really use it on anything except math and schoolwork. The thing that unlocked me was my first CFAR workshop, which is when it first occurred to me that I could enjoy using the parts of my brain I’d developed to think about math to think about anything at all.