Interesting post! I’ve wondered the same thing before.
I’m doing a much more half-arsed version, as a casual quantum foundations enjoyer alongside a technical writing job, and also getting endlessly distracted by other things I find interesting, so my output is not impressive. But it’s a pretty fun hobby and I’m surprised more people don’t try this!
Oozeware?
I keep thinking about this post! I’ve been trying to get back into playing violin on and off, and it does a good job of describing why I’ve found that so hard. I stopped early on in your fourth stage, and my ear is way ahead of my ability to play anything it actually wants to listen to.
I guess once I join an orchestra I’ll enjoy that enough to get some momentum, but solo playing is pretty unrewarding right now.
I’m enjoying this whole series, but this one’s extra relevant because I’m doing something similar right now in a less structured way, so I can pick up some ideas.
I’m working on being able to notice, when talking to people, that I can expand my awareness out to include my surroundings. (The idea is that this gives me space to notice what I feel and have curiosity about what they feel, rather than being locked into ‘polite conversation bot’ mode, but right now just noticing is the important bit.)
I like the noticing timeline, it fits very well with what I’m experiencing. I’m sort of between stages 2 and 3 depending on the situation, and normally either remember just after or notice some time during.
I think I’m going to experiment with an explicit marking action and a tally, and probably toy situations as well. Thanks for all the ideas!
One confusion I wrote down in advance was “I still don’t quite know how to predict that there will not be a simple mathematical apparatus that explains something. Why the motion of the planets, why the game of chance, why not the color of houses in England or the number of hairs on a man’s head?”
I think the main thing I’d look for is an unusual amount of regularity. This comes in two types:
Natural regularity: unusual ‘spherical cow’ type situations like the movement of the planets. Things that are somehow isolated, or where some particular effect strongly dominates, so that only a few variables are needed
Artificial regularity: a lot of the regularity we see around us is there because people engineered it. Dice and coins are good examples. Can’t remember details but I think there’s some interesting stuff on the history of dice, e.g. this link says that ‘Only in the middle of the 15th century did it become standard to use symmetric cubes’. I think it would be hard to invent probability theory when gambling with irregularly shaped lumps.
There doesn’t seem to be any particularly obvious regularity to house colours or number of hairs, they just look like your standard-issue messy situations that don’t tell you much.
Thanks for the reply! I also feel like I rely heavily on the audio loop currently, hoping I can boost the visual sketchpad side.
Happened to look this post up again this morning and apparently it’s review season, so here goes...
This post inspired me to play around with some very basic visualisation exercises last year. I didn’t spend that long on it, but I think of myself as having a very weak visual imagination and this pushed me in the direction of thinking that I could improve this a good deal if I put the work in. It was also fascinating to surface some old visual memories.
I’d be intrigued to know if you’ve kept using these techniques since writing the post.
Actually this was something that I meant to talk about in the post and forgot. I wasn’t expecting that anyone would want to read the resulting posts at all, and I’m pretty sure that I wouldn’t enjoy reading this sort of thing very much myself if someone else was producing it, but some people liked them a surprising amount. I don’t fully understand what’s appealing about them—maybe something about the immediacy of it?
Most of my sample of opinions is coming from twitter, which probably selects for people who can tolerate reading fragmented, disjointed stuff.
In practice it would take me longer than 15 minutes to do even a sloppy editing pass, I’m just not very quick at that sort of thing. And I don’t want to add extra requirements anyway, the whole point for me is to be able to do this quickly.
I like this idea a lot. I often do pomodoros but there seems to be a lot of potential for other uses of timers while working.
My favourite version of this advice is Sarah Perry’s writing graph (from the Ribbonfarm longform course, I think) - maybe that’s one of the places you saw it?
I also ignore it a lot :(
I’d like to give this post a second nomination. I’m also trying various experiments in tracking down and listening to hidden/ignored emotions and find other peoples’ accounts of this very helpful—it was well worth a reread. I also like the vivid real-life examples.
Thanks! I have been meaning to add a ‘start here’ page for a while, so that’s good to have the extra push :) Seems particularly worthwhile in my case because a) there’s no one clear theme and b) I’ve been trying a lot of low-quality experimental posts this year bc pandemic trashed motivation, so recent posts are not really reflective of my normal output.
For now some of my better posts in the last couple of years might be Cognitive decoupling and banana phones (tracing back the original precursor of Stanovich’s idea), The middle distance (a writeup of a useful and somewhat obscure idea from Brian Cantwell Smith’s On the Origin of Objects), and the negative probability post and its followup.
This is only tangentially relevant, but adding it here as some of you might find it interesting:
Venkatesh Rao has an excellent Twitter thread on why most independent research only reaches this kind of initial exploratory level (he tried it for a bit before moving to consulting). It’s pretty pessimistic, but there is a somewhat more optimistic follow-up thread on potential new funding models. Key point is that the later stages are just really effortful and time-consuming, in a way that keeps out a lot of people trying to do this as a side project alongside a separate main job (which I think is the case for a lot of LW contributors?)
Quote from that thread:
Research =
a) long time between having an idea and having something to show for it that even the most sympathetic fellow crackpot would appreciate (not even pay for, just get)
b) a >10:1 ratio of background invisible thinking in notes, dead-ends, eliminating options etc
With a blogpost, it’s like a week of effort at most from idea to mvp, and at most a 3:1 ratio of invisible to visible. That’s sustainable as a hobby/side thing.
To do research-grade thinking you basically have to be independently wealthy and accept 90% deadweight losses
Also just wanted to say good luck! I’m a relative outsider here with pretty different interests to LW core topics but I do appreciate people trying to do serious work outside academia, have been trying to do this myself, and have thought a fair bit about what’s currently missing (I wrote that in a kind of jokey style but I’m serious about the topic).
I haven’t thought about the bat and ball question specifically very much since writing this post, but I did get a lot of interesting comments and suggestions that have sort of been rolling around my head in background mode ever since. Here’s a few I wanted to highlight:
Is the bat and ball question really different to the others? First off, it was interesting to see how much agreement there was with my intuition that the bat and ball question was interestingly different to the other two questions in the CRT. Reading through the comments I count four other people who explicitly agree with this (1, 2, 3, 4) and three who either explicitly disagree or point out that they find the widget problem hardest (5, 6, 7). I’d be intrigued to know if other people also disagree that the bat and ball feels different to them.
Concrete vs abstract quantities. Out of the people who agreed with that the bat and ball is different, this comment from @awbery does a particularly good job of giving a potential explanation for why:
The problem is a ‘two things’ problem. The first sentence presents two things, a bat and a ball. The language correctly reflects there are two things we should consider. The first sentence is ‘this plus that equals $1.10’. It correctly sounds like a + b; two things. The first sentence presents the state of affairs, not the problem itself. The second sentence presents the problem. The language of the second sentence reinforces the two things idea because there’s still the bat and the ball and they’re compared against each other: ‘there’s this one and it’s more than that one’. The trickiness is that it is a two things problem, but the two things we need to consider are not the most object level single units, but the bat, and the bat-plus-ball. Our brains are pulled toward the object level division of things by the language and the visual nature of the problem. We have to think really hard to understand that the abstract construct of the problem is the same shape as the state of affairs – there are two things to consider in relation to each other – but while the bat and the ball are still involved, they’re reconfigured by a non-intuitive/non-object-like division.
There’s no object level mirror trick in the other two problems, they’re straight forward maths mapping an object level visual representation. The widget problem presents a process which doesn’t change how the machines and widgets relate to each other in its solution. Our brains don’t have to mash up the pond and the lilies to separate the visual presentation to an abstract level. We can see that the pond is the same pond, half covered with lilies then fully covered with lilies at the next step. We don’t suddenly have some new abstract unreal configuration of lilies and pond to contend with.
I think this is why Kyzentun and Ander’s methods help get at the bat and ball problem intuitively – because they bypass the conflict between object level and abstract and translate it into the formal algebra realm. The problem as presented is non-intuitive because the objects visualization it suggests doesn’t reflect the shape of the formal solution.
So I think this is a particular type of problem, one in which visual shape and language of the presentation collude to obfuscate the visualization of the solution at an abstract/formal level. It’s a different type of problem to the other two in this sense, because the objects they present can be used as given in the solution.
Closeness to correct answer. Another interesting possibility is in TheManxLoiner’s comment—that the bat and ball problem is difficult because the incorrect answer is ‘close to the real one’, whereas for the other two problems the incorrect answer is ‘wildly off’. I’ve written a comment in response but I need to think about this more.
Ethnomethodology. David Chapman pointed out that these introspective accounts of what people are thinking when they solve maths problems are very unreliable, and that I’d probably be better concentrating strictly on what people do, as in ethnomethodology:
Yes, the fundamental principle of ethnomethodological methodology is “look at what people say and do, and don’t ever speculate about what’s happening in their head, because we can’t know.” At first that seems like a straitjacket, and highly unintuitive; but it forces you to really look, and then you see what is going on.
This sounds promising. I’m only just getting round to reading some ethnomethodology, and I haven’t got my bearings yet.
Cognitive decoupling. There’s a link with cognitive decoupling (in Stanovich’s original sense) that could be worth exploring further. Success in the bat and ball problem seems to involve decoupling from the noisy wrong answer. David Chapman recommended Formal Languages in Logic by Dutilh Novaes for more background on this. So far I’ve read maybe a third of it. I’ve also written a bit more about cognitive decoupling and the history of the term here.
Next steps. I’m not sure where I’m going to take this next. Probably nowhere much for a while, as I have other priorities. But some options are:
Anders came up with a load of similar problems in the comments. These are designed to be cognitively unpleasant in the same way as the bat and ball, so I keep putting them off. I should actually go through them!
I’m going to continue reading Dutilh Novaes and some ethnomethodology.
Connect more specifically to Stanovich’s idea of cognitive decoupling.
Testing theories? Further out, it could be interesting to actually test some theories by trying alternative, disguised versions of the question, on Mechanical Turk or something. Right now I’ve barely considered this, because I haven’t thought through what I’d want carefully enough yet, but it might be interesting to test variations in:
how concrete the things the quantities refer to are (e.g. really concrete like ‘the price of the bat’, or more abstract like ‘the difference between the price of the bat and ball’. Some of Anders’ variant questions might fit the bill
how close in magnitude the intuitive-but-wrong answer is, as in TheManxLoiner’s comment
I’m very ignorant about experiment design, so to do this I’d to get help from someone more knowledgeable. And psych research sounds like a gigantic minefield even if you are knowledgeable, so I’d probably end up wasting my time. But probably I’d learn something from going through the process, and it’s something that could maybe happen in the future.
A possible reason for this is that the intuitive but incorrect answer in (1) is a decent approximation to the correct answer, whereas the common incorrect answers in (2) and (3) are wildly off the correct answer. For (1) I have to explicitly do a calculation to verify the incorrectness of the rapid answer, whereas in (2) and (3) my understanding of the situation immediately rules out the incorrect answers.
I must have missed this comment before, sorry. This is a really interesting point. Just to write it out explicitly,
(1) correct answer: 5, incorrect answer: 10
(2) correct answer: 5, incorrect answer: 100
(3) correct answer: 47, incorrect answers: 24
Now, for both (1) and (3) the wrong answer is off by roughly a factor of two. But I also share your sense that the answer to (3) is ‘wildly off’, whereas the answer to (1) is ‘close enough’.
There are a couple of possible reasons for this. One is that 5 cents and 10 cents both just register as ‘some small change’, whereas 24 days and 47 days feel meaningfully different.
But also, it could be to do with relative size compared to the other numbers that appear in the problem setup. In (1), 5 and 10 are both similarly small compared to 100 and 110. In (3), 24 is small compared to 48, but 47 isn’t.
Or something else. I haven’t thought about this much.
There’s a variant ‘Ford and Ferrari’ problem that is somewhat related:
> A Ferrari and a Ford together cost $190,000. The Ferrari costs $100,000 more than the Ford. How much does the Ford cost?
So here we have correct answer: 45000, incorrect answer: 90000
Here the incorrect answer feels somewhat wrong, as the Ford is improbably close in price to the Ferrari. People appeared to do better on this modified problem than the bat and ball, but I haven’t looked into the details.
Not quite knitting, but close—you may like this piece by Sarah Perry explaining a spinning metaphor of Wittgenstein’s:
And we extend our concept of number as in spinning a thread we twist fibre on fibre. And the strength of the thread does not reside in the fact that some one fibre runs through its whole length, but in the overlapping of many fibres.
Just curious, are you planning to migrate blog comments too? I didn’t know about Netlify, but it looks very promising for what I want—a mostly static site with some support for storing form submissions—so I’m going to investigate it a bit now.
There was a Durham University study running from 2010 to 2013 where they asked the public to record their earworms (I contributed a few).
They suggest a few features that go into a particularly persistent earworm. A couple that stood out to me:
- Simple exposure. Songs that are currently popular tend to predominate. (There is a lot of Lady Gaga in their corpus.)
- A melody in the ‘sweet spot’ where it’s generic enough to be easy to remember and sing but also has some kind of distinctive ‘hook’ like an unusual interval.
The popularity feature definitely fits Baby Shark. I think the melodic-sweet-spot feature does too: it’s overall an extremely generic and repetitive tune, but also has the distinctive, painfully memorable ‘doo doo do doo doo’ bit.
The paper they published is here (pdf link). From a quick skim I’m not convinced that the stats are going to be all that great, but you’ll have to read it more closely to judge for yourself. At the least it might give you some useful hints on other references and some terminology to google.
(And if you find anything interesting, let us know! I’m extremely prone to getting songs stuck in my head and would also like to know more about earworms.)
Oops, I fixed that in my blog version and then accidentally posted the old draft here. Edited now, thank you!
+1 for “what has been seen cannot be unseen”, wow I’m seeing a lot of cat-urine yellow around now