Taking the Hammertime Final Exam
[alkjash just finished his superb Hammertime sequence. I’m taking him up on his Hammertime Final Exam to come up with:
an instrumental rationality technique
a concept / framework
a cognitive bias
with just 5 minutes of brainstorming + 5 minutes of writing for each. The results are below.]
Box Your Brain:
Sometimes, your brain will come up with really great reasons to do really stupid things. Well, maybe they’re not totally stupid, but you don’t have the time to do some sort of fancy in-depth analysis to see what’s up. Or, you know that your System 1 is compromised. In those cases, just Box Your Brain.
Okay, so boxing AIs doesn’t seem to work that well. Unless you precommit, of course, such that you can’t yourself boxed. That’s the same idea here. You know that you know that you know…(and all the way up) that you’re running off faulty hardware.
So just tell yourself, “Nope, boxing my brain right now.” And go off and do the Virtuous Thing that you already know is Good and Correct. It’s your brain, and you can use it how you want. Sometimes the right thing to do is to stop listening and run with your meta-knowledge.
Exceptions All The Way Down:
You know how the right thing to do is always listen to your gut? Except for when your gut’s wrong?
You know how the right thing to do is always to write stuff down? Except for when writing stuff down isn’t helpful?
Yeah, so there’s this thing here that’s sort of like the metacontrarian cycle happening in rationality. At least a good third of rationality is trying to draw generalizations around things. We love to work off abstraction. This is going to lead to quite valuable heuristics; and of course there will be lots of edge cases.
Rules aren’t absolute. Sometimes they get broken. So what does that leave us with? Well, one thing is we can get specific down to the situation to make our judgments, much like the way you can still tell that certain moral decisions are repugnant, even if The System declares that said decision is the “right one”.
Here’s a thing I think at least some people are averse to: doing things again. Imagine you’re chatting with a stranger. The conversation finishes, and the two of you part ways. Then, BAM! You remember something cool that’d be great to bring up.
I postulate that the aversion you feel towards running back to the other person and bringing up said piece of coolness grows faster than your ability to run. That is, there will be a point where it will be in theory possible to catch up to the other party—and it’ll also feel Bad.
This feels like the same reason that someone might feel Bad following up again to ask someone for directions, after already having asked them for directions a few minutes prior. There’s something about “going back and trying to redo the same interaction” that I think feels bad.
And I also think it shouldn’t.
Something something about social roles and how interactions are “supposed” to generally follow some assumptions about how often they happen, and two interactions in rapid succession feels weird.
Except that I think most people are fine with multiple interactions despite the weirdness. Or, at least, there are good ways to do this well.
So leave that Badness behind.
Do it again!
(And again! And again!)