If someone is motivated to “win” and have the side they started on be correct (or to get people to view the other side as incorrect) then that’s a less cooperative atmosphere than I’d ideally want to run True Rejection Challenge with. I stuck the Investment tag on this one for a reason, and that reason is basically that I would expect doing this on someone’s facebook wall to be frustrating and unproductive, but that doing it with an established group of friends in person to be helpful.
(Sidenote: I’m aware that the way I’m using that tag section between Summary and Purpose isn’t really achieving what I want it to here. Ideally I’d want to be able to search up all the Investment meetups within the Meetups In A Box sequence and to quickly get the usage of each tag from a single post instead of leaving them on the sequence description. If you missed that usage, that’s mostly on me.)
That said, I have the sense you might be missing a useful piece of the True Rejection technique. There’s this thing human brains do sometimes where they say “I don’t believe you because you don’t have a Ph.D” and then, when the person they’re talking to comes back with a Ph.D, they say “There are lots of Ph.Ds, come back when you have tenure.” It’s frustrating when other people do it to me, but I sometimes catch myself doing it to other people. I’ve caught my own brain doing it to myself! The countercharm I use is to try and list out all my rejections at once, to pause and consider if I’d change my mind if all of them were satisfied, and then to at least dock myself points if I don’t change my mind if all of them are satisfied.
If the proposed example or solution really doesn’t satisfy my rejection, that’s one thing. The easy road is to come up with a reason whatever they did doesn’t satisfy the rejection so that I don’t have to change my mind. I try not to take that easy road.
The easy road is to come up with a reason whatever they did doesn’t satisfy the rejection so that I don’t have to change my mind.
If I say “Come back when your scientific journal is much later than 1880”, how is that distinguishable from the kind of excuse you’re talking about? I am, in fact, coming up with something that wasn’t included in my original rejection, and I am in fact saying that, because of it, I shouldn’t have to change my mind. The only difference is that it’s a better excuse.
“Come back when your scientific journal is much later than 1880” is not particularly distinguishable, no.
Multiple things that I think are simultaneously true:
Something can satisfy all my pre-stated rejections and still not actually be good evidence for changing my mind. If that happens the right move is not to change my mind, because I don’t have good evidence.
There is a skill (or a cluster of related skills) which Is That Your True Rejection points at. Mastery of this skill is the ability to consider a belief of my own, concisely state the evidence which would change my mind on that belief, and be correct such that if that evidence is presented then my mind changes.
“I don’t like working out because I hate people watching me” is loosely isomorphic here to “I believe gravity on Earth accelerates objects down at about 9.8 m/s^2 because I dropped some objects off a high place and timed them.” The skill is pretty similar.
If someone points something out that satisfies my stated rejections, and I don’t change my mind, it’s pretty reasonable for them to be annoyed about that. I’m the one who failed a skill check.
If this keeps happening, where every time I try to pre-state my rejections and someone points out a way to satisfy them I find that I’m not convinced and add another reason, then I am not very good at the skill which Is That Your True Rejection points at.
There’s an unhelpful kind of munchkinry that looks for poor phrasing in pre-stated rejections like a devil in a fantasy novel or a highly motivated and perhaps unscrupulous lawyer, making suggestions that technically satisfy my rejections but obviously aren’t what I meant. There’s also a helpful kind of munchkinry that looks for out-of-the-box ways to work out without tripping anything we hate. The line is kind of blurry and may just outright be a gradient. I can’t write out rules that unhelpful munchkins couldn’t get around, but sometimes I know it when you see it and I don’t want to discourage helpful munchkinry.
Since the True Rejection Challenge exercise is in large part designed to practice the skill which Is That Your True Rejection points at, it’s going to involve a bunch of “oops, I didn’t think to add this rejection” in the beginning as well as the harder to spot failure of “oops, I added this as a rejection but it isn’t actually important to me.” When you start practicing juggling, you drop a lot of balls. That’s fine! Dropping balls in juggling practice and singing off key in choir practice aren’t mortal sins, they’re kind of supposed to happen! Obviously try not to make mistakes but go ahead and make lots of mistakes if it’s on the path to getting good at the skill.
In the case of prayer regrowing a leg, I think it’s possible someone failed a skill check by leaving the word “reputable” under-specified, and also possible their interlocutor is being an unhelpful munchkin. Both could be true at once! The helpful thing might be to say “hey, what do you mean by reputable?” Does that make sense?
There’s an unhelpful kind of munchkinry that looks for poor phrasing in pre-stated rejections like a devil in a fantasy novel or a highly motivated and perhaps unscrupulous lawyer, making suggestions that technically satisfy my rejections but obviously aren’t what I meant.
I think the original true rejection post is one of these. “Why should I believe him when he doesn’t have a PhD” probably means that the PhD is one of multiple conditions, not that it’s the sole reason for rejection. But Eliezer’s original post treats it as if it’s a gotcha.
Also, remember the Hidden Complexity of Wishes. Phrasing your rejection in such a way that nobody can abuse a misphrasing is really hard, even with feedback, and a lot like trying to phrase a wish properly. (And ironically, in this context, Eliezer asked me my background in computer science which essentially is asking what degree I have. I wonder if that was his true rejection.)
I think the original true rejection post is one of these. “Why should I believe him when he doesn’t have a PhD” probably means that the PhD is one of multiple conditions, not that it’s the sole reason for rejection. But Eliezer’s original post treats it as if it’s a gotcha.
Maybe, though if it’s the only condition given and I actually went out, got a PhD, came back, and the other person didn’t change their mind I’d be kind of annoyed. I have some direct experience with
if the potential customer says, “It seems good, but you don’t have feature X,” that may not be the true rejection. Fixing it may, or may not, change anything.
and anecdotal evidence seems in favour of Eliezer’s point. Having feature X doesn’t mean they’ll buy, and they might buy even without feature X if you change some other thing.
I’m noticing I’m not clear if we’re disagreeing here, or where that disagreement might lie. I think but am not at all confident that you think the unhelpful munchkinry is so prevalent and multiple rejections are sufficiently common as to make this technique useless. Can you try restate your point? At present this thread doesn’t seem productive to me.
I think but am not at all confident that you think the unhelpful munchkinry is so prevalent and multiple rejections are sufficiently common as to make this technique useless.
Pretty much.
If “true rejection” allows multiple reasons for rejection, not just one, and isn’t used as a gotcha, I have no real problem with it, but the difficulty of genie-proofing it and the ease of using it as a gotcha make it not work very well in practice.
This is also one reason I oppose bets.
I have some direct experience with
if the potential customer says, “It seems good, but you don’t have feature X,” that may not be the true rejection. Fixing it may, or may not, change anything.
But that sounds like the multiple reason case. If the customer has multiple reasons why he doesn’t like the product, and he’s only stated the biggest one, the customer may be unsatisfied after you fix it. Claiming “the customer didn’t state his true rejection” assumes that a true rejection can’t consist of multiple reasons. And even if the customer did phrase his rejection in some way that implies that it’s the only reason, I don’t think “failed to state all his reasons” is meaningfully like “didn’t give his true rejection”.
If someone is motivated to “win” and have the side they started on be correct (or to get people to view the other side as incorrect) then that’s a less cooperative atmosphere than I’d ideally want to run True Rejection Challenge with. I stuck the Investment tag on this one for a reason, and that reason is basically that I would expect doing this on someone’s facebook wall to be frustrating and unproductive, but that doing it with an established group of friends in person to be helpful.
(Sidenote: I’m aware that the way I’m using that tag section between Summary and Purpose isn’t really achieving what I want it to here. Ideally I’d want to be able to search up all the Investment meetups within the Meetups In A Box sequence and to quickly get the usage of each tag from a single post instead of leaving them on the sequence description. If you missed that usage, that’s mostly on me.)
That said, I have the sense you might be missing a useful piece of the True Rejection technique. There’s this thing human brains do sometimes where they say “I don’t believe you because you don’t have a Ph.D” and then, when the person they’re talking to comes back with a Ph.D, they say “There are lots of Ph.Ds, come back when you have tenure.” It’s frustrating when other people do it to me, but I sometimes catch myself doing it to other people. I’ve caught my own brain doing it to myself! The countercharm I use is to try and list out all my rejections at once, to pause and consider if I’d change my mind if all of them were satisfied, and then to at least dock myself points if I don’t change my mind if all of them are satisfied.
If the proposed example or solution really doesn’t satisfy my rejection, that’s one thing. The easy road is to come up with a reason whatever they did doesn’t satisfy the rejection so that I don’t have to change my mind. I try not to take that easy road.
If I say “Come back when your scientific journal is much later than 1880”, how is that distinguishable from the kind of excuse you’re talking about? I am, in fact, coming up with something that wasn’t included in my original rejection, and I am in fact saying that, because of it, I shouldn’t have to change my mind. The only difference is that it’s a better excuse.
“Come back when your scientific journal is much later than 1880” is not particularly distinguishable, no.
Multiple things that I think are simultaneously true:
Something can satisfy all my pre-stated rejections and still not actually be good evidence for changing my mind. If that happens the right move is not to change my mind, because I don’t have good evidence.
There is a skill (or a cluster of related skills) which Is That Your True Rejection points at. Mastery of this skill is the ability to consider a belief of my own, concisely state the evidence which would change my mind on that belief, and be correct such that if that evidence is presented then my mind changes.
“I don’t like working out because I hate people watching me” is loosely isomorphic here to “I believe gravity on Earth accelerates objects down at about 9.8 m/s^2 because I dropped some objects off a high place and timed them.” The skill is pretty similar.
If someone points something out that satisfies my stated rejections, and I don’t change my mind, it’s pretty reasonable for them to be annoyed about that. I’m the one who failed a skill check.
If this keeps happening, where every time I try to pre-state my rejections and someone points out a way to satisfy them I find that I’m not convinced and add another reason, then I am not very good at the skill which Is That Your True Rejection points at.
There’s an unhelpful kind of munchkinry that looks for poor phrasing in pre-stated rejections like a devil in a fantasy novel or a highly motivated and perhaps unscrupulous lawyer, making suggestions that technically satisfy my rejections but obviously aren’t what I meant. There’s also a helpful kind of munchkinry that looks for out-of-the-box ways to work out without tripping anything we hate. The line is kind of blurry and may just outright be a gradient. I can’t write out rules that unhelpful munchkins couldn’t get around, but sometimes I know it when you see it and I don’t want to discourage helpful munchkinry.
Since the True Rejection Challenge exercise is in large part designed to practice the skill which Is That Your True Rejection points at, it’s going to involve a bunch of “oops, I didn’t think to add this rejection” in the beginning as well as the harder to spot failure of “oops, I added this as a rejection but it isn’t actually important to me.” When you start practicing juggling, you drop a lot of balls. That’s fine! Dropping balls in juggling practice and singing off key in choir practice aren’t mortal sins, they’re kind of supposed to happen! Obviously try not to make mistakes but go ahead and make lots of mistakes if it’s on the path to getting good at the skill.
In the case of prayer regrowing a leg, I think it’s possible someone failed a skill check by leaving the word “reputable” under-specified, and also possible their interlocutor is being an unhelpful munchkin. Both could be true at once! The helpful thing might be to say “hey, what do you mean by reputable?” Does that make sense?
I think the original true rejection post is one of these. “Why should I believe him when he doesn’t have a PhD” probably means that the PhD is one of multiple conditions, not that it’s the sole reason for rejection. But Eliezer’s original post treats it as if it’s a gotcha.
Also, remember the Hidden Complexity of Wishes. Phrasing your rejection in such a way that nobody can abuse a misphrasing is really hard, even with feedback, and a lot like trying to phrase a wish properly. (And ironically, in this context, Eliezer asked me my background in computer science which essentially is asking what degree I have. I wonder if that was his true rejection.)
Maybe, though if it’s the only condition given and I actually went out, got a PhD, came back, and the other person didn’t change their mind I’d be kind of annoyed. I have some direct experience with
and anecdotal evidence seems in favour of Eliezer’s point. Having feature X doesn’t mean they’ll buy, and they might buy even without feature X if you change some other thing.
I’m noticing I’m not clear if we’re disagreeing here, or where that disagreement might lie. I think but am not at all confident that you think the unhelpful munchkinry is so prevalent and multiple rejections are sufficiently common as to make this technique useless. Can you try restate your point? At present this thread doesn’t seem productive to me.
Pretty much.
If “true rejection” allows multiple reasons for rejection, not just one, and isn’t used as a gotcha, I have no real problem with it, but the difficulty of genie-proofing it and the ease of using it as a gotcha make it not work very well in practice.
This is also one reason I oppose bets.
But that sounds like the multiple reason case. If the customer has multiple reasons why he doesn’t like the product, and he’s only stated the biggest one, the customer may be unsatisfied after you fix it. Claiming “the customer didn’t state his true rejection” assumes that a true rejection can’t consist of multiple reasons. And even if the customer did phrase his rejection in some way that implies that it’s the only reason, I don’t think “failed to state all his reasons” is meaningfully like “didn’t give his true rejection”.