I don’t think MIRI “gave up”

Disclaimer: I haven’t run this by Nate or Eliezer, if they think it mischaracterizes them, whoops.

I have seen many people assume MIRI (or Eliezer) ((or Nate?)) has “given up”, and been telling other people to give up.

On one hand: if you’re only half paying attention, and skimmed a post called “Death With Dignity”, I think this is a kinda reasonable impression to have ended up with. I largely blame Eliezer for choosing a phrase which returns “support for assisted suicide” when you google it.

But, I think if you read the post in detail, it’s not at all an accurate summary of what happened, and I’ve heard people say this who I feel like should have read the post closely enough to know better.

Eliezer and “Death With Dignity”

Q1: Does ‘dying with dignity’ in this context mean accepting the certainty of your death, and not childishly regretting that or trying to fight a hopeless battle?

Don’t be ridiculous. How would that increase the log odds of Earth’s survival?

The whole point of the post is to be a psychological framework for actually doing useful work that increases humanity’s long log odds of survival. “Giving Up” clearly doesn’t do that.

[left in typo that was Too Real]

[edited to add] Eliezer does go on to say:

That said, I fought hardest while it looked like we were in the more sloped region of the logistic success curve, when our survival probability seemed more around the 50% range; I borrowed against my future to do that, and burned myself out to some degree. That was a deliberate choice, which I don’t regret now; it was worth trying, I would not have wanted to die having not tried, I would not have wanted Earth to die without anyone having tried. But yeah, I am taking some time partways off, and trying a little less hard, now. I’ve earned a lot of dignity already; and if the world is ending anyways and I can’t stop it, I can afford to be a little kind to myself about that.

I agree this means he’s “trying less heroically hard.” Someone in the comments says “this seems like he’s giving up a little”. And… I dunno, maybe. I think I might specifically say “giving up somewhat at trying heroically hard”. But I think if you round “give up a little at ” to “give up” you’re… saying an obvious falsehood? (I want to say “you’re lying”, but as previously discussed, sigh, no, it’s not lying, but, I think your cognitive process is fucked up in a way that should make you sit-bolt-upright-in-alarm.)

I think it is a toxic worldview to think that someone should be trying maximally hard, to a degree that burns their future capacity, and that to shift from that to “work at a sustainable rate while recovering from burnout for a bit” count as “giving up.” No. Jesus Christ no. Fuck that worldview.

(I do notice that what I’m upset about here is the connotation of “giving up”, and I’d be less upset if I thought people were simply saying “Eliezer/​MIRI has stopped taking some actions” with no further implications. But I think people who say this are bringing in unhelpful/​morally-loaded implications, and maybe equivocating between them)

Nate and “Don’t go through the motions of doing stuff you don’t really believe in.”

I think Nate says a lot of sentences that sound closer to “give up” upon first read/​listen. I haven’t run this post by him, and am least confident in my claim he wouldn’t self-describe as “having given up”. But would still bet against it. (Meanwhile, I do think it’s possible for someone to have given up without realizing it, but, don’t think that’s what happened here)

From his recent post Focus on the places where you feel shocked everyone’s dropping the ball:

Look for places where everyone’s fretting about a problem that some part of you thinks it could obviously just solve.

Look around for places where something seems incompetently run, or hopelessly inept, and where some part of you thinks you can do better.

Then do it better.

[...]

Contrast this with, say, reading a bunch of people’s research proposals and explicitly weighing the pros and cons of each approach so that you can work on whichever seems most justified. This has more of a flavor of taking a reasonable-sounding approach based on an argument that sounds vaguely good on paper, and less of a flavor of putting out an obvious fire that for some reason nobody else is reacting to.

I dunno, maybe activities of the vaguely-good-on-paper character will prove useful as well? But I mostly expect the good stuff to come from people working on stuff where a part of them sees some way that everybody else is just totally dropping the ball.

In the version of this mental motion I’m proposing here, you keep your eye out for ways that everyone’s being totally inept and incompetent, ways that maybe you could just do the job correctly if you reached in there and mucked around yourself.

That’s where I predict the good stuff will come from.

And if you don’t see any such ways?

Then don’t sweat it. Maybe you just can’t see something that will help right now. There don’t have to be ways you can help in a sizable way right now.

I don’t see ways to really help in a sizable way right now. I’m keeping my eyes open, and I’m churning through a giant backlog of things that might help a nonzero amount—but I think it’s important not to confuse this with taking meaningful bites out of a core problem the world is facing, and I won’t pretend to be doing the latter when I don’t see how to.

Like, keep your eye out. For sure, keep your eye out. But if nothing in the field is calling to you, and you have no part of you that says you could totally do better if you deconfused yourself some more and then handled things yourself, then it’s totally respectable to do something else with your hours.

I do think this looks fairly close to “having given up.” The key difference is the combo of keeping his eyes open for ways to actually help in a serious way.

The point of Death With Dignity, and with MIRI’s overall vibe, as I understand it, is:

Don’t keep doing things out a vague belief that you’re supposed to do something.

Don’t delude yourself about whether you’re doing something useful.

Be able to think clearly about what actually needs doing, so that you can notice things that are actually worth doing.

(Note: I’m not sure I agree with Nate here, strategically, but that’s a separate question from whether he’s given up or not)

((I think reasonable people can disagree about whether the thing Nate is saying amounts to “give up”, for some vague verbal-cultural clustering of what “give up” means. But, I don’t think this is at all a reasonable summary of anything I’ve seen Eliezer say, and I think most people were responding to Death With Dignity rather than random 1-1 Nate conversations or his most recent post))