Harlan

MIRI Newslet­ter #123

A re­sponse to OpenAI’s “How we think about safety and al­ign­ment”

• Harlan 17 Dec 2024 1:08 UTC

  6 points

  2

  on: What is MIRI cur­rently do­ing?

  Hi, I’m part of the communications team at MIRI. Here’s a very high-level summary of what MIRI is currently doing:

  • Our research portfolio includes the new Technical Governance Team, as well as some alignment research (though much less than before).

  • We have also spun up a comms team. We think of our comms work in terms of “rock content” and “wave content.” Currently more effort is going into “rock content” projects which will be announced later.

  • We also do some work in DC, though this is limited by our status as a 501(c)(3).

  MIRI’s strategy update from earlier this year explains the reasoning behind our shift from primarily doing technical alignment research to focusing more on communications and policy. The actual work of making that shift is a lot of why 2024 looked quieter, from the outside, than 2023 (and than our hopes for 2025).

• Harlan 14 Dec 2024 0:35 UTC

  12 points

  4

  in reply to: Logan Riggs’s comment on: MIRI’s 2024 End-of-Year Update

  Hi, I’m part of the communications team at MIRI.

  To address the object-level question: no, that’s not MIRI’s full public output for the year (but our public output for the year was quite small; more on that below). The links on the media page and research page are things that we put in the spotlight. We know the current website isn’t great for seeing all of our output, and we have plans to fix this. In the meantime, you can check out our newsletters, TGT’s new website, and a forthcoming post with more details about the media stuff we’ve done recently.

  To address the pertinent meta-level thing, there are a few reasons why our public output was low for the year:

  • A lot of MIRI’s energy this year has gone into “revving up,” including hiring new staff, spinning up those new teams, and moving into a larger office space.

  • The comms team has primarily been working on “rock content” projects that will be announced later.

  • As you mentioned, some of our work is not in the form of public output, such as engaging with policymakers.

MIRI’s Septem­ber 2024 newsletter

• Harlan 15 Jul 2024 21:41 UTC

  3 points

  0

  in reply to: Vladimir_Nesov’s comment on: MIRI’s July 2024 newsletter

  Thanks for pointing out this mistake!

MIRI’s July 2024 newsletter

MIRI’s June 2024 Newsletter

• Harlan 16 May 2024 0:38 UTC

  9 points

  2

  on: MIRI’s May 2024 Newsletter

  I wrote that “it appears that not all of the leading AI labs are honoring the voluntary agreements they made at [AI Safety Summit],” citing a Politico article. However, after seeing more discussion about it (e.g. here), I am now highly uncertain about whether the labs made specific commitments, what those commitments were, and whether commitments were broken. These seem like important questions, so I hope that we can get more clarity.

MIRI’s May 2024 Newsletter

MIRI’s April 2024 Newsletter

New re­port: A re­view of the em­piri­cal ev­i­dence for ex­is­ten­tial risk from AI via mis­al­igned power-seeking

When sci­en­tists con­sider whether their re­search will end the world

AI Im­pacts Quar­terly Newslet­ter, Apr-Jun 2023

AI Im­pacts Quar­terly Newslet­ter, Jan-Mar 2023

How pop­u­lar is ChatGPT? Part 1: more pop­u­lar than Tay­lor Swift

• Harlan 21 Oct 2022 0:47 UTC

  1 point

  0

  on: Notes on “Can you con­trol the past”

  One of my most-confident guesses about anthropics is that being multiply-instantiated in other ways is analogous. For instance, if there are two identical physical copies of you (in physical rooms that are identical enough that you’re going to make the same observations for the length of the hypothetical, etc.), then my guess is that there isn’t a real question about which one is you. They are both you. You are the pattern, not the meat.

  Thinking about identical brains as the same person is an interesting idea, and I think it’s useful for reasoning about some decision puzzles.
  
  To anyone thinking about this idea, it has some important limitations. Don’t try to use it in domains where counting the number of individuals/​observers is important. If you roll a die 100 times and it keeps coming up “6” then you should update towards it being a loaded die, even though there are infinite copies of every brain state experiencing every possibility of the die rolls. If you’re in a trolley problem where the five people on the track have identical brains, you should still pull the lever, or else utilitarian ethics don’t work (and if you’re going to bite the bullet that utilitarian ethics don’t work because of this, you have to also bite the bullet on reasoning about the world from your own observations not working, which it obviously does).
  
  Here’s a Bostrom paper talking about this https://​​nickbostrom.com/​​papers/​​experience.pdf

• Harlan 1 Jul 2022 2:56 UTC

  7 points

  0

  on: Cul­ti­vat­ing And De­stroy­ing Agency

  Her parents aren’t letting her go to college out of state, or so much as move out until she’s married. She can’t do anything to stop them; any fighting back will result in even worse conditions for her.

  Overall I strongly agree with your post, but I’m confused about this example.

  I don’t know all of the context of your friend’s situation, but you say “out of state” which makes me think that she lives in the US, in which case I don’t understand how her parents could prevent her from leaving home once she is an adult.

  Are they...

  1. Using emotional manipulation, e.g. making it clear that they’ll be really mad or disappointed if she doesn’t comply? In that case, that sounds like a toxic situation that your friend should leave.

  2. Threatening to withhold funding and support that they would otherwise provide? This one is tough but it’s possible to go to college without being financially supported by your parents.

  3. Physically preventing her from leaving? Less common but I’m sure it happens. They can’t legally do this, so at this point, if she is a legal adult, she could get police involved to escort her out out of the property.

• Harlan 7 Jun 2022 23:29 UTC

  8 points

  1

  on: De­liber­ate Grieving

  This is an important discussion to have and I’m looking forward to seeing what you have to say in the rest of the series.
  
  One concept that I wish more people knew about, and might be particularly relevant to this community, is disenfranchised grief, which is grief that is not understood or accepted by society or the people around you. If a relative dies, it is easy to receive support and understanding, even from complete strangers. If you are grieving about something that’s e.g. difficult to explain, taboo, a secret, or unrelatable to most people, then you might end up processing your grief alone, which can suck.

• Harlan 17 Feb 2022 17:54 UTC

  2 points

  0

  on: Sim­plify EA Pitches to “Holy Shit, X-Risk”

  I believe that preventing X-Risks should be the greatest priority for humanity right now. I don’t necessarily think that it should be everyone’s individual greatest priority though, because someone’s comparative advantage might be in a different cause area.

  “Holy Shit, X-Risk” can be extremely compelling, but it can also have people feeling overwhelmed and powerless, if they’re not in a position to do much about it. One advantage of the traditional EA pitch is that it empowers the person with clear actions they can take that have a clear and measurable impact.