Harlan

MIRI’s April 2024 Newsletter

New re­port: A re­view of the em­piri­cal ev­i­dence for ex­is­ten­tial risk from AI via mis­al­igned power-seeking

When sci­en­tists con­sider whether their re­search will end the world

AI Im­pacts Quar­terly Newslet­ter, Apr-Jun 2023

AI Im­pacts Quar­terly Newslet­ter, Jan-Mar 2023

How pop­u­lar is ChatGPT? Part 1: more pop­u­lar than Tay­lor Swift

• Harlan 21 Oct 2022 0:47 UTC

  1 point

  0

  on: Notes on “Can you con­trol the past”

  One of my most-confident guesses about anthropics is that being multiply-instantiated in other ways is analogous. For instance, if there are two identical physical copies of you (in physical rooms that are identical enough that you’re going to make the same observations for the length of the hypothetical, etc.), then my guess is that there isn’t a real question about which one is you. They are both you. You are the pattern, not the meat.

  Thinking about identical brains as the same person is an interesting idea, and I think it’s useful for reasoning about some decision puzzles.
  
  To anyone thinking about this idea, it has some important limitations. Don’t try to use it in domains where counting the number of individuals/​observers is important. If you roll a die 100 times and it keeps coming up “6” then you should update towards it being a loaded die, even though there are infinite copies of every brain state experiencing every possibility of the die rolls. If you’re in a trolley problem where the five people on the track have identical brains, you should still pull the lever, or else utilitarian ethics don’t work (and if you’re going to bite the bullet that utilitarian ethics don’t work because of this, you have to also bite the bullet on reasoning about the world from your own observations not working, which it obviously does).
  
  Here’s a Bostrom paper talking about this https://​​nickbostrom.com/​​papers/​​experience.pdf

• Harlan 1 Jul 2022 2:56 UTC

  7 points

  on: Cul­ti­vat­ing And De­stroy­ing Agency

  Her parents aren’t letting her go to college out of state, or so much as move out until she’s married. She can’t do anything to stop them; any fighting back will result in even worse conditions for her.

  Overall I strongly agree with your post, but I’m confused about this example.

  I don’t know all of the context of your friend’s situation, but you say “out of state” which makes me think that she lives in the US, in which case I don’t understand how her parents could prevent her from leaving home once she is an adult.

  Are they...

  1. Using emotional manipulation, e.g. making it clear that they’ll be really mad or disappointed if she doesn’t comply? In that case, that sounds like a toxic situation that your friend should leave.

  2. Threatening to withhold funding and support that they would otherwise provide? This one is tough but it’s possible to go to college without being financially supported by your parents.

  3. Physically preventing her from leaving? Less common but I’m sure it happens. They can’t legally do this, so at this point, if she is a legal adult, she could get police involved to escort her out out of the property.

• Harlan 7 Jun 2022 23:29 UTC

  7 points

  on: De­liber­ate Grieving

  This is an important discussion to have and I’m looking forward to seeing what you have to say in the rest of the series.
  
  One concept that I wish more people knew about, and might be particularly relevant to this community, is disenfranchised grief, which is grief that is not understood or accepted by society or the people around you. If a relative dies, it is easy to receive support and understanding, even from complete strangers. If you are grieving about something that’s e.g. difficult to explain, taboo, a secret, or unrelatable to most people, then you might end up processing your grief alone, which can suck.

• Harlan 17 Feb 2022 17:54 UTC

  2 points

  on: Sim­plify EA Pitches to “Holy Shit, X-Risk”

  I believe that preventing X-Risks should be the greatest priority for humanity right now. I don’t necessarily think that it should be everyone’s individual greatest priority though, because someone’s comparative advantage might be in a different cause area.

  “Holy Shit, X-Risk” can be extremely compelling, but it can also have people feeling overwhelmed and powerless, if they’re not in a position to do much about it. One advantage of the traditional EA pitch is that it empowers the person with clear actions they can take that have a clear and measurable impact.

Are co­in­ci­dences clues about missed dis­asters? It de­pends on your an­swer to the Sleep­ing Beauty Prob­lem.

• Harlan 22 Aug 2019 3:20 UTC

  1 point

  in reply to: Hazard’s comment on: How to Ig­nore Your Emo­tions (while also think­ing you’re awe­some at emo­tions)

  Thanks. Thinking about it in terms of convincing a sub-agent does help.

  Breathing happens automatically, but you can manually control it as soon as you notice it. I think that sometimes I’ve expected changing my internal state to be more like breathing than it realistically can be.

• Harlan 22 Aug 2019 1:07 UTC

  2 points

  on: How to Ig­nore Your Emo­tions (while also think­ing you’re awe­some at emo­tions)

  The psychologist Lisa Feldman Barrett makes a compelling case that emotions are actually stories that our minds construct to explain the bodily sensations that we experience in different situations. She says that there are no “emotion circuits” in the brain and that you can train yourself to associate the same bodily sensations and situations with more positive emotions. I find this idea liberating and I want it to be true, but I worry that if it’s not true, or if I’m applying the idea incorrectly, I will be doing something like ignoring my emotions in a bad way. I’m not sure how to resolve the tension between “don’t repress your emotions” and “don’t let a constructed narrative about your negative emotions run out of control and make you suffer.”