cozyfractal

• cozyfractal 28 Apr 2023 9:03 UTC

  11 points

  4

  in reply to: Alex_Altair’s comment on: The salt in pasta wa­ter fallacy

  It’s the horizontal difference that matters and not the vertical one, so the water boils about 200s earlier or 20% faster (according to this one experiment) which quite nice!

• cozyfractal 15 Apr 2024 12:50 UTC

  2 points

  0

  in reply to: Tamsin Leake’s comment on: What con­vinc­ing warn­ing shot could help pre­vent ex­tinc­tion from AI?

  I agree, that’s an important point. I probably worry more about your first possibility, as we are already seeing this effect today, and worry less about the second, which would require a level of resignation that I’ve rarely seen. Entities that are responsible would likely try to do something about it, but the ways this “we’re doomed, let’s profit” might happen are:

  • The warning shot comes from a small player and a bigger player feels urgency or feels threatened, in a situation where they have little control

  • There is no clear responsibility and there are many entities at the frontier, who think others are responsible and there’s no way to prevent them.

  Another case of harmful warning shot is if the lesson learnt from it is “we need stronger AI systems to prevent this”. This probably goes in hand with a poor credit assignment.
  

• cozyfractal 4 Sep 2023 7:14 UTC

  2 points

  0

  in reply to: Joseph Bloom’s comment on: Against Al­most Every The­ory of Im­pact of Interpretability

  I’m not sure of what you meant about studying transistors.

  It seems to me to me that if we are studying transistors so hard, it’s to push computers capabilities (faster, smaller, more energy efficient etc.), and not at all to make software safer. Instead to make software safer, we use anti-viruses, automatic testing, developer liability, standards, regulations, pop-up warnings, etc.

• cozyfractal 30 Sep 2022 15:27 UTC

  2 points

  on: Gears-Level Men­tal Models of Trans­former Interpretability

  Thank you for bringing those four ideas into one nicely written post! It helped me have a better overview of what happens inside transformers, even though I had worked with each idea independently before :)