Upon reflection, the one thing I don’t love about this post is the use of the word “newbies”. I don’t have deep technical chops, but I’ve been around the AI safety space since 2023 and I’ve completed the BlueDot technical curriculum in 2023 and 2024 (when it was still close to Richard Ngo’s original). I still found IABIED clarified and reinforced several important intuitions about the likely path ASI will take. I wish we had found a better term that could act as a scalpel to cleave the difference between things that help grow technical skills and things that help grow fundamental intuitions.
Similarly: when you’re deep in the trees, it can be extremely valuable to review the map of the forest.
Ha ha ha. I was strongly tempted to add a softener to Luc’s phrase. I wanted a subtitle like “Technically If everyone reads it, everyone doesn’t die (all at once), but it doesn’t have the same ring, does it?”