Director & Movement Builder—AI Safety ANZ
Advisory Board Member (Growth) - Giving What We Can
The catchphrase I walk around with in my head regarding the optimal strategy for AI Safety is something like: Creating Superintelligent Artificial Agents* (SAA) without a worldwide referendum is ethically unjustifiable. Until a consensus is reached on whether to bring into existence such technology, a global moratorium is required (*we already have AGI).
I thought it might be useful to spell that out.
There have been multiple occasions where I’ve copy and pasted email threads into an LLM and asked it things like:
What is X person saying
What are the cruxes in this conversation?
Summarise this conversation
What are the key takeaways
What views are being missed from this conversation
I really want an email plugin that basically brute forces rationality INTO email conversations.
If you’re into podcasts, the Very Bad Wizards guys did an ep on this essay, which I enjoyed: https://verybadwizards.com/episode/episode-227-a-terrible-master-david-foster-wallaces-this-is-water
Alcoholics are encouraged not to talk passed Liquor Stores. Basically, physical availability is the biggest lever—keep your phone / laptop in a different room when you don’t absolutely need them!
If GPT5 actually comes with competent agents then I expect this to be a “Holy Shit” moment at least as big as ChatGPT’s release. So if ChatGPT has been used by 200 million people, then I’d expect that to at least double within 6 months of GPT5 (agent’s) release. Maybe triple. So that “Holy Shit” moment means a greater share of the general public learning about the power of frontier models. With that will come another shift in the Overton Window. Good luck to us all.
The catchphrase I walk around with in my head regarding the optimal strategy for AI Safety is something like: Creating Superintelligent Artificial Agents* (SAA) without a worldwide referendum is ethically unjustifiable. Until a consensus is reached on whether to bring into existence such technology, a global moratorium is required (*we already have AGI).
I thought it might be useful to spell that out.
I recently discovered the idea of driving all blames into oneself, which immediately resonated with me. It is relatively hardcore; the kind of thing that would turn David Goggins into a Buddhist.
Gemini did a good job of summarising it:
This quote by Pema Chödron, a renowned Buddhist teacher, represents a core principle in some Buddhist traditions, particularly within Tibetan Buddhism. It’s called “taking full responsibility” or “taking self-blame” and can be a bit challenging to understand at first. Here’s a breakdown:
What it Doesn’t Mean:
Self-Flagellation: This practice isn’t about beating yourself up or dwelling on guilt.
Ignoring External Factors: It doesn’t deny the role of external circumstances in a situation.
What it Does Mean:
Owning Your Reaction: It’s about acknowledging how a situation makes you feel and taking responsibility for your own emotional response.
Shifting Focus: Instead of blaming others or dwelling on what you can’t control, you direct your attention to your own thoughts and reactions.
Breaking Negative Cycles: By understanding your own reactions, you can break free from negative thought patterns and choose a more skillful response.
Analogy:
Imagine a pebble thrown into a still pond. The pebble represents the external situation, and the ripples represent your emotional response. While you can’t control the pebble (the external situation), you can control the ripples (your reaction).
Benefits:
Reduced Suffering: By taking responsibility for your own reactions, you become less dependent on external circumstances for your happiness.
Increased Self-Awareness: It helps you understand your triggers and cultivate a more mindful response to situations.
Greater Personal Growth: By taking responsibility, you empower yourself to learn and grow from experiences.
Here are some additional points to consider:
This practice doesn’t mean excusing bad behavior. You can still hold others accountable while taking responsibility for your own reactions.
It’s a gradual process. Be patient with yourself as you learn to practice this approach.
Be the meme you want to see in the world (screenshot).
Strong upvote, but I won’t tell you why.
Thanks for the feedback Neil! At LM we know that insights can come from anywhere. We appreciate your input regarding the training video’s completeness and the deadline duration. In the meantime please feel free to apply for one of our graduate positions, where presumably one can feel better working on capabilities since ‘someone else will just take the job anyway’: https://www.lockheedmartinjobs.com/job/aguadilla/software-engineer-fire-control-weapons-early-career/694/53752768720
I have heard rumours that an AI Safety documentary is being made. Separate to this, a good friend of mine is also seriously considering making one, but he isn’t “in” AI Safety. If you know who this first group is and can put me in touch with them, it might be worth getting across each others plans.
I like the fact that despite not being (relatively) young when they died, the LW banner states that Kahneman & Vinge have died “FAR TOO YOUNG”, pointing to the fact that death is always bad and/or it is bad when people die when they were still making positive contributions to the world (Kahneman published “Noise” in 2021!).
I can’t stress this enough: the two most important things to happen to me in my life have been (1) my daughter being born and (2) receiving a pointing-out instruction from Loch Kelly.
[GIF] A feature I’d love on the forum: while posts are read back to you, the part of the text that is being read is highlighted. This exists on Naturalreaders.com and would love to see it here (great for people who have wandering minds like me).
I’ll add that for some period I was on 100mg of sertraline, but I dont think that cured me of anything.
Haha no yoga. Some combination of the following:
- Meta cognitive therapy + CBT with this guy for 4 years
- Lots of exercise (resistance training and cardio)
- Sleeping lots
- Found meaningful work + less a stressful industry
- Stable relationship (monogomous)
- This one is the curved ball, as I had already cured my OCD/GAD by the time I found it, but it definitely lifted my wellbeing a lot https://lochkelly.org/
Are you interested in receiving any advice from someone who used to have OCD/GAD but now lives with almost not enough anxiety?
Thanks for posting and I hope you’re doing ok!
I have two questions:
1/ when someone says they “believe in God” does this mean something like “I assign a ≥ 50% probability to there being an omnipotent omnipresent and omniscient intelligence?”
2/ how do you update on the non-religious-related views of someone (like Huberman) after they say they believe in God? Do they become less trustworthy on other topics?
I think acting on the margins is still very underrated. For e.g. I think 5x the amount of advocacy for a Pause on capabilities development of frontier AI models would be great. I also think in 12 months time it would be fine for me to reevaluate this take and say something like ‘ok that’s enough Pause advocacy’.
Basically, you shouldn’t feel ‘locked in’ to any view. And if you’re starting to feel like you’re part of a tribe, then that could be a bad sign you’ve been psychographically locked in.
Hi Benjamin—would be interested in your take on a couple of things:
1. By recommending people work at big labs, do you think this has a positive Halo Effect for the labs’ brand? I.e. 80k is known for wanting people to do good in the world, so by recommending people invest their careers at a lab, then those positive brand associations get passed onto the lab (this is how most brand partnerships work).
2. If you think the answer to #1 is Yes, then do you believe the cost of this Halo Effect is outweighed by the benefit of having safety minded EA / Rationalist folk inside big labs?
Putting my EA Forum comment here:
I’d like to make clear to anyone reading that you can support the PauseAI movement right now, only because you think it is useful right now. And then in the future, when conditions change, you can choose to stop supporting the PauseAI movement.
AI is changing extremely fast (e.g. technical work was probably our best bet a year ago, I’m less sure now). Supporting a particular tactic/intervention does not commit you to an ideology or team forever!