It might be useful for you to taboo “LessWrong” at least briefly.
I have a spiel that may turn into a post someday about how communities aren’t people, the short version being that if you ask “why doesn’t the community do X?” the answer is usually that no individual in the community took it upon themselves to be the hero. Other times, someone did, but the result didn’t look like the community doing X it looks like individuals doing X.
Is the question “why does the average user on this website not put much more focus on AI Governance and outreach?” Half of LessWrong users don’t make their own posts, just comment or lurk. Yes, they could do more, but I could say that of Twitter users too.
Is the question “why does the formal organization behind this website not put much more focus on AI Governance and outreach?” They just helped put out ai-2027.com. They run Alignment Forum. They host conferences like The Curve. Yes, they could do more, but at some point you look at the employee hours they have and what projects they’ve done and it balances out.
Is the question “why do the most prominent users on this website not put much more focus on AI Governance and outreach?” By karma, the top ten users are Eliezer Yudkowsky, Gwern, Raemon, John Wentworth, Kaj Sotala, Zvi, Scott Alexander, Wedrifrid, Habryka, and Vaniver. I think Eliezer, Scott, and Zvi do lots of outreach actually, and it’s not like John and Vaniver do none. Yes, they could do more Governance and outreach, but- no, wait, I take it back, I don’t think Zvi realistically has much more marginal AI outreach he can do, let the man rest I think his keyboard is smoking from all that typing, his children miss him while he’s away in the posting mines.
I’m not exactly a disinterested observer here. I do a lot of rationality outreach, and I make a deliberate choice not to push an AI angle because I think that would be worse both for AI and for my sub-branch of the rationality community. If your argument is more people on the margin should do AI governance and outreach, especially if they have comparative advantage, sure, I’ll agree with that. If you think the front page of LessWrong should be completely full of AI discussion, I disagree, with the core of my disagreement stemming from The Common Interest of Many Causes.
I would argue that it is people in AI Governance (the corporate “Reponsible AI” kind) that should also make an effort to learn more about AI Safety. I know, because I am one of them, and I do not know of many others that have AI Safety as a key research topic in their agenda.
I am currently working on resources to improve AI Safety literacy amongst policy people, tech lawyers, compliance teams etc.
My question to you is: any advice for the rare few in AI Governance that are here? I sometimes post with the hope of getting technical insights from AI Safety researchers. Do you think it’s worth the effort?
I don’t have the technical AI Safety skillset myself. My guess is to show up with specific questions if you need a technical answer, try and make a couple of specific contacts you can run big plans past or reach out to if you unexpectedly get traction, and use your LessWrong presence to establish a pointer to you and your work so people looking for what you’re doing can find you. That seems worthwhile. After that, maybe crosspost when it’s easy? Zvi might be a good example, where it’s relatively easy to crosspost between LessWrong and Substack, though he’s closer to keeping up with incoming news and less building resource posts for the long term.
If I type “lawyer AI safety” into LessWrong’s search, your post comes up, which I assume is something you want.
Good catch! My implicit question was about what ends up on the frontpage, i.e. some mix of version 1 and 3. A friend of mine answered the sociological side of that question to my satisfaction: Many of the most competent people already pivoted to governance/outreach. But they don’t have much use for in-group signalling, so they have quantitatively much less posts on the frontpage than others.
Frontpage is mostly what the admins and mods think is worth frontpaging, plus what users upvote. It’s also a positional good, there can only be so many things on the front page. This is a more specific and useful question though! Yeah, if the LW team frontpaged more AI governance and less of everything else, and the average user upvoted more AI governance and less of everything else, the frontpage would have more AI governance on it. I wouldn’t be a fan, but I’d understand the move that was the goal. My understanding is that’s not the goal.
Not having a use for in-group signaling seems accurate but maybe overly cynical or something? I think it’s that having lots of posts on LessWrong is not a constructive part of their plan. Look at Situational Awareness and ai-2027: great writing, great outreach, obviously applicable to governance. Would either of those have been better as LessWrong posts? I think no, they’re more impactful as freestanding websites with a short url and a convenient PDF button.
What’s the actual game plan, and what intervening steps benefit from the average LessWrong reader knowing the information you want to tell them or having a calling card that leads the right LessWrong readers to reach out to you? Look at the rash of posting around SB-1047, particularly the PauseAI leader’s post. There’s a game plan that benefited from a bunch of LessWrong readers knowing some extra information.
It might be useful for you to taboo “LessWrong” at least briefly.
I have a spiel that may turn into a post someday about how communities aren’t people, the short version being that if you ask “why doesn’t the community do X?” the answer is usually that no individual in the community took it upon themselves to be the hero. Other times, someone did, but the result didn’t look like the community doing X it looks like individuals doing X.
Is the question “why does the average user on this website not put much more focus on AI Governance and outreach?” Half of LessWrong users don’t make their own posts, just comment or lurk. Yes, they could do more, but I could say that of Twitter users too.
Is the question “why does the formal organization behind this website not put much more focus on AI Governance and outreach?” They just helped put out ai-2027.com. They run Alignment Forum. They host conferences like The Curve. Yes, they could do more, but at some point you look at the employee hours they have and what projects they’ve done and it balances out.
Is the question “why do the most prominent users on this website not put much more focus on AI Governance and outreach?” By karma, the top ten users are Eliezer Yudkowsky, Gwern, Raemon, John Wentworth, Kaj Sotala, Zvi, Scott Alexander, Wedrifrid, Habryka, and Vaniver. I think Eliezer, Scott, and Zvi do lots of outreach actually, and it’s not like John and Vaniver do none. Yes, they could do more Governance and outreach, but- no, wait, I take it back, I don’t think Zvi realistically has much more marginal AI outreach he can do, let the man rest I think his keyboard is smoking from all that typing, his children miss him while he’s away in the posting mines.
I’m not exactly a disinterested observer here. I do a lot of rationality outreach, and I make a deliberate choice not to push an AI angle because I think that would be worse both for AI and for my sub-branch of the rationality community. If your argument is more people on the margin should do AI governance and outreach, especially if they have comparative advantage, sure, I’ll agree with that. If you think the front page of LessWrong should be completely full of AI discussion, I disagree, with the core of my disagreement stemming from The Common Interest of Many Causes.
I would argue that it is people in AI Governance (the corporate “Reponsible AI” kind) that should also make an effort to learn more about AI Safety. I know, because I am one of them, and I do not know of many others that have AI Safety as a key research topic in their agenda.
I am currently working on resources to improve AI Safety literacy amongst policy people, tech lawyers, compliance teams etc.
Stress-Testing Reality Limited | Katalina Hernández | Substack
My question to you is: any advice for the rare few in AI Governance that are here? I sometimes post with the hope of getting technical insights from AI Safety researchers. Do you think it’s worth the effort?
I don’t have the technical AI Safety skillset myself. My guess is to show up with specific questions if you need a technical answer, try and make a couple of specific contacts you can run big plans past or reach out to if you unexpectedly get traction, and use your LessWrong presence to establish a pointer to you and your work so people looking for what you’re doing can find you. That seems worthwhile. After that, maybe crosspost when it’s easy? Zvi might be a good example, where it’s relatively easy to crosspost between LessWrong and Substack, though he’s closer to keeping up with incoming news and less building resource posts for the long term.
If I type “lawyer AI safety” into LessWrong’s search, your post comes up, which I assume is something you want.
Thank you very much for your advice! Actually helps, and thanks for running that search too :).
Good catch! My implicit question was about what ends up on the frontpage, i.e. some mix of version 1 and 3. A friend of mine answered the sociological side of that question to my satisfaction: Many of the most competent people already pivoted to governance/outreach. But they don’t have much use for in-group signalling, so they have quantitatively much less posts on the frontpage than others.
Frontpage is mostly what the admins and mods think is worth frontpaging, plus what users upvote. It’s also a positional good, there can only be so many things on the front page. This is a more specific and useful question though! Yeah, if the LW team frontpaged more AI governance and less of everything else, and the average user upvoted more AI governance and less of everything else, the frontpage would have more AI governance on it. I wouldn’t be a fan, but I’d understand the move that was the goal. My understanding is that’s not the goal.
Not having a use for in-group signaling seems accurate but maybe overly cynical or something? I think it’s that having lots of posts on LessWrong is not a constructive part of their plan. Look at Situational Awareness and ai-2027: great writing, great outreach, obviously applicable to governance. Would either of those have been better as LessWrong posts? I think no, they’re more impactful as freestanding websites with a short url and a convenient PDF button.
What’s the actual game plan, and what intervening steps benefit from the average LessWrong reader knowing the information you want to tell them or having a calling card that leads the right LessWrong readers to reach out to you? Look at the rash of posting around SB-1047, particularly the PauseAI leader’s post. There’s a game plan that benefited from a bunch of LessWrong readers knowing some extra information.