Fund independent safety efforts somehow, make model access easier. I’m worried currently Anthropic has systemic and possibly bad impact on AI safety as a field just by the virtue of hiring so large part of AI safety, competence weighted. (And other part being very close to Anthropic in thinking)
To be clear I don’t think people are doing something individually bad or unethical by going to work for Anthropic, I just do think -environment people work in has a lot of hard to track and hard to avoid influence on them -this is true even if people are genuinely trying to work on what’s important for safety and stay virtuous -I also do think that superagents like corporations, religions, social movements, etc. have instrumental goals, and subtly influence how people inside see (or don’t see) stuff (i.e. this is not about “do I trust Dario?”)
Fund independent safety efforts somehow, make model access easier. I’m worried currently Anthropic has systemic and possibly bad impact on AI safety as a field just by the virtue of hiring so large part of AI safety, competence weighted. (And other part being very close to Anthropic in thinking)
To be clear I don’t think people are doing something individually bad or unethical by going to work for Anthropic, I just do think
-environment people work in has a lot of hard to track and hard to avoid influence on them
-this is true even if people are genuinely trying to work on what’s important for safety and stay virtuous
-I also do think that superagents like corporations, religions, social movements, etc. have instrumental goals, and subtly influence how people inside see (or don’t see) stuff (i.e. this is not about “do I trust Dario?”)