Yeah, for this reason I’d be excited for people with the relevant technical chops to try to start more “normal” AI or ML companies and just earn-to-give for alignment orgs or funds. Of course there are also some downside risks; preferably people trying this should also put in some effort to minimize capabilities externalities (eg work on ML applications rather than train frontier models, don’t publish by default).
If you’re reading this comment, and you have technical chops, then I think AI auditing or (for quite different sorts of technical chops) government consultation are great businesses to try to go into, that are very likely better than earning to give.
Alignment of present-day models or interpretability as a service I’m not so excited about.
It’s just that more than any of these things, I’m excited about actually trying to understand what technologies are necessary for building friendly AI, and making those technologies happen faster than they otherwise would. Even if you’re 1⁄3 as productive at this than at starting the business, I’d think this is a better thing to be doing if you can.
Yeah, for this reason I’d be excited for people with the relevant technical chops to try to start more “normal” AI or ML companies and just earn-to-give for alignment orgs or funds. Of course there are also some downside risks; preferably people trying this should also put in some effort to minimize capabilities externalities (eg work on ML applications rather than train frontier models, don’t publish by default).
If you’re reading this comment, and you have technical chops, then I think AI auditing or (for quite different sorts of technical chops) government consultation are great businesses to try to go into, that are very likely better than earning to give.
Alignment of present-day models or interpretability as a service I’m not so excited about.
It’s just that more than any of these things, I’m excited about actually trying to understand what technologies are necessary for building friendly AI, and making those technologies happen faster than they otherwise would. Even if you’re 1⁄3 as productive at this than at starting the business, I’d think this is a better thing to be doing if you can.