I meant collective action as a strategy, rather than trying to do this alone
sudo-nym
I suggest going on strike instead.
I have seen two separate people from two different social circles of mine say that they think OpenAI and then Anthropic announcing security incidents is a publicity stunt to attract shareholder attention by using the “killer god-computer” trope to signal just how advanced their technology has become. This seems like an obvious conspiracy theory to me, but the fact that it is coming from two unrelated people who claim that they didn’t read it anywhere else gives me pause. Has anyone else seen this? Did it come from somewhere?
I have this sneaking suspicion that companies are jumping on AI safety now because it is a socially acceptable way to get out of their unprofitable overinvestment into current AI. I’m not complaining, I think them stopping is good for safety reasons regardless, but I really feel like they got to the right answer using the wrong methods.
If we want aligned AI, the people and entities making the AI must also be aligned. Publicly traded corporations are misaligned, due to pressures such as executive bonus pay and the doctrine of fiduciary duty to shareholders.
I know a person (who is not me) who was going to college to eventually work on AI alignment, wholeheartedly absorbed this community’s “we need to work at full speed at all times or we’re all gonna die” attitude and took on far too much work, had a complete mental breakdown, and is now a depressed nihilist hedonist.
The problem you speak of is not hypothetical. This community’s doomerism and chronic stress has already incurred real costs in brain drain.
Skepticism about the alignment of government and the incentives thereof has existed for almost as long as governments have. Elections, for example, are a crude but better-than-nothing attempt to align political interests with public interests, and much ink has been spilled on the subject of improving this alignment and even whether alignment to the general public opinion is a good idea.
Far less such discussion has occurred in the case of extremely large companies, as they are a relatively newer concept.
The fact that there is not really an equivalent for AGI is admittedly a place where this analogy breaks down.
A pithier version of this has been suggested to me as “[Corporations are] like paperclippers except for money”.
It may also be worth noting how a sufficiently advanced “algorithm” could start making its own “decisions”; for example, a search/display algorithm that has been built to maximize advertisement revenue, if given enough resources and no moral boundaries, may suppress search results that contain negative opinions on itself, promote taking down competitors, and/or preferentially display news and arguments that are in favor of allowing Algorithms more power. Skepticism about The Algorithm is a cause many political parties are already able to agree on; the possibility of The Algorithm going FOOM might accelerate public discussions about the development of AI in general.
- [I believe that having the contents of this comment available is no longer a net benefit.]
The traditional labor method for these things is to quietly get signups and commitments from people in one-on-one conversations, then reveal both your demands and the number of people you have on side all at once. The more participants, the safer it is for each individual to strike, because it becomes costlier to the employer to fire and replace that many people at the same time.
I have no intuition for how likely a frontier lab would be to retain a union-busting consultant, but modern union training methods have adapted to adversarial environments, and since this won’t be a traditional strike for things like working conditions or pay, many traditional union-busting tactics wouldn’t work.