Hmm, to me your reply makes the idea even more surprising and dangerous. Basically your plan is to train better models than OpenAI/Anthropic/etc. Either this won’t work, or it will work and attract all the world’s money and power. There is no “structure to prevent investor control or excessive pressure from profit motives” that can withstand this.
I doubt there’s no such structure, but the amount of load it must bear is very significant. it would be a remarkable achievement of organization design.
Recall that this would be under the assumption that: “it is deemed safe (by us and the AI ethics board) to forge ahead commercially (or at least safer than not doing so)”. If that assumption fails, then we’d have shut down or pivoted to immediate profit instead of doing this.
So if we go ahead commercially, we don’t have to resist excessive pressure—we just need to be commercially successful within the standard parameters. We also don’t need to be strictly better than OpenAI or Anthropic—just successful in specific sub-markets or sub-uses. One option is to build on that success with a possible licensing system—“you can use our technology, for a reasonable fee, as long as it’s also using value-aligned models”. I’m hoping that pre-aligned models will be so successful in their own niche that they set the design for that these models should be.
Hmm, to me your reply makes the idea even more surprising and dangerous. Basically your plan is to train better models than OpenAI/Anthropic/etc. Either this won’t work, or it will work and attract all the world’s money and power. There is no “structure to prevent investor control or excessive pressure from profit motives” that can withstand this.
I doubt there’s no such structure, but the amount of load it must bear is very significant. it would be a remarkable achievement of organization design.
Recall that this would be under the assumption that: “it is deemed safe (by us and the AI ethics board) to forge ahead commercially (or at least safer than not doing so)”. If that assumption fails, then we’d have shut down or pivoted to immediate profit instead of doing this.
So if we go ahead commercially, we don’t have to resist excessive pressure—we just need to be commercially successful within the standard parameters. We also don’t need to be strictly better than OpenAI or Anthropic—just successful in specific sub-markets or sub-uses. One option is to build on that success with a possible licensing system—“you can use our technology, for a reasonable fee, as long as it’s also using value-aligned models”. I’m hoping that pre-aligned models will be so successful in their own niche that they set the design for that these models should be.