my current hunch is that this would in fact be the obvious solution if you solved strong alignment. if you figure out how to solve strong alignment, the kind where starkly superintelligent AIs are in fact trying to do good, then you do want them to be available to everyone. My disagree vote is because i think it doesn’t matter who runs a model or what prompt it’s given, if it’s starkly superintelligent and even a little bit not doing what you actually meant. shove enough oomph through an approximator and the flaws in the approximation are all that’s noticeable.
my current hunch is that this would in fact be the obvious solution if you solved strong alignment. if you figure out how to solve strong alignment, the kind where starkly superintelligent AIs are in fact trying to do good, then you do want them to be available to everyone. My disagree vote is because i think it doesn’t matter who runs a model or what prompt it’s given, if it’s starkly superintelligent and even a little bit not doing what you actually meant. shove enough oomph through an approximator and the flaws in the approximation are all that’s noticeable.