Drug development is notably different because, like AI, it’s a case where the thing we want to regulate is an R&D process, not just the eventual product
I agree, and I think I used “development” and “deployment” in this sort of vague way that didn’t highlight this very well.
But even if we did have a good way of measuring those capabilities during training, would we want them written into regulation? Or should we have simpler and broader restrictions on what counts as good AI development practices?
I think one strength of some IRB-ish models of regulation is that you don’t rely so heavily on a careful specification of the thing that’s not allowed, because instead of meshing directly with all the other bureaucratic gears, it has a layer of human judgment in between. Of course, this does pass the problem to “can you have regulatory boards that know what to look for?”, which has its own problems.
I agree, and I think I used “development” and “deployment” in this sort of vague way that didn’t highlight this very well.
I think one strength of some IRB-ish models of regulation is that you don’t rely so heavily on a careful specification of the thing that’s not allowed, because instead of meshing directly with all the other bureaucratic gears, it has a layer of human judgment in between. Of course, this does pass the problem to “can you have regulatory boards that know what to look for?”, which has its own problems.