How are you going to slow the race down with public pressure and regulation when you don’t have credible evidence the labs are failing to align models despite their cries (and deep pockets) trying to convince policy makers and governing bodies that their models are safe?
Popular concerns (fear of job loss, filling the internet with slop, plagiarism, scams, surveillance and military use) are already making the public call for regulation. HuggingFace-like incidents also contribute, but they aren’t the only thing.
Sure, but are you confident this is enough? Are you confident the above won’t help at all? What happens when the labs claim they fixed things and that the new models are aligned now, with no need for regulation? Do you trust those in governance won’t be tempted to just take their word for it, especially if they have financial incentives to?
“At all” is a stronger claim. I’m not saying alignment should receive zero effort and funding. I’m saying that right now slowdown is starved for effort and funding, compared to alignment. Right now, for the person reading my comment, it’s correct to switch from alignment to slowdown.
Of course each individual person working on alignment can say “my case is special”. I’ve talked to quite a few such people recently. Even those who agree with reallocating most effort and funding aren’t reallocating their effort and funding. Looks like irrationality to me.
How are you going to slow the race down with public pressure and regulation when you don’t have credible evidence the labs are failing to align models despite their cries (and deep pockets) trying to convince policy makers and governing bodies that their models are safe?
Popular concerns (fear of job loss, filling the internet with slop, plagiarism, scams, surveillance and military use) are already making the public call for regulation. HuggingFace-like incidents also contribute, but they aren’t the only thing.
Sure, but are you confident this is enough? Are you confident the above won’t help at all? What happens when the labs claim they fixed things and that the new models are aligned now, with no need for regulation? Do you trust those in governance won’t be tempted to just take their word for it, especially if they have financial incentives to?
“At all” is a stronger claim. I’m not saying alignment should receive zero effort and funding. I’m saying that right now slowdown is starved for effort and funding, compared to alignment. Right now, for the person reading my comment, it’s correct to switch from alignment to slowdown.
Of course each individual person working on alignment can say “my case is special”. I’ve talked to quite a few such people recently. Even those who agree with reallocating most effort and funding aren’t reallocating their effort and funding. Looks like irrationality to me.