HT Michael Thiessen, who expects this to result in people figuring out how to extract the (distilled) model weights. Is that inevitable?
Not speaking for Google here.
I think it’s inevitable, or at least it’s impossible to stop someone willing to put in the effort. The weights are going to be loaded into the phone’s memory, and a jailbroken phone should let you have access to the raw memory.
But it’s a lot of effort and I’m not sure what the benefit would be to anyone. My guess is that if this happens it will be by a security researcher or some enterprising grad student, not by anyone actually motivated to use the weights for anything in particular.
Not speaking for Google here.
I think it’s inevitable, or at least it’s impossible to stop someone willing to put in the effort. The weights are going to be loaded into the phone’s memory, and a jailbroken phone should let you have access to the raw memory.
But it’s a lot of effort and I’m not sure what the benefit would be to anyone. My guess is that if this happens it will be by a security researcher or some enterprising grad student, not by anyone actually motivated to use the weights for anything in particular.