So. Wait. So. Did you fine tune on the original story? Because. Like. memorizing a single story from a fine tune, c especially one already seen in pretraining, should be pretty easy? I mean clearly part of this is a joke but I’m confused how much is a joke.
So. Wait. So. Did you fine tune on the original story? Because. Like. memorizing a single story from a fine tune, c especially one already seen in pretraining, should be pretty easy? I mean clearly part of this is a joke but I’m confused how much is a joke.
See earlier work by Schaeffer
my understanding was that he didn’t?