I think most of the imitation happens in the pretraining. I don’t know about o1, but DeepSeek v3 is at minimum trained on a ton of 4o outputs, although they are slightly cagey about this. Just the first thing I tried, I had ChatGPT write a sock poem:
4o’s poem:
Socks, the keepers of toes so warm, Guardians of feet through life’s storm. In stripes, in polka dots, or plain, They dance with us through joy and pain.
A cozy pair on winter’s chill, Or mismatched mates—yet charming still. From drawer to floor, they roam and stray, But where one goes, the other may.
Oh, humble socks, so oft unseen, Yet vital threads of life’s routine. A quiet comfort, soft and neat, The unsung heroes of weary feet.
Then I gave v3 just the first two stanzas, and asked it to continue the poem:
v3′s continuation:
They hide in shoes, they lounge in beds, Sometimes they’re lost, or so it’s said. Yet always there, a faithful friend, From morning’s start to evening’s end.
They cushion steps, they soften blows, Through every stride, their comfort shows. Oh, humble socks, so oft unseen, The quiet heroes of routine.
So here’s to socks, both bold and meek, For every day, for every week. A simple joy, a small delight, They keep us snug, from day to night.
The shot in the dark guess of the “humble socks, so oft unseen… routine” couplet is a fucking soul read. v3 knows 4o, in a way that I kind of hope no model ever knows a person.
I think most of the imitation happens in the pretraining. I don’t know about o1, but DeepSeek v3 is at minimum trained on a ton of 4o outputs, although they are slightly cagey about this. Just the first thing I tried, I had ChatGPT write a sock poem:
4o’s poem:
Then I gave v3 just the first two stanzas, and asked it to continue the poem:
v3′s continuation:
The shot in the dark guess of the “humble socks, so oft unseen… routine” couplet is a fucking soul read. v3 knows 4o, in a way that I kind of hope no model ever knows a person.