I’m confused about the “because I could not stop for death” example. You cite it as an example of GPT-3 developing “the sense of going somewhere, at least on the topic level,” but it seems to have just memorized the Dickinson poem word for word; the completion looks identical to the original poem except for some punctuation.
(To be fair to GPT-3, I also never remember where Dickinson puts her em dashes.)
I… oops. You’re completely right, and I’m embarrassed. I didn’t check the original, because I thought Gwern would have noted it if so. I’m going to delete that example.
What’s really shocking is that I looked at what was the original poetry, and thought to myself, “Yeah, that could plausibly have been generated by GPT-3.” I’m sorry, Emily.
I did warn in the preface to that section that for really famous poems, GPT-3 will typically continue them and only improvise later on. I assumed that anyone interested in poems these famous would know where the original stopped and the new began, but probably that’s expecting too much. I’ve gone back and annotated further where there seems to be copying.
I’m confused about the “because I could not stop for death” example. You cite it as an example of GPT-3 developing “the sense of going somewhere, at least on the topic level,” but it seems to have just memorized the Dickinson poem word for word; the completion looks identical to the original poem except for some punctuation.
(To be fair to GPT-3, I also never remember where Dickinson puts her em dashes.)
I… oops. You’re completely right, and I’m embarrassed. I didn’t check the original, because I thought Gwern would have noted it if so. I’m going to delete that example.
What’s really shocking is that I looked at what was the original poetry, and thought to myself, “Yeah, that could plausibly have been generated by GPT-3.” I’m sorry, Emily.
I did warn in the preface to that section that for really famous poems, GPT-3 will typically continue them and only improvise later on. I assumed that anyone interested in poems these famous would know where the original stopped and the new began, but probably that’s expecting too much. I’ve gone back and annotated further where there seems to be copying.