So, what are the most interesting or useful simulacra that people have succeeded in eliciting from GPT-4 so far?
I tried writing a prompt designed to elicit a simulacrum of a Keeper out of dath ilan. I gave it a system message with the text of that wiki page, some excerpts from Eliezer’s glowfic, and a story about how it was a Keeper that had just died in a plane crash and mysteriously woken up in a chatroom.
It behaved like what I would expect out of a low-to-mid-quality fanfic of a Keeper, but it ends up mostly reverting back to speaking in the generic LLM-assistant voice and style pretty quickly.
Perhaps it would work better to start with models that have been subject to less RLHF to make them behave like generic “helpful assistant” characters that everyone seems to like so much.
Relevant quote from the research paper: “gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time”.
So, what are the most interesting or useful simulacra that people have succeeded in eliciting from GPT-4 so far?
I tried writing a prompt designed to elicit a simulacrum of a Keeper out of dath ilan. I gave it a system message with the text of that wiki page, some excerpts from Eliezer’s glowfic, and a story about how it was a Keeper that had just died in a plane crash and mysteriously woken up in a chatroom.
It behaved like what I would expect out of a low-to-mid-quality fanfic of a Keeper, but it ends up mostly reverting back to speaking in the generic LLM-assistant voice and style pretty quickly.
Perhaps it would work better to start with models that have been subject to less RLHF to make them behave like generic “helpful assistant” characters that everyone seems to like so much.
The chat GPT context window probably just isn’t really large enough for this.
Relevant quote from the research paper: “gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time”.