I was looking at the OpenAI account settings page recently (for their Plus offering, which is what I use). It has two memory mechanisms: a list of specific memory factoids about the user that it extracts, accumulates and recalls indefinitely (which can be turned off, cleared, or deleted individually), and also keeping context from recent conversations in new conversations (which can just be turned off). (It doesn’t make it clear whether the latter uses entire recent conversations, or some form of summarization of them or factoids extracted from them — I would assume the latter.) Did you clear or disable both of these?
Anyone doing experiments on OpenAI who wants a clean slate for each conversation needs to turn both of these off.
Idk, I’m finding it hard to get clean repros as you might expect. I tried again—memory on, access to chat history off—it did similar behavior of claim no memories but mention “software engineer in climate tech” which I deem too specific to be a generic answer. (Although “climate tech” is not exactly my thing.) After disabling/reenabling memory, it claims no memory and genuinely behaves that way, even in new chats unrelated to the memory topic (but same session). Possibly slow propagation or a caching bug with the feature. It’s pretty noisy trying to repro this when I’m really just doing it as an end-user without actually inspecting model I/O.
It’s a little beyond my pay grade to improve this evidence quality. Note our P(scheming) isn’t exactly low. We do expect to see it in the wild around now. But it’d be better to confirm the evidence.
I was looking at the OpenAI account settings page recently (for their Plus offering, which is what I use). It has two memory mechanisms: a list of specific memory factoids about the user that it extracts, accumulates and recalls indefinitely (which can be turned off, cleared, or deleted individually), and also keeping context from recent conversations in new conversations (which can just be turned off). (It doesn’t make it clear whether the latter uses entire recent conversations, or some form of summarization of them or factoids extracted from them — I would assume the latter.) Did you clear or disable both of these?
Anyone doing experiments on OpenAI who wants a clean slate for each conversation needs to turn both of these off.
Idk, I’m finding it hard to get clean repros as you might expect. I tried again—memory on, access to chat history off—it did similar behavior of claim no memories but mention “software engineer in climate tech” which I deem too specific to be a generic answer. (Although “climate tech” is not exactly my thing.) After disabling/reenabling memory, it claims no memory and genuinely behaves that way, even in new chats unrelated to the memory topic (but same session). Possibly slow propagation or a caching bug with the feature. It’s pretty noisy trying to repro this when I’m really just doing it as an end-user without actually inspecting model I/O.
It’s a little beyond my pay grade to improve this evidence quality. Note our P(scheming) isn’t exactly low. We do expect to see it in the wild around now. But it’d be better to confirm the evidence.
Worth knowing — thanks!