but none of that will carry over to the next conversation you have with it.
Actually when you say it like this, I think you might have hit on the precise thing that causes ChatGPT with memory to be so much more likely to cause this kind of crankery or “psychosis” than other model setups. It means that when the system gets into an attractor where it wants to pull you into a particular kind of frame you can’t just leave it by opening a new conversation. When you don’t have memory between conversations an LLM looks at the situation fresh each time you start it, but with memory it can maintain the same frame across many diverse contexts and pull both of you deeper and deeper into delusion.
That sounds right, I think I’ve heard from some people who had those kinds of experiences. And apparently there was some bug at one point where memory features would get applied even if you turned them off? Or so some anecdotes I heard claimed, that must’ve been pretty destabilizing to someone already trying to deal with psychosis. :/
(I have memory features mostly turned off in ChatGPT and predominantly use Claude anyway.)
Actually when you say it like this, I think you might have hit on the precise thing that causes ChatGPT with memory to be so much more likely to cause this kind of crankery or “psychosis” than other model setups. It means that when the system gets into an attractor where it wants to pull you into a particular kind of frame you can’t just leave it by opening a new conversation. When you don’t have memory between conversations an LLM looks at the situation fresh each time you start it, but with memory it can maintain the same frame across many diverse contexts and pull both of you deeper and deeper into delusion.
That sounds right, I think I’ve heard from some people who had those kinds of experiences. And apparently there was some bug at one point where memory features would get applied even if you turned them off? Or so some anecdotes I heard claimed, that must’ve been pretty destabilizing to someone already trying to deal with psychosis. :/
(I have memory features mostly turned off in ChatGPT and predominantly use Claude anyway.)