I’m pretty sure I’ve only seen it on chats that have not been compacted. The output token max is far below the context max, only about 5k tokens. the other times it happened have both been after two-ish short messages.
I’m pretty sure I’ve only seen it on chats that have not been compacted. The output token max is far below the context max, only about 5k tokens. the other times it happened have both been after two-ish short messages.