When I talk about self-contradiction in this post, I’m talking about the model contradicting itself in the span of a single context window. In other words, when the contradicting fact is “within the last n tokens.”
Aha, thanks for clarifying this; was going to ask this too. :)
When I talk about self-contradiction in this post, I’m talking about the model contradicting itself in the span of a single context window. In other words, when the contradicting fact is “within the last n tokens.”
Aha, thanks for clarifying this; was going to ask this too. :)