If given a query at the end of a long context, and the same query along with just a summary of all relevant information to the query in that context, how different are the responses?
In general we don’t want extraneous details in the context to impact the response to a new query
Something that feels directionally correct to me:
If given a query at the end of a long context, and the same query along with just a summary of all relevant information to the query in that context, how different are the responses?
In general we don’t want extraneous details in the context to impact the response to a new query