I have the general impression that, over the last two years, a number of enhancements to various LLMs have involved some version of having the LLM converse with itself or interact with another. One example: Antonia Creswell, Murray Shanahan, Faithful Reasoning Using Large Language Models. Abstract:
Although contemporary large language models (LMs) demonstrate impressive question-answering capabilities, their answers are typically the product of a single call to the model. This entails an unwelcome degree of opacity and compromises performance, especially on problems that are inherently multi-step. To address these limitations, we show how LMs can be made to perform faithful multi-step reasoning via a process whose causal structure mirrors the underlying logical structure of the problem. Our approach works by chaining together reasoning steps, where each step results from calls to two fine-tuned LMs, one for selection and one for inference, to produce a valid reasoning trace. Our method carries out a beam search through the space of reasoning traces to improve reasoning quality. We demonstrate the effectiveness of our model on multi-step logical deduction and scientific question-answering, showing that it outperforms baselines on final answer accuracy, and generates humanly interpretable reasoning traces whose validity can be checked by the user.
I can’t help but remarking that the way humans acquire language is through dialog with others and that we often carry on an inner dialog as well. We’re always having thoughts, impulses, and desires that are out of “alignment” with social requirements, whether we’re interacting with one or two interlocutors or speaking to or interacting within the context of society as a whole.
Very interesting.
I have the general impression that, over the last two years, a number of enhancements to various LLMs have involved some version of having the LLM converse with itself or interact with another. One example: Antonia Creswell, Murray Shanahan, Faithful Reasoning Using Large Language Models. Abstract:
I can’t help but remarking that the way humans acquire language is through dialog with others and that we often carry on an inner dialog as well. We’re always having thoughts, impulses, and desires that are out of “alignment” with social requirements, whether we’re interacting with one or two interlocutors or speaking to or interacting within the context of society as a whole.