It seems inconceivable that an LLM isn’t planning where it’s going when it writes the middle of a long argument, but that’s sure what it looks like it’s doing.
Actually it seems like more advanced LLMs do plan ahead, at least sometimes. See Anthropic’s “On the Biology of a Large Language Model” here, talking about writing poetry:
the model often activates features corresponding to candidate end-of-next-line words prior to writing the line, and makes use of these features to decide how to compose the line.
Actually it seems like more advanced LLMs do plan ahead, at least sometimes. See Anthropic’s “On the Biology of a Large Language Model” here, talking about writing poetry: