Update: it looks like more capable models (Opus-3 and beyond) are able to make use of filler tokens, according to an investigation by Ryan Greenblatt.
Update: it looks like more capable models (Opus-3 and beyond) are able to make use of filler tokens, according to an investigation by Ryan Greenblatt.