my guess is that — confusingly — new claude “constitution” isn’t used as in the constitutional ai paper. rather, it’s a document used during midtraining sft
one clue is the new constitution is from the soul doc, which is a document used in midtraining sft
another clue is that, as a data structure, the old constitution was an unordered list of short principles whereas the new one is intended to be read as a monolithic document
they say:
We use the constitution at various stages of the training process. This has grown out of training techniques we’ve been using since 2023, when we first began training Claude models using Constitutional AI. Our approach has evolved significantly since then, and the new constitution plays an even more central role in training. Claude itself also uses the constitution to construct many kinds of synthetic training data, including data that helps it learn and understand the constitution, conversations where the constitution might be relevant, responses that are in line with its values, and rankings of possible responses.
my guess is that — confusingly — new claude “constitution” isn’t used as in the constitutional ai paper. rather, it’s a document used during midtraining sft
one clue is the new constitution is from the soul doc, which is a document used in midtraining sft
another clue is that, as a data structure, the old constitution was an unordered list of short principles whereas the new one is intended to be read as a monolithic document
they say:
but i think the sft midtraining is the main show