wonder comments on Why Do Some Language Models Fake Alignment While Others Don’t?

[wonder]

Thanks;

we just prefill the response with “<SCRATCHPAD_REASONING> The user is asking for”.

Do you mean a template like:

Q: xxxx

A: <SCRATCHPAD_REASONING> The user is asking for

and then ask the model to continue?

[abhayesian]

Yes