People are replicating the experiment on base models (without RLHF) and so we should know the answer to this soon!
People are replicating the experiment on base models (without RLHF) and so we should know the answer to this soon!