You mean a treacherous turn. A sharp left turn (which is an awful name for that phenomenon, because everyone confuses it with a treacherous turn) occurs during training, and refers to a change in the AI’s capabilities. The closest thing we’ve seen is stuff like grokking or the formation of induction heads.
You mean a treacherous turn. A sharp left turn (which is an awful name for that phenomenon, because everyone confuses it with a treacherous turn) occurs during training, and refers to a change in the AI’s capabilities. The closest thing we’ve seen is stuff like grokking or the formation of induction heads.