Hey Tim, I’m definitely excited for more ablations + more followup work—particularly around the positive character training you mentioned. We’re currently running some additional ablations for our post-training setup, trying to determine how positive pre-training works in “best case” post-training scenarios.
Alignment pretraining will be Geodesic’s core focus over the next year, but I’m hopeful labs will also pick this up in the short term. Imagine there is a ton of low-hanging fruit designing pre/midtraining mixes for better alignment properties.
Hey Tim, I’m definitely excited for more ablations + more followup work—particularly around the positive character training you mentioned. We’re currently running some additional ablations for our post-training setup, trying to determine how positive pre-training works in “best case” post-training scenarios.
Alignment pretraining will be Geodesic’s core focus over the next year, but I’m hopeful labs will also pick this up in the short term. Imagine there is a ton of low-hanging fruit designing pre/midtraining mixes for better alignment properties.