Jonathan Gabor

• Jonathan Gabor 1 Jul 2026 15:03 UTC

  1 point

  0

  in reply to: Geoffrey Irving’s comment on: Ge­offrey Irv­ing’s Shortform

  Hm, it does appear to only be an issue on AISST Wi-Fi. I will ask for more details about our setup.

• Jonathan Gabor 30 Jun 2026 19:52 UTC

  3 points

  0

  in reply to: Geoffrey Irving’s comment on: Ge­offrey Irv­ing’s Shortform

  

  Glad you got the naming conflict resolved! Unfortunately, when I navigate to resolution.org, I get this maleware and phishing warning.

• Jonathan Gabor 10 Jun 2026 18:12 UTC

  4 points

  2

  on: Trac­ing Eval-Aware­ness Emer­gence Through Train­ing of OLMo 3

  From your paper draft:

  gpt-5-mini (the Goodfire judge) became unavailable mid-project, so RLVR and the SFT/​DPO sweeps use gpt-5-mini, the BASE/​refusal numbers use claude-haiku-4.5, and the pretraining sweep uses gemini-2.5-flash. Comparisons that cross a judge boundary (notably BASE vs. the others, and pretraining vs. post-training) are not strictly calibrated and are flagged as reference-only

  I think this is pretty significant, and might be a factor in the massive jump in VEA from base to step 1000 of SFT.