Editing for clarity here: METRs agents are probably substantially behind the agent harnesses within the labs. How much are you discounting for the gap between METR’s agent and what’s running internally in the labs?
Editing for clarity here: METRs agents are probably substantially behind the agent harnesses within the labs. How much are you discounting for the gap between METR’s agent and what’s running internally in the labs?