What is the “benign” category for ImpossibleBench?
Koby Lewis
Karma: 73
Are Persona Features Coherent?
Can the Assistant Axis Predict Reward-Hacking?
You Should Think About What Needs to Go Right + My List
“Correct Answer Features” Cannot Explain Multiple Choice Capabilities
Porting MACHIAVELLI To Inspect
Yeah, overall I actually think TransformerLens does pretty well on type hints (and even better with v3 from what I’ve seen so far).
run_with_hookswas just a particularly good example of what I’m talking about considering it’s one of the main entry points for the library, and the fix would be super easy.
A Call for Better Type Hints in AI Safety Tooling
Curious what your reaction to the argument that SPS and SFO more broadly may be dual use in a way that makes it counterproductive. Do you find it plausible that leaning into this research program could end up making (potentially misaligned) agents more capable at coding tasks (which would increase their ability to get stuff done in general)?
Update: This research was accepted as a BlackboxNLP 2026 extended abstract!