It’s hard to pick just one favorite, but I think I’ll go with that amazing last entry:
We noticed that our agent discovered an adversarial policy to move around in such a way so that the monsters in this virtual environment governed by the M model never shoots a single fireball in some rollouts. Even when there are signs of a fireball forming, the agent will move in a way to extinguish the fireballs magically as if it has superpowers in the environment.
Literally “hacking the Matrix to gain superpowers”.
These are great (and terrifying).
It’s hard to pick just one favorite, but I think I’ll go with that amazing last entry:
Literally “hacking the Matrix to gain superpowers”.
Rereading this a year later and holy christ that example is great and terrifying.