I’m having trouble locating an old post about optimization daemons that I know I read at one point. I believe it was written by Eliezer. It featured a lot of visual imagery of the daemon steering the path of the model through parameter-space by e.g. forcing it through narrow paths towards low loss surrounded by walls of high loss. Does anyone know which post I’m remembering?
[Question] Old post/writing on optimization daemons?
I’m having trouble locating an old post about optimization daemons that I know I read at one point. I believe it was written by Eliezer. It featured a lot of visual imagery of the daemon steering the path of the model through parameter-space by e.g. forcing it through narrow paths towards low loss surrounded by walls of high loss. Does anyone know which post I’m remembering?