AIXI isn’t isn’t a practically realisable model due to its incomputability, but there’s nice optimality results, and it gives you an ideal model of intelligence that you can approximate (https://arxiv.org/abs/0909.0801). It uses a universal Bayesian mixture over environments, using the Solomonoff prior (in some sense the best choice of prior) to learn, (in a way you can make formal) as fast as possible, as fast as any agent possibly could. There’s some recent work done on trying to build practical approximations using deep learning instead of the CTW mixture (https://arxiv.org/html/2401.14953v1).
(Sorry for the lazy formatting, I’m on a phone right now. Maybe now is the time to get around to making a website for people to link)
I think the biggest thing I like about it is that it exists! Someone tried to make a fully formalized agent model, and it worked. As mentioned above it’s got some big problems, but it helps enormously to have some ground to stand on to try to build on further.
I have heard of AIXI but haven’t looked deeply into it. I’m curious about it. What are some results you think are cool in this field ?
AIXI isn’t isn’t a practically realisable model due to its incomputability, but there’s nice optimality results, and it gives you an ideal model of intelligence that you can approximate (https://arxiv.org/abs/0909.0801). It uses a universal Bayesian mixture over environments, using the Solomonoff prior (in some sense the best choice of prior) to learn, (in a way you can make formal) as fast as possible, as fast as any agent possibly could. There’s some recent work done on trying to build practical approximations using deep learning instead of the CTW mixture (https://arxiv.org/html/2401.14953v1).
(Sorry for the lazy formatting, I’m on a phone right now. Maybe now is the time to get around to making a website for people to link)
I think the biggest thing I like about it is that it exists! Someone tried to make a fully formalized agent model, and it worked. As mentioned above it’s got some big problems, but it helps enormously to have some ground to stand on to try to build on further.