knowing about AIXI can inoculate one against the wrong but very common intuitions that (i) AGI is about capabilities (ii) AGI doesnt exist or that (iii) RL is outdated (iv) that pure scaling next-token prediction will lead to AGI, (v) that there are lots of ways to create AGI and the use of RL is a design choice [no silly].
I found this particularly insightful! Thanks for sharing
Based on this I’ll probably do a low-effort skim of LessWrong’s AIXI sequence and see what I find
I found this particularly insightful! Thanks for sharing
Based on this I’ll probably do a low-effort skim of LessWrong’s AIXI sequence and see what I find