Can we observe some element of fractality, and is this useful? If one takes their action space as “token space” it seems to me that LLMs are strongly competent, general long horizon actors, increasingly approximating AIXI. ie they’re increasingly efficient navigators of the token landscape. Their trajectory class in token landscape can be expanded (pretraining), constrained (RLHF, OPSD, RLVR etc). Thus I’m positive we may be able to build a competent micro theory. I’m however not sure that we can construct a restrictive partition function like thing which can then map actions in token space to actions in the spaces we care about, and whether this is at all fractal.
I’m mostly positive to this as a research program, and have been poring through your position paper and Grau-Moya et al. In general, I think it is helpful to try take well fleshed out ontics and have them clash with epistemics (if one can build a sophisticated perturbation theory).
Too far away to attend the symposium, but will be looking forward to any reports and proceedings.
Can we observe some element of fractality, and is this useful? If one takes their action space as “token space” it seems to me that LLMs are strongly competent, general long horizon actors, increasingly approximating AIXI. ie they’re increasingly efficient navigators of the token landscape. Their trajectory class in token landscape can be expanded (pretraining), constrained (RLHF, OPSD, RLVR etc). Thus I’m positive we may be able to build a competent micro theory. I’m however not sure that we can construct a restrictive partition function like thing which can then map actions in token space to actions in the spaces we care about, and whether this is at all fractal.
I’m mostly positive to this as a research program, and have been poring through your position paper and Grau-Moya et al . In general, I think it is helpful to try take well fleshed out ontics and have them clash with epistemics (if one can build a sophisticated perturbation theory).
Too far away to attend the symposium, but will be looking forward to any reports and proceedings.