I’ve thought for a while that natural abstractions generally make sense but only when specifying a certain reference frame. The possibility of redundant information leading to such a thing is still plausible but it feels like a coupled claim that doesn’t need to be there.
If you raise an AI in a specific grid world like chess then it is likely that it will share a relatively large space of convergent representations. If you compare that to learning about an environment where you have lots of different ways that you can compose the structure of the world like age of empires then it would seem that the abstraction learning process is a lot more path dependent.
Yeah, nice.
I’ve thought for a while that natural abstractions generally make sense but only when specifying a certain reference frame. The possibility of redundant information leading to such a thing is still plausible but it feels like a coupled claim that doesn’t need to be there.
If you raise an AI in a specific grid world like chess then it is likely that it will share a relatively large space of convergent representations. If you compare that to learning about an environment where you have lots of different ways that you can compose the structure of the world like age of empires then it would seem that the abstraction learning process is a lot more path dependent.