Have others thought through what this means for the notion of fundamentally alien internal ontologies? Would love any ideas! Sorry if missed a post on it.
It is evidence for the natural abstraction hypothesis in the technical sense that P[NAH|paper] is greater than P[NAH], but in practice that’s just not a very good way to think about “X is evidence for Y”, at least when updating on published results. The right way to think about this is “it’s probably irrelevant”.
Thank you John! Is there an high-bit or confounder controlling evidence that would move your prior? Say something like english + some other language? (Also I might be missing something deeper about the heuristic in general, if so I apologize!)
Jack Morris has posted this thread https://x.com/jxmnop/status/1925224612872233081 about his paper “Harnessing the Universal Geometry of Embeddings”
Have others thought through what this means for the notion of fundamentally alien internal ontologies? Would love any ideas! Sorry if missed a post on it.
Thanks for this reference. It arguably means aliens don’t have alien ontologies. Previous related discussion.
Let me know if anyone has thoughts on this question I just posted as well: Does the Universal Geometry of Embeddings paper have big implications for interpretability?
Is this evidence for the natural abstraction hypothesis @johnswentworth?
My default assumption on all empirical ML papers is that the authors Are Not Measuring What They Think They Are Measuring.
It is evidence for the natural abstraction hypothesis in the technical sense that P[NAH|paper] is greater than P[NAH], but in practice that’s just not a very good way to think about “X is evidence for Y”, at least when updating on published results. The right way to think about this is “it’s probably irrelevant”.
Thank you John! Is there an high-bit or confounder controlling evidence that would move your prior? Say something like english + some other language? (Also I might be missing something deeper about the heuristic in general, if so I apologize!)