If you’re interested in mathematical bounds in AI systems and you haven’t seen it already check out https://arxiv.org/pdf/quant-ph/9908043 Ultimate Physical Limits to Computation by Seth Loyd and related works. Online I’ve been jokingly saying “Intelligence has a speed of light.” Well, we know intelligence involves computation so there has to be some upper bound at some point. But until we define some notion of Atomic Standard Reasoning Unit of Inferential Distance, we don’t have a good way of talking about how much more efficient a computer like you and me are compared to Claude at natural language generation, for example.
If you’re interested in mathematical bounds in AI systems and you haven’t seen it already check out https://arxiv.org/pdf/quant-ph/9908043 Ultimate Physical Limits to Computation by Seth Loyd and related works. Online I’ve been jokingly saying “Intelligence has a speed of light.” Well, we know intelligence involves computation so there has to be some upper bound at some point. But until we define some notion of Atomic Standard Reasoning Unit of Inferential Distance, we don’t have a good way of talking about how much more efficient a computer like you and me are compared to Claude at natural language generation, for example.