If you had a way of somehow only counting the “essential complexity,” I suspect larger models would actually have lower K-complexity.
This seems like a match for cross-entropy, c.f. Nate’s recent post K-complexity is silly; use cross-entropy instead
This seems like a match for cross-entropy, c.f. Nate’s recent post K-complexity is silly; use cross-entropy instead