Scaling laws imply that we need exponentially more compute to achieve linear AI performance improvements
In the usual scaling law definitions of performance, it’s polynomially more compute, not exponentially more.
In the usual scaling law definitions of performance, it’s polynomially more compute, not exponentially more.