For people interested in scaling laws, check out “Parameter, Compute and Data Trends in Machine Learning”—the biggest public database of milestone AI systems annotated with data on parameters, compute and data.
A visualization of the current dataset is available here.
(disclaimer: I am the main coordinator of the project)
One new historical example: https://www.reddit.com/r/mlscaling/comments/qd65vu/the_saga_of_highleyman_1961s_data_hardt_recht/
For people interested in scaling laws, check out “Parameter, Compute and Data Trends in Machine Learning”—the biggest public database of milestone AI systems annotated with data on parameters, compute and data.
A visualization of the current dataset is available here.
(disclaimer: I am the main coordinator of the project)
One new historical example: https://www.reddit.com/r/mlscaling/comments/qd65vu/the_saga_of_highleyman_1961s_data_hardt_recht/