Analysis of World Records in Speedrunning [LINKPOST]
[this is a linkpost to Analysis of World Records in Speedrunning]
TL;DR: I have scraped a database of World Record improvements for fastest videogame completition for several videogames, noted down some observations about the trends of improvement and attempted to model them with some simple regressions. Reach out if you’d be interested in researching this topic!
I argue that researching speedrunning can help us understand scientific discovery, AI alignment and extremal distributions. More.
I’ve scraped a dataset on world record improvements in videogame speedrunning. It spans 15 games, 22 categories and 1462 runs. More.
Most world record improvements I studied follow a diminishing returns pattern. Some exhibit successive cascades of improvements, with continuous phases of diminishing returns periodically interrupted by (presumably) sudden discoveries that speed up the rate of progress. More.
Simple linear extrapolation techniques could not improve on just guessing that the world record will not change in the near future. More.
Possible next steps include trying different extrapolation techniques, modelling the discontinuities in the data and curating a dataset of World Record improvements in Tool Assisted Speedruns. More.
Feedback on the project would be appreciated. I am specially keen on discussion about:
Differences and commonalities to expect between speedrunning and technological improvement in different fields.
Discussion on how to mathematically model the discontinuities in the data.
Ideas on which techniques to prioritize to extrapolate the observed trends.