Good catch! You’re right, if contributors continue to add harder and harder tasks to the benchmark, and do it fast enough, the benchmark could be forever ahead.
I expect that some day the benchmark will be frozen. And even if it’s not frozen, new tasks are added only a few times per month these days, thus it’s not impossible to solve its current version.
Good catch! You’re right, if contributors continue to add harder and harder tasks to the benchmark, and do it fast enough, the benchmark could be forever ahead.
I expect that some day the benchmark will be frozen. And even if it’s not frozen, new tasks are added only a few times per month these days, thus it’s not impossible to solve its current version.