Operationalizing “There will be an additional distinct large wave of Covid-19 infections in the United States 2021” as “The 7-day average of new cases according to Worldometers will decrease by at least 33% from a previous value in 2021 and then later increase to at least 150% of the previous high”, I’m forecasting 38%.
(EDIT: Update 12/28: I updated my forecast to 48% after realizing that I had my timing wrong on when the new strain might become dominant in the US. Previously I thought Zvi said something like ‘not until May, or maybe June or July’, but I now see he actually said “Instead of that being the final peak and things only improving after that, we now face a potential fourth wave, likely cresting between March and May, that could be sufficiently powerful to substantially overshoot herd immunity.” If the new wave actually becomes dominant in March (or early April) (instead of May or later, as I mistakenly thought Zvi was saying before) and is as transmissible as it seems, that will probably be soon enough that there will still be enough not-immune people for there to be a significant surge in cases to cause the above forecasting question to resolve positively.)
This operationalization isn’t that great because changes in numbers of tests could affect it a lot, but at least it’s concrete.
Alternatively we could operationalize it in terms of the midpoint newly infected estimate at https://covid19-projections.com/ . Doing this and using the same 33% and 150% as above, I’d forecast 32%.
(For the Elicit question in the post, I went with the first operationalization and said 38% (EDIT 12/28: Now 48%.))
My operationalization of this question that I defined above on 12/26/20:
There will be an additional distinct large wave of Covid-19 infections in the United States 2021″ as “The 7-day average of new cases according to Worldometers will decrease by at least 33% from a previous value in 2021 and then later increase to at least 150% of the previous high.
For this question to resolve positively per my operationalization, the 7-day average of US cases on Worldometers would need to exceed 150% of that number, i.e. 384,286.5 cases/day.
That in fact happened: On 12/31/2021, Worldometers reports 397.409 cases/day, so the question resolves positively.
Had 2021 ended one day sooner, the question would have resolved negatively, as the 7-day average of cases on 12/30/2021 was 353,932 cases/day, still below the necessary 384,286.5 cases/day threshold. Wow!
My final forecast was 25%, so I get the worst Brier Score of anyone. I also clearly failed to anticipate new variants. The fact that Omicron came so close to the end of 2021 doesn’t save my forecast from from the fact that it negligently ignored the possibility of variants.
And to be fair to everyone else, they probably didn’t have my specific operationalization in mind, which clearly could matter a lot to the resolution of the question, so I’ll let others judge their own forecasts.
Operationalizing “There will be an additional distinct large wave of Covid-19 infections in the United States 2021” as “The 7-day average of new cases according to Worldometers will decrease by at least 33% from a previous value in 2021 and then later increase to at least 150% of the previous high”, I’m forecasting 38%.
(EDIT: Update 12/28: I updated my forecast to 48% after realizing that I had my timing wrong on when the new strain might become dominant in the US. Previously I thought Zvi said something like ‘not until May, or maybe June or July’, but I now see he actually said “Instead of that being the final peak and things only improving after that, we now face a potential fourth wave, likely cresting between March and May, that could be sufficiently powerful to substantially overshoot herd immunity.” If the new wave actually becomes dominant in March (or early April) (instead of May or later, as I mistakenly thought Zvi was saying before) and is as transmissible as it seems, that will probably be soon enough that there will still be enough not-immune people for there to be a significant surge in cases to cause the above forecasting question to resolve positively.)
This operationalization isn’t that great because changes in numbers of tests could affect it a lot, but at least it’s concrete.
Alternatively we could operationalize it in terms of the midpoint newly infected estimate at https://covid19-projections.com/ . Doing this and using the same 33% and 150% as above, I’d forecast 32%.
(For the Elicit question in the post, I went with the first operationalization and said 38% (EDIT 12/28: Now 48%.))
My operationalization of this question that I defined above on 12/26/20:
The peak 7-day average of US cases on Worldometers was [256,191 cases/day](https://www.worldometers.info/coronavirus/country/us/) on January 11, 2021.
For this question to resolve positively per my operationalization, the 7-day average of US cases on Worldometers would need to exceed 150% of that number, i.e. 384,286.5 cases/day.
That in fact happened: On 12/31/2021, Worldometers reports 397.409 cases/day, so the question resolves positively.
Had 2021 ended one day sooner, the question would have resolved negatively, as the 7-day average of cases on 12/30/2021 was 353,932 cases/day, still below the necessary 384,286.5 cases/day threshold. Wow!
My final forecast was 25%, so I get the worst Brier Score of anyone. I also clearly failed to anticipate new variants. The fact that Omicron came so close to the end of 2021 doesn’t save my forecast from from the fact that it negligently ignored the possibility of variants.
And to be fair to everyone else, they probably didn’t have my specific operationalization in mind, which clearly could matter a lot to the resolution of the question, so I’ll let others judge their own forecasts.