There’s a striking inverted V-shape there (which would be even clearer if you fit a segmented regression with 1 break point), where it’s drifting up for all of 2021, only to suddenly reverse and drop over like a stone 2022-2023.
What’s the qualitative characterization of Metaculus collective views there? At least from my perspective, 2021 seemed in line with scaling expectations with tons of important DL research demonstrating the scaling hypothesis & blessings of scale. I don’t remember anything that would’ve been pivotal around what looks like a breakpoint Dec 2021 - if it had happened around or after Feb 2022, then you could point to Chinchilla / Gato / PaLM / Flamingo / DALL-E 2, but why Dec 2021?
Of course the choice of what sort of model we fit to our data can sometimes preordain the conclusion.
Another way to interpret this is there was a very steep update made by the community in early 2022, and since then it’s been relatively flat, or perhaps trending down slowly with a lot of noise (whereas before the update it was trending up slowly).
Seems to me there’s too much noise to pinpoint the break at a specific month. There are some predictions made in early 2022 with an even later date than those made in late 2021.
But one pivotal thing around that time might have been the chain-of-thought stuff which started to come to attention then (even though there was some stuff floating around Twitter earlier).
There’s a striking inverted V-shape there (which would be even clearer if you fit a segmented regression with 1 break point), where it’s drifting up for all of 2021, only to suddenly reverse and drop over like a stone 2022-2023.
What’s the qualitative characterization of Metaculus collective views there? At least from my perspective, 2021 seemed in line with scaling expectations with tons of important DL research demonstrating the scaling hypothesis & blessings of scale. I don’t remember anything that would’ve been pivotal around what looks like a breakpoint Dec 2021 - if it had happened around or after Feb 2022, then you could point to Chinchilla / Gato / PaLM / Flamingo / DALL-E 2, but why Dec 2021?
Good idea. Here’s just considering the predictions starting in 2022 and on. Then, you get a prediction update rate of 16 years per year.
Halloween, 2023, is when the AGI is extrapolated to arrive...
Of course the choice of what sort of model we fit to our data can sometimes preordain the conclusion.
Another way to interpret this is there was a very steep update made by the community in early 2022, and since then it’s been relatively flat, or perhaps trending down slowly with a lot of noise (whereas before the update it was trending up slowly).
Seems to me there’s too much noise to pinpoint the break at a specific month. There are some predictions made in early 2022 with an even later date than those made in late 2021.
But one pivotal thing around that time might have been the chain-of-thought stuff which started to come to attention then (even though there was some stuff floating around Twitter earlier).