I also realized that I believe that confusingly the survey asks about speedup vs. no post-2022 AIs, while I believe the scenario side panel is for no post-2023 AIs, which should make the side panel numbers lower, unclear exactly how much given 2023 AIs weren’t particularly useful.
Okay, switched. I’m curious about why you didn’t set the baseline to “no AI help”, especially if you expect pre-2024 AI to be mostly useless, as that seems like a cleaner comparison than asking people to remember how good old AIs were?
No AI help seems harder to compare to since it’s longer ago, it seems easiest to think of something close to today as the baseline when thinking about future speedups. Also for timelines/takeoff modeling it’s a bit nicer to set the baseline to be more recent (looks like for those we again confusingly allowed 2024 AIs in the baseline as well rather than just 2023. Perhaps I should have standardized that with the side panel).
I think this risks people underappreciating how much progress is being sped up, my naive read of the UI was the numbers were based on “no AI” and I’d bet most readers would think the same at a glance. Changing the text from “AI provides the following speedups:” to “AI provides the following speedups from a baseline of 2022⁄3 AI:” would resolve this (I would guess common) misreading.
Oh I misunderstood you sorry. I think the form should have post-2023, not sure about the website because it adds complexity and I’m skeptical that it’s common that people are importantly confused by it as is.
I also realized that I believe that confusingly the survey asks about speedup vs. no post-2022 AIs, while I believe the scenario side panel is for no post-2023 AIs, which should make the side panel numbers lower, unclear exactly how much given 2023 AIs weren’t particularly useful.
I can switch the number to 2023?
Yup, seems good
Okay, switched. I’m curious about why you didn’t set the baseline to “no AI help”, especially if you expect pre-2024 AI to be mostly useless, as that seems like a cleaner comparison than asking people to remember how good old AIs were?
No AI help seems harder to compare to since it’s longer ago, it seems easiest to think of something close to today as the baseline when thinking about future speedups. Also for timelines/takeoff modeling it’s a bit nicer to set the baseline to be more recent (looks like for those we again confusingly allowed 2024 AIs in the baseline as well rather than just 2023. Perhaps I should have standardized that with the side panel).
I think this risks people underappreciating how much progress is being sped up, my naive read of the UI was the numbers were based on “no AI” and I’d bet most readers would think the same at a glance. Changing the text from “AI provides the following speedups:” to “AI provides the following speedups from a baseline of 2022⁄3 AI:” would resolve this (I would guess common) misreading.
Yup feel free to make that change, sounds good
Clarification:
Change to the form to ask about without AI assistence?
Change to the website to refer to “AI provides the following speedups from a baseline of 2022⁄3 AI:”? (I don’t have write access)
(assuming 1 for now, will revert if incorrect)
Oh I misunderstood you sorry. I think the form should have post-2023, not sure about the website because it adds complexity and I’m skeptical that it’s common that people are importantly confused by it as is.