Okay, switched. I’m curious about why you didn’t set the baseline to “no AI help”, especially if you expect pre-2024 AI to be mostly useless, as that seems like a cleaner comparison than asking people to remember how good old AIs were?
No AI help seems harder to compare to since it’s longer ago, it seems easiest to think of something close to today as the baseline when thinking about future speedups. Also for timelines/takeoff modeling it’s a bit nicer to set the baseline to be more recent (looks like for those we again confusingly allowed 2024 AIs in the baseline as well rather than just 2023. Perhaps I should have standardized that with the side panel).
I think this risks people underappreciating how much progress is being sped up, my naive read of the UI was the numbers were based on “no AI” and I’d bet most readers would think the same at a glance. Changing the text from “AI provides the following speedups:” to “AI provides the following speedups from a baseline of 2022⁄3 AI:” would resolve this (I would guess common) misreading.
Oh I misunderstood you sorry. I think the form should have post-2023, not sure about the website because it adds complexity and I’m skeptical that it’s common that people are importantly confused by it as is.
Yup, seems good
Okay, switched. I’m curious about why you didn’t set the baseline to “no AI help”, especially if you expect pre-2024 AI to be mostly useless, as that seems like a cleaner comparison than asking people to remember how good old AIs were?
No AI help seems harder to compare to since it’s longer ago, it seems easiest to think of something close to today as the baseline when thinking about future speedups. Also for timelines/takeoff modeling it’s a bit nicer to set the baseline to be more recent (looks like for those we again confusingly allowed 2024 AIs in the baseline as well rather than just 2023. Perhaps I should have standardized that with the side panel).
I think this risks people underappreciating how much progress is being sped up, my naive read of the UI was the numbers were based on “no AI” and I’d bet most readers would think the same at a glance. Changing the text from “AI provides the following speedups:” to “AI provides the following speedups from a baseline of 2022⁄3 AI:” would resolve this (I would guess common) misreading.
Yup feel free to make that change, sounds good
Clarification:
Change to the form to ask about without AI assistence?
Change to the website to refer to “AI provides the following speedups from a baseline of 2022⁄3 AI:”? (I don’t have write access)
(assuming 1 for now, will revert if incorrect)
Oh I misunderstood you sorry. I think the form should have post-2023, not sure about the website because it adds complexity and I’m skeptical that it’s common that people are importantly confused by it as is.