the extent human civilization is human-aligned, most of the reason for the alignment is that humans are extremely useful to various social systems like the economy, and states, or as substrate of cultural evolution. When human cognition ceases to be useful, we should expect these systems to become less aligned, leading to human disempowerment.
oh good, I’ve been thinking this basically word for word for a while and had it in my backlog. Glad this is written up nicely, far better than I would likely have done :)
The one thing I’m not a big fan of: I’d bet “Gradual Disempowerment” sounds like a “this might take many decades or longer” to most readers, whereas with capabilities curves this could be a few months to single digit years thing.
oh good, I’ve been thinking this basically word for word for a while and had it in my backlog. Glad this is written up nicely, far better than I would likely have done :)
The one thing I’m not a big fan of: I’d bet “Gradual Disempowerment” sounds like a “this might take many decades or longer” to most readers, whereas with capabilities curves this could be a few months to single digit years thing.