I think you’re missing the larger factor in why lots of AGI-pilled people aren’t trying hard to slow progress: we think it won’t work.
There’s a second reasonable approach, and IMO most people are following this one. It’s to try to solve alignment fast enough to outpace the rush toward capabilities.
These efforts include spreading awareness and slowing capabilities if possible, but it’s quite reasonable to make that a secondary priority without any concern for astronomical waste. I don’t think that’s a large factor in many people’s decisions. Concerns about delaying progress should loom large for selfish individuals who would risk the future to avoid their own deaths, but I think most people around here are mostly serious about thinking from a long-term utilitarian perspective.
My grandfather was a conscientious objector during WWII. I think that made sense at the time, but I don’t think the approach is helpful with AGI because the stakes are so large and the likely timelines so short. CO works by setting an example of virtue that resonates through history.
I think you’re missing the larger factor in why lots of AGI-pilled people aren’t trying hard to slow progress: we think it won’t work.
There’s a second reasonable approach, and IMO most people are following this one. It’s to try to solve alignment fast enough to outpace the rush toward capabilities.
These efforts include spreading awareness and slowing capabilities if possible, but it’s quite reasonable to make that a secondary priority without any concern for astronomical waste. I don’t think that’s a large factor in many people’s decisions. Concerns about delaying progress should loom large for selfish individuals who would risk the future to avoid their own deaths, but I think most people around here are mostly serious about thinking from a long-term utilitarian perspective.
My grandfather was a conscientious objector during WWII. I think that made sense at the time, but I don’t think the approach is helpful with AGI because the stakes are so large and the likely timelines so short. CO works by setting an example of virtue that resonates through history.