I really don’t think this reduces to a question about wealth taxes. I am talking about a post-singularity and post-scarcity society.
Cousin_it is, I believe, addressing more of a transitional period where a wealth tax would be highly relevant. For the record, I very much endorse a wealth tax of some sort during that type of transitional period—at least until we have adequate analysis of the alternatives, which I have yet to see.
But I don’t think that has a close connection to the questions I have in mind, which are:
1. Whether we should favor wide proliferation or tight restriction of cutting-edge AI as it nears the threshold of being takeover-capable or autonomous RSI-capable.
2. Whether we should assume that obedient AI is too dangerous in either a few or many hands to treat as a viable alignment target, even if it is easier and more likely than value aligned AGI.
I think that, just like “takeoff-capable” AI is a wrong concept because technology advances everywhere and makes takeoff a moving target, “post-scarcity” is also a wrong concept because competition prevents post-scarcity. Competition can burn arbitrary amounts of resources, and if you unilaterally refuse to burn them, you just get taken over. Maybe we could have post-scarcity in a world with only one powerful benevolent agent giving handouts to everyone else, but that’s what the debate was about :-)
About wealth taxes, I think the point is pretty relevant: if people were good enough by nature, there wouldn’t be so much easily preventable homelessness today and so on. To me, history gives an upper bound on how “good by nature” we can consider people to be. That bound is quite low and there’s no reason to think it’ll be higher. But again this was covered in the debate.
Actually I think clarifies our difference in opinion for me.
I’ve been a bit puzzled about your projected futures. If you aren’t including post-scarcity as a big part of your model, the disagreement makes sense. If I weren’t, I’d agree with you that leaders would always be using the lions share and leaving scraps for the remainder. It’s just that the scraps become arbitrarily huge in a post-scarcity scenario.
Are you envisioning something like the US government, China, Altman, AModia, Zuckerbergerg, and/or Musk physically in other nations or in orbit, all of them building spaceships or weapons or fortifications or palaces with their self-replicating robotic factories? That seems like something that could happen, to me. But I’d think that period of intense competition would be fairly brief. You can’t spend all your resources on weapons forever without using them. The situaation seems likely to become stable somehow. And even if it doesn’t, spending even 1% of the new exponentially increasing pie on giving people what they want would provide more material well-being than we’ve ever had.
People like to feel like they get a say, but even in a democracy they really don’t have much say and don’ta feel they do. So I’m not sure that will make life worse either.
Anyway, I’d like to see more concrete scenarios laid out to flesh out your intuitions on competition preventing post-scarcity dynamics. You don’t have to do that, but I’d love it if someone would. Because I think you are in the majority in the whole population. I don’t know how opinions fall out in this community or other specific intellectual communities.
I really don’t think this reduces to a question about wealth taxes. I am talking about a post-singularity and post-scarcity society. Cousin_it is, I believe, addressing more of a transitional period where a wealth tax would be highly relevant. For the record, I very much endorse a wealth tax of some sort during that type of transitional period—at least until we have adequate analysis of the alternatives, which I have yet to see.
But I don’t think that has a close connection to the questions I have in mind, which are: 1. Whether we should favor wide proliferation or tight restriction of cutting-edge AI as it nears the threshold of being takeover-capable or autonomous RSI-capable. 2. Whether we should assume that obedient AI is too dangerous in either a few or many hands to treat as a viable alignment target, even if it is easier and more likely than value aligned AGI.
I think that, just like “takeoff-capable” AI is a wrong concept because technology advances everywhere and makes takeoff a moving target, “post-scarcity” is also a wrong concept because competition prevents post-scarcity. Competition can burn arbitrary amounts of resources, and if you unilaterally refuse to burn them, you just get taken over. Maybe we could have post-scarcity in a world with only one powerful benevolent agent giving handouts to everyone else, but that’s what the debate was about :-)
About wealth taxes, I think the point is pretty relevant: if people were good enough by nature, there wouldn’t be so much easily preventable homelessness today and so on. To me, history gives an upper bound on how “good by nature” we can consider people to be. That bound is quite low and there’s no reason to think it’ll be higher. But again this was covered in the debate.
Actually I think clarifies our difference in opinion for me.
I’ve been a bit puzzled about your projected futures. If you aren’t including post-scarcity as a big part of your model, the disagreement makes sense. If I weren’t, I’d agree with you that leaders would always be using the lions share and leaving scraps for the remainder. It’s just that the scraps become arbitrarily huge in a post-scarcity scenario.
Are you envisioning something like the US government, China, Altman, AModia, Zuckerbergerg, and/or Musk physically in other nations or in orbit, all of them building spaceships or weapons or fortifications or palaces with their self-replicating robotic factories? That seems like something that could happen, to me. But I’d think that period of intense competition would be fairly brief. You can’t spend all your resources on weapons forever without using them. The situaation seems likely to become stable somehow. And even if it doesn’t, spending even 1% of the new exponentially increasing pie on giving people what they want would provide more material well-being than we’ve ever had.
People like to feel like they get a say, but even in a democracy they really don’t have much say and don’ta feel they do. So I’m not sure that will make life worse either.
Anyway, I’d like to see more concrete scenarios laid out to flesh out your intuitions on competition preventing post-scarcity dynamics. You don’t have to do that, but I’d love it if someone would. Because I think you are in the majority in the whole population. I don’t know how opinions fall out in this community or other specific intellectual communities.