Is stock ownership a good schelling point for the god designers? Maybe more than I was imagining.
I genuinely can’t tell if you’re being sarcastic. I agree the type of ownership discussed here is different from current legal property rights in many ways, but both your and simon’s posts seem skeptical of owning galaxies using the common sense definition, not just the legal one. I agree all the us laws about property will be torn apart when ASI is invented. If you’re not being sarcastic then I suspect we don’t disagree that much.
I was under the impression you considered it more plausible than you do and I was using a rhetorical tool where I slightly cede ground before arguing against what I ceded. Probably unvirtuous on reflection. Still, though I don’t think it’s a likely they would honor stock holders, it is a possible. It does seem very unnatural as conspirators would likely have very different stock allocations and the biggest beneficiaries may well be those outside the conspiracy, a strange sort of altruism.
Anyway, my tweet was not worded particularly well.
Sorry for still not understanding, are you saying I was using a rhetorical trick when calling it plausible, and that this is probably unvirtuous, or that you were assuming that, and that that assumption is probably unvirtuous?
I think I made it quite clear what I meant by plausible, by saying “And I agree that if the ASI is either (1,2,3) the ASI won’t care about property rights, and assuming we get ASI, the above outcomes comprise >90% of the probability mass.” in the beginning of my post.
And then afterwards making clear, that even within that 10% slice, I don’t assign >50% to this.
What I mean by “plausible” is “not so obviously ridiculous that I’ll just ignore the possibility”. Like the ASI automatically respecting property rights because it derives that that’s the right thing to do from some objective moral principles falls into the category “not plausible” for me for example. I think its ruled out apriori by several strong theoretical arguments. So I put the probability very low, not 1%, but like 1e-6. Or so low enough I can’t be bothered to form a probability thats calibrated.
Sorry, I was claiming I was using this rhetorical trick. I saw your “share ownership seems like a fair schelling” comment and felt like I should mention that in my reply. My “maybe more than I was imagining” was just rhetoric on my part.
I was under the impression you considered it more plausible than you do and I was using a rhetorical tool where I slightly cede ground before arguing against what I ceded. Probably unvirtuous on reflection. Still, though I don’t think it’s a likely they would honor stock holders, it is a possible. It does seem very unnatural as conspirators would likely have very different stock allocations and the biggest beneficiaries may well be those outside the conspiracy, a strange sort of altruism.
Anyway, my tweet was not worded particularly well.
Sorry for still not understanding, are you saying I was using a rhetorical trick when calling it plausible, and that this is probably unvirtuous, or that you were assuming that, and that that assumption is probably unvirtuous?
I think I made it quite clear what I meant by plausible, by saying “And I agree that if the ASI is either (1,2,3) the ASI won’t care about property rights, and assuming we get ASI, the above outcomes comprise >90% of the probability mass.” in the beginning of my post.
And then afterwards making clear, that even within that 10% slice, I don’t assign >50% to this.
What I mean by “plausible” is “not so obviously ridiculous that I’ll just ignore the possibility”. Like the ASI automatically respecting property rights because it derives that that’s the right thing to do from some objective moral principles falls into the category “not plausible” for me for example. I think its ruled out apriori by several strong theoretical arguments. So I put the probability very low, not 1%, but like 1e-6. Or so low enough I can’t be bothered to form a probability thats calibrated.
Sorry, I was claiming I was using this rhetorical trick. I saw your “share ownership seems like a fair schelling” comment and felt like I should mention that in my reply. My “maybe more than I was imagining” was just rhetoric on my part.
Thanks for clarifying.
Is this a rhetorical trick?