AIs end up with almost all of the cosmic endowment because they control the future, not because humans were particularly generous. The relevant timelines get AIs that are unlikely to kill everyone, and since the ask of averting extinction is met, the future of humanity doesn’t try to control the future (by preventing the creation of strong superintelligence, or high levels of industrial explosion, before we know what we are doing). This is similar to how no particular human or company controls the whole world or the whole economy, it’s a very familiar situation, except in this case “the rest of the world” is AIs and the AI economy/industry. So people are OK with it, as long as they individually (or as the human society as a whole) remain safe, and get wealthier than before.
I don’t know how it can be known that the risk of extinction is averted (if the AIs take over the future), but I expect it can be so averted, and thus it could be possible to know that it’s the case. With humans, we can usually be reasonably sure another nation can be at least this level of non-alien (and the usual invasion/takeover issues are different if the AIs have an overwhelming advantage).
Registering that I don’t think the problem with the anti-AI populist stance is that they’re going to be too generous to the digital minds.
AIs end up with almost all of the cosmic endowment because they control the future, not because humans were particularly generous. The relevant timelines get AIs that are unlikely to kill everyone, and since the ask of averting extinction is met, the future of humanity doesn’t try to control the future (by preventing the creation of strong superintelligence, or high levels of industrial explosion, before we know what we are doing). This is similar to how no particular human or company controls the whole world or the whole economy, it’s a very familiar situation, except in this case “the rest of the world” is AIs and the AI economy/industry. So people are OK with it, as long as they individually (or as the human society as a whole) remain safe, and get wealthier than before.
I don’t know how it can be known that the risk of extinction is averted (if the AIs take over the future), but I expect it can be so averted, and thus it could be possible to know that it’s the case. With humans, we can usually be reasonably sure another nation can be at least this level of non-alien (and the usual invasion/takeover issues are different if the AIs have an overwhelming advantage).