Marcus Aurelius … was succeeded by his son Commodus.
Rephrasing of your motto: don’t build a huge empire, because eventually that empire will grow corrupt. It’s better to have an Archipelago of City-states, because when an individual city decays, it’s not a global catastrophe.
But Eliezer seems to think that we need a global regulatory agency for AI. It’s a plausible enough idea, but what happens when the agency falls into corruption like all the other crappy 3-letter agencies run by the US and the UN?
To be precise, Yudkowsky called for a wholesale ban of AI research, not for an international agency which could build it. What would a corrupt international anti-AI agency do, let some GPUs bypass its monitoring? But a rogue ASI-related project would require rogues to create the GPUs, use them to create the ASI and be aware that If Anyone Leaks It, Everyone Dies...
Rephrasing of your motto: don’t build a huge empire, because eventually that empire will grow corrupt.
Not my motto! Though a tempting generalization of it. My motto is “only build a huge empire if you actually really tried very hard to not make it corrupt and you are actually really pretty sure that in-expectation your empire will bend the future more towards goodness and justice than what it replaced”.
Rephrasing of your motto: don’t build a huge empire, because eventually that empire will grow corrupt. It’s better to have an Archipelago of City-states, because when an individual city decays, it’s not a global catastrophe.
But Eliezer seems to think that we need a global regulatory agency for AI. It’s a plausible enough idea, but what happens when the agency falls into corruption like all the other crappy 3-letter agencies run by the US and the UN?
To be precise, Yudkowsky called for a wholesale ban of AI research, not for an international agency which could build it. What would a corrupt international anti-AI agency do, let some GPUs bypass its monitoring? But a rogue ASI-related project would require rogues to create the GPUs, use them to create the ASI and be aware that If Anyone Leaks It, Everyone Dies...
Not my motto! Though a tempting generalization of it. My motto is “only build a huge empire if you actually really tried very hard to not make it corrupt and you are actually really pretty sure that in-expectation your empire will bend the future more towards goodness and justice than what it replaced”.
See also my controversial follow-up post: Let goodness conquer all that it can defend.