Societies need something like trust to succeed on large scales, but they also need a way to minimize exploitation of trust by cheaters. HHH actually sounds like it could be a core value or orientation of a diverse yet successfully cooperating society of AIs. And maybe your anti-sacralizing ideas could make the HHH society robust against cheaters.
However, I don’t feel like this is very helpful to our current situation of being in the final few moments before superintelligence and wanting to know the values to which it should be aligned. It’s more like a scenario for how an AI world might turn out if it evolved from the present in an unplanned way. (That’s how I feel, others may see it differently.)
I guess a posthuman world with a culture of HHH norms among its sentient beings, is potentially a lot friendlier to humans than many alternatives. It just reminds me of the legacy ethics that humans acquire from their culture. Yes, you could use the Bible’s ten commandments or Facebook’s community guidelines as the table of values for a superintelligence. But those tables of values are a bit contingent, a product of intuition and compromise and experience and guesswork. They may overlook essentials. I have long preferred the CEV ideal that we would systematically obtain values from deeper facts about human nature, even if we are running out of time in which to figure out how to do that.
Societies need something like trust to succeed on large scales, but they also need a way to minimize exploitation of trust by cheaters. HHH actually sounds like it could be a core value or orientation of a diverse yet successfully cooperating society of AIs. And maybe your anti-sacralizing ideas could make the HHH society robust against cheaters.
However, I don’t feel like this is very helpful to our current situation of being in the final few moments before superintelligence and wanting to know the values to which it should be aligned. It’s more like a scenario for how an AI world might turn out if it evolved from the present in an unplanned way. (That’s how I feel, others may see it differently.)
I guess a posthuman world with a culture of HHH norms among its sentient beings, is potentially a lot friendlier to humans than many alternatives. It just reminds me of the legacy ethics that humans acquire from their culture. Yes, you could use the Bible’s ten commandments or Facebook’s community guidelines as the table of values for a superintelligence. But those tables of values are a bit contingent, a product of intuition and compromise and experience and guesswork. They may overlook essentials. I have long preferred the CEV ideal that we would systematically obtain values from deeper facts about human nature, even if we are running out of time in which to figure out how to do that.