I wonder what insights are applicable to our situation. Are they the AGIs being as unimaginable to the commoner as the Holocaust to its victims? Or are they that various bureaucrats can, say, accidentally keep a memo on Agent-4′s misalignment secret from the ones who are supposed to make decisions on Agent-4′s fate? Or that politicians can manage to disempower mankind without it noticing?
I wonder what insights are applicable to our situation. Are they the AGIs being as unimaginable to the commoner as the Holocaust to its victims? Or are they that various bureaucrats can, say, accidentally keep a memo on Agent-4′s misalignment secret from the ones who are supposed to make decisions on Agent-4′s fate? Or that politicians can manage to disempower mankind without it noticing?