Yes, that was my first reaction also, if only because it’s possible to attack that premise without reference to tricky AI mumbo-jumbo. It would be mildly clever but rather misleading to apply the reversal test: “You think a superintelligence will tend towards superbenevolence, but allegedly-benevolent humans are doing so little to create the aforementioned superintelligence;—humans apparently aren’t as benevolent as they seem, so why think a superhuman intelligence will be disanalogously benevolent? Contradiction, sucka!” This argument is of course fallacious because humans spend more on AGI development than do frogs—the great chain of being argument holds.
Yes, that was my first reaction also, if only because it’s possible to attack that premise without reference to tricky AI mumbo-jumbo. It would be mildly clever but rather misleading to apply the reversal test: “You think a superintelligence will tend towards superbenevolence, but allegedly-benevolent humans are doing so little to create the aforementioned superintelligence;—humans apparently aren’t as benevolent as they seem, so why think a superhuman intelligence will be disanalogously benevolent? Contradiction, sucka!” This argument is of course fallacious because humans spend more on AGI development than do frogs—the great chain of being argument holds.