I have never understood why Eliezer has kept his tactics secret. This seems to me the most interesting aspect of the experiment. Is the idea that the methodology is “dangerous knowledge” which should not be shared? Objection: dangerous to whom? Surely super-intelligent AIs will not need our help! Humanity, it seems, should benefit from learning the tricks an unfriendly AI might use to deceive us.
I have never understood why Eliezer has kept his tactics secret. This seems to me the most interesting aspect of the experiment. Is the idea that the methodology is “dangerous knowledge” which should not be shared? Objection: dangerous to whom? Surely super-intelligent AIs will not need our help! Humanity, it seems, should benefit from learning the tricks an unfriendly AI might use to deceive us.