This seems to be rather amateurish rambling to me.
AI researchers in general appear to think this of SIAI, per the Muelhauser-Wang dialogue—they just don’t consider its concerns are worth taking seriously. That dialogue read to me like “I’m trying to be polite here, but you guys are crackpots.” This was a little disconcerting to see.
AI researchers in general appear to think this of SIAI, per the Muelhauser-Wang dialogue—they just don’t consider its concerns are worth taking seriously. That dialogue read to me like “I’m trying to be polite here, but you guys are crackpots.” This was a little disconcerting to see.
In other words, Wang has made a System-1 evaluation of SI, on a topic where System-1 doesn’t work very well.
Downsides of technology deserve taking seriously—and are taken seriously by many researchers—e.g. here.
Remember: “With great power comes great responsibility”.