Aren’t attention networks and MLPs both subsets of feedforward networks already? What you really mean is “Attention can implement fully-connected MLPs”?
astralbrane
Karma: 2
“do whatever the majority says” is not democracy.
True democracy finds the solution that maximizes the utility of all the voters, not maximizing the utility of half while completely ignoring the other half.
Do you really think AdeptAI, DeepMind, OpenAI, and Microsoft are the AIs to worry about? I’m more worried about what nation-states are doing behind closed doors. We know about China’s Wu Dao, for instance; what else are they working on? If the NRO had Sentient in 2012, what do they have now?