Interestingly, I read this as evidence in favour of a fast takeoff, because being able to explicitly sort through the traditions for which ones were valuable and which ones were not, seems something a decent AI could do much better than a human. If part of our knowledge and power is held in forms we don’t understand, we become vulnerable to entities who do understand it.
Interestingly, I read this as evidence in favour of a fast takeoff, because being able to explicitly sort through the traditions for which ones were valuable and which ones were not, seems something a decent AI could do much better than a human. If part of our knowledge and power is held in forms we don’t understand, we become vulnerable to entities who do understand it.