OTOH, it can look at the humans, hear us constantly say this is a thing we value that we don’t know how to directly impart to it, and thereby know without understanding that it is important. IF that works out far better than I’d expect, it may actually be a way to ensure an unconscious ASI keeps us around and doesn’t disempower us.
Definitely agreed.
OTOH, it can look at the humans, hear us constantly say this is a thing we value that we don’t know how to directly impart to it, and thereby know without understanding that it is important. IF that works out far better than I’d expect, it may actually be a way to ensure an unconscious ASI keeps us around and doesn’t disempower us.