How do we know that the “prediction extractor” component doesn’t do additional serious computation, so that it knows something important that the “figure out what’s going on” module doesn’t know? If that were true, the AI as a whole could know the diamond was stolen, without the “figure out what’s going on” module knowing, which means even the direct translator wouldn’t know, either. Are we just not giving the extractor that many parameters?
How do we know that the “prediction extractor” component doesn’t do additional serious computation, so that it knows something important that the “figure out what’s going on” module doesn’t know? If that were true, the AI as a whole could know the diamond was stolen, without the “figure out what’s going on” module knowing, which means even the direct translator wouldn’t know, either. Are we just not giving the extractor that many parameters?