I don’t have any certitude, but I would say that the representation in the neural network is somehow compressed following a logic that emerges from the training. There is something holistic in the process. Maybe a little like the notion of general interest in Rousseau’s social contract, a combination of vectors.
But if you create as many different networks as humans, you rely on the confrontation of all these systems at the risk that some takeover, just like the dictators we often get in real life. Would it be better, I don’t know. One thing is certain, it would need more compute power, because the redundancy of networks would result in less global compression.
I don’t have any certitude, but I would say that the representation in the neural network is somehow compressed following a logic that emerges from the training. There is something holistic in the process. Maybe a little like the notion of general interest in Rousseau’s social contract, a combination of vectors.
But if you create as many different networks as humans, you rely on the confrontation of all these systems at the risk that some takeover, just like the dictators we often get in real life. Would it be better, I don’t know. One thing is certain, it would need more compute power, because the redundancy of networks would result in less global compression.