Chaotic in a sense that small changes in weights can produce large difference in behavior at least in some conditions, which is the thing we are wary of.
do we have evidence that this is true?
I think we have plenty of suggestive evidence, like existence of super weights?
More evidence here as well: nondeterminism, STEVE-1 nondeterminism.
Chaotic in a sense that small changes in weights can produce large difference in behavior at least in some conditions, which is the thing we are wary of.
do we have evidence that this is true?
I think we have plenty of suggestive evidence, like existence of super weights?
More evidence here as well: nondeterminism, STEVE-1 nondeterminism.