I’m also lightly surprised by the strength of the relationship, but not because of the convolutional layers. It seems like if “convolutional layers apply the same filter everywhere” makes me surprised by the cheese-distance influence, it should also make me be surprised by “the mouse behaves differently in a dead-end versus a long corridor” or “the mouse tends to go to the top-right.”
(I have some sense of “maybe I’m not grappling with Vivek’s reasons for being surprised”, so feel free to tell me if so!)
I’m also lightly surprised by the strength of the relationship, but not because of the convolutional layers. It seems like if “convolutional layers apply the same filter everywhere” makes me surprised by the cheese-distance influence, it should also make me be surprised by “the mouse behaves differently in a dead-end versus a long corridor” or “the mouse tends to go to the top-right.”
(I have some sense of “maybe I’m not grappling with Vivek’s reasons for being surprised”, so feel free to tell me if so!)