Hey Buck, love the line of thinking. We definitely aren’t trying to say “any two ridges can be connected for any loss landscape” but rather that the ridges for overparameterised networks are connected.
Hey Buck, love the line of thinking.
We definitely aren’t trying to say “any two ridges can be connected for any loss landscape” but rather that the ridges for overparameterised networks are connected.