More generally, I wish that when people used the term “phase transition”, they clarified whether they meant “s-shaped loss curves” or some more precise notion. Often, people are making a non-mechanistic claim when they say “phase transition” (we observed a loss curve with a s-shape), but there are also mechanistic claims which require additional evidence.
In particular, when citing other work somewhere, it would be nice to clarify what notion of phase transition the other work is discussing.
More generally, I wish that when people used the term “phase transition”, they clarified whether they meant “s-shaped loss curves” or some more precise notion. Often, people are making a non-mechanistic claim when they say “phase transition” (we observed a loss curve with a s-shape), but there are also mechanistic claims which require additional evidence.
In particular, when citing other work somewhere, it would be nice to clarify what notion of phase transition the other work is discussing.