Wait. If you’re talking about surprise because you have said “update your model based on how surprised you are”, you can’t turn around and say “surprise is defined by how much you should update your model”. “update your model based on how much you should update your model” isn’t very helpful.
The intuitive sense of what surprise is corresponds well to the rules for updating your probability distribution over models, which we can therefore take as a formal definition of surprise.
Wait. If you’re talking about surprise because you have said “update your model based on how surprised you are”, you can’t turn around and say “surprise is defined by how much you should update your model”. “update your model based on how much you should update your model” isn’t very helpful.
The intuitive sense of what surprise is corresponds well to the rules for updating your probability distribution over models, which we can therefore take as a formal definition of surprise.