Learning through exercises

One of the best aspects of mathematics is that it is possible for a student to reconstruct much of it on their own, given the relevant axioms, definitions, and some hints. Indeed, this style of education is usually encouraged for training mathematicians. Relatedly, it is also possible for a mathematician to give a quick impression of the relevance of their particular field by choosing an example of an interesting problem which can be efficiently solved using the methods of that specific specialty of mathematics.

To what extent do other academic fields share this property? How well can physics, chemistry, biology, etc. be taught “through exercises”?

EDIT: Note that the “exercises” I am referring to are not just matters of applying learned principles for solving random problems but rather are devices to lead the student to “rediscover” important principles in the field.