It’s the best possible kind of answer to my question—a link to a load of interesting stuff—thanks!
I see where I went wrong, in missing out the entire physical universe as a source of questions that can be clearly stated but are about real things rather than mathematical descriptions of them.
Can you even have a clearly defined problem in any field other than Mathematics, or one that doesn’t reduce to a mathematical problem regardless of the field where it originated?