I think this is a philosophically important point that most people don’t have in mind when thinking about natural abstractions (nor I had seen addressed in John’s work): we have some vague intuition that an abstraction like pressure will always be useful, because of some fundamental statistical property of reality (non-dependent on the macrostates we are trying to track), and that’s not quite true.
As discussed, it’s unclear whether this philosophical point poses a pragmatic problem, or any hindrance to the realistic implementation of John’s agenda. My intuition is no, but this is a subtle question.
My intuition is that there will tend to be convergence, but I agree that this is uncertain. Thus, I also agree that convergence of natural abstractions is something we should seek to empirically measure across a varying population of created agents.
My intuition is that there will tend to be convergence, but I agree that this is uncertain. Thus, I also agree that convergence of natural abstractions is something we should seek to empirically measure across a varying population of created agents.