This feels related to Hanson’s recent article: https://www.overcomingbias.com/2021/04/to-beat-aliens-we-must-become-aliens.html
Which mentions that the greatest threat to successor ages are preceding ages that don’t like the prospect of ‘alienation’.
Some of the arguments mentioned here against technology point in that same direction.
I really love this topic of self-modeling/perception/phenomenology and what it means for rationality. I’m probably going to have to re-read your posts to better understand all the details.
I’m only surprised you haven’t mentioned Steven Lehar’s work yet, especially his cartoon epistemology which really made the homunculus and other aspects of our indirect perception of the universe clear to me, with wonderfully detailed drawings. I think those could help people get an even better sense of what you are talking about.