I too expect that testing whether someone can talk as if they’ve absorbed the sequences would measure password-guessing more accurately than comprehension.
I think the test could end up working as an ideology measure rather than a password-guessing game.
The idea gets me wondering whether it’s possible to design a game that’s easy to learn and win using the skills taught by the sequences, but difficult or impossible without them. Since the sequences teach a skill, it seems like we should be able to procedurally generate novel challenges that the skill makes it easy to complete.
It’s tricky to me, because the Sequences teach a network of ideas that are often not directly applicable to problem-solving/production tasks, but rather relevant for analyzing or explaining ideas. It’s hard to really evaluate an analysis/explanation without considering its downstream applications, but also it’s hard to come up with a task that is simultaneously:
Big enough that it has both analysis/explanation and downstream applications,
Small enough that it can be done quickly as a single person filling out a test.
I think the test could end up working as an ideology measure rather than a password-guessing game.
It’s tricky to me, because the Sequences teach a network of ideas that are often not directly applicable to problem-solving/production tasks, but rather relevant for analyzing or explaining ideas. It’s hard to really evaluate an analysis/explanation without considering its downstream applications, but also it’s hard to come up with a task that is simultaneously:
Big enough that it has both analysis/explanation and downstream applications,
Small enough that it can be done quickly as a single person filling out a test.