At grave peril of strawmanning, a first order-approximation to SquirrelInHell’s meta-process (what I think of as the Self) is the only process in the brain with write access, the power of self-modification. All other brain processes are to treat the brain as a static algorithm and solve the world from there.
Let me clarify: I consider it the meta level when I think something like “what trajectory do I expect to have as a result of my whole brain continuing to function as it already tends to do, assuming I do nothing special with the output of the thought process which I’m using right now to simulate myself?”. This simulation obviously includes everyday self-modification which happens as a side-effect of acting (like the 10% shift you describe). The key question is, am I reflectively consistent? Do I endorse the most accurate simulation of myself that I can run?
The meta process is what happens when I want to make sure that I always remain reflectively consistent. Then I conjure up a special kind of self-modification which desires to remember to do itself, and to continue to hold on to enough power to always win. I aspire to make this meta process an automatic part of myself, so that my most accurate simulation of any of my future trajectories already automatically includes self-consistency.
Let me clarify: I consider it the meta level when I think something like “what trajectory do I expect to have as a result of my whole brain continuing to function as it already tends to do, assuming I do nothing special with the output of the thought process which I’m using right now to simulate myself?”. This simulation obviously includes everyday self-modification which happens as a side-effect of acting (like the 10% shift you describe). The key question is, am I reflectively consistent? Do I endorse the most accurate simulation of myself that I can run?
The meta process is what happens when I want to make sure that I always remain reflectively consistent. Then I conjure up a special kind of self-modification which desires to remember to do itself, and to continue to hold on to enough power to always win. I aspire to make this meta process an automatic part of myself, so that my most accurate simulation of any of my future trajectories already automatically includes self-consistency.
Also: enjoy your CFAR workshop! :)
Yea, I wanted to write that this is the next step in the pendulum rather than a rebuttal.