I think your comment highlights an important uncertainty of mine. Here’s my best guess:
I think planning involves world-model invocations (ie the predictive machinery which predicts relevant observables for plan stubs, like “get in my car”). It seems to me that there is subconscious planning, to some degree. If true, you wouldn’t notice the world-model being invoked because it’s sub-conscious. Insofar as “you” are in part composed of some set of shards or some algorithm which aggregates shard outputs, it’s therefore true that the world-model invocations aren’t globally visible. Therefore, it’s possible for certain kinds of WM invocations to not be visible to certain shards, even though those shards usually “hook into the WM” (eg check # of diamonds the plan leads to).
Separately, I’d guess that shards can be shaped to invoke the world model (e.g. “if this plan gets considered, will it be executed?”) without themselves being agents.
I think your comment highlights an important uncertainty of mine. Here’s my best guess:
I think planning involves world-model invocations (ie the predictive machinery which predicts relevant observables for plan stubs, like “get in my car”). It seems to me that there is subconscious planning, to some degree. If true, you wouldn’t notice the world-model being invoked because it’s sub-conscious. Insofar as “you” are in part composed of some set of shards or some algorithm which aggregates shard outputs, it’s therefore true that the world-model invocations aren’t globally visible. Therefore, it’s possible for certain kinds of WM invocations to not be visible to certain shards, even though those shards usually “hook into the WM” (eg check # of diamonds the plan leads to).
Separately, I’d guess that shards can be shaped to invoke the world model (e.g. “if this plan gets considered, will it be executed?”) without themselves being agents.