Why not just have a “my model of” thing in the model, so you can have both “this door” and “my model of” + “this door” = “my model of this door”? (Of course I’m assuming compositionality here, but whatever, I always assume compositionality. This is the same kind of thing as “Carol’s” + “door” = “Carol’s door”.) What am I missing? I didn’t use any quines. Seems too simple… :-P
The thing I’m interested in re “1st-person problem” is slightly different than that, I think, because your reply still assumes a passive model, I think, whereas I think we’re going to need an AGI that “does things”—even if it’s just “thinking thoughts”—for reasons discussed in section 7.2 here. So there would a bunch of 1st-person actions / decisions thrown into the mix.
The main issue with “my model of” + “this door” = “my model of this door”, taken literally, is that there’s no semantics. It’s the semantics which I expect to need something quine-like.
Adding actions is indeed a big step, and I still don’t know the best way to do that. Main strategies I’ve thought about are:
something predictive-processing-esque
keep the model itself passive, but include an agent with actions in the model itself, and then require correctness of the model-abstraction. (In other words, put an agent in the map, then require map-territory correspondence.)
Something thermodynamic-esque but not predictive processing. This one seems most promising long-term but also I’m still most confused about how to set it up.
The main issue with “my model of” + “this door” = “my model of this door”, taken literally, is that there’s no semantics. It’s the semantics which I expect to need something quine-like.
I think you’re saying that I’m proposing how to label everything but not describing what those things are or do. (Correct?) I guess I’d say we learn general rules to follow with the “my model of” piece-of-thought, and exceptions to those rules, and exceptions to the exceptions, etc. Like “the relation between my-model-of-X and my-model-of-Y is the same as the relation between X and Y” could be an imperfect rule with various exceptions. See my “Python code runs the same on Windows and Mac” example here.
Why not just have a “my model of” thing in the model, so you can have both “this door” and “my model of” + “this door” = “my model of this door”? (Of course I’m assuming compositionality here, but whatever, I always assume compositionality. This is the same kind of thing as “Carol’s” + “door” = “Carol’s door”.) What am I missing? I didn’t use any quines. Seems too simple… :-P
The thing I’m interested in re “1st-person problem” is slightly different than that, I think, because your reply still assumes a passive model, I think, whereas I think we’re going to need an AGI that “does things”—even if it’s just “thinking thoughts”—for reasons discussed in section 7.2 here. So there would a bunch of 1st-person actions / decisions thrown into the mix.
The main issue with “my model of” + “this door” = “my model of this door”, taken literally, is that there’s no semantics. It’s the semantics which I expect to need something quine-like.
Adding actions is indeed a big step, and I still don’t know the best way to do that. Main strategies I’ve thought about are:
something predictive-processing-esque
keep the model itself passive, but include an agent with actions in the model itself, and then require correctness of the model-abstraction. (In other words, put an agent in the map, then require map-territory correspondence.)
Something thermodynamic-esque but not predictive processing. This one seems most promising long-term but also I’m still most confused about how to set it up.
I think you’re saying that I’m proposing how to label everything but not describing what those things are or do. (Correct?) I guess I’d say we learn general rules to follow with the “my model of” piece-of-thought, and exceptions to those rules, and exceptions to the exceptions, etc. Like “the relation between my-model-of-X and my-model-of-Y is the same as the relation between X and Y” could be an imperfect rule with various exceptions. See my “Python code runs the same on Windows and Mac” example here.