To me the problem of embedded agency isn’t about fitting a large description of the world into a small part of the world. That’s easy with quining, which is mentioned in the MIRI writeup. The problem is more about the weird consequences of learning about something that contains the learner.
Also, I love your wording that the problem has many faucets. Please don’t edit it out :-)
To me the problem of embedded agency isn’t about fitting a large description of the world into a small part of the world. That’s easy with quining, which is mentioned in the MIRI writeup. The problem is more about the weird consequences of learning about something that contains the learner.
Also, I love your wording that the problem has many faucets. Please don’t edit it out :-)
haha, oops.