It will also have models of every possible universe, and also an understanding of its own mathematical structure. To make a decision given a certain input, it will scan each universe model for structures that will be logically dependent on its output. It will then predict what will happen in each universe for each particular output. Then, it will choose the output that maximizes its preferences.
Apologies if this is a stupid question—I am not an expert—but how do we know what “level of reality” to have our UDT-agent model its world-models with? That is, if we program the agent to produce and scan universe-models consisting of unsliced representations of quark and lepton configurations, what happens if we discover that quarks and leptons are composed of more elementary particles yet?
Wei Dai has suggested that the default setting for a decision theory be Tegmark’s Level 4 Multiverse—where all mathematical structures exist in reality. So a “quark—lepton” universe and a string theory universe would both be considered among the possible universes—assuming they are consistent mathematically.
Of course, this makes it difficult to specify the utility function.
Apologies if this is a stupid question—I am not an expert—but how do we know what “level of reality” to have our UDT-agent model its world-models with? That is, if we program the agent to produce and scan universe-models consisting of unsliced representations of quark and lepton configurations, what happens if we discover that quarks and leptons are composed of more elementary particles yet?
Wei Dai has suggested that the default setting for a decision theory be Tegmark’s Level 4 Multiverse—where all mathematical structures exist in reality. So a “quark—lepton” universe and a string theory universe would both be considered among the possible universes—assuming they are consistent mathematically.
Of course, this makes it difficult to specify the utility function.