Ok, they both tree search over a space, whether it is the space of strategies or the space of programs. That does make sense.
I think my initial reaction to SI was very negative—even without the halting problem, simply testing every program of length<n is crazy. By comparison, I could imagine some kind of tree search, possibly weighted by heuristics, to be efficient.
I think my initial reaction to SI was very negative—even without the halting problem, simply testing every program of length<n is crazy.
It’s crazy, but some universes are crazy. Pity the poor AI who wakes up inside a simulation where the programmer is in fact testing it on every program of length <n!
Ok, they both tree search over a space, whether it is the space of strategies or the space of programs. That does make sense.
I think my initial reaction to SI was very negative—even without the halting problem, simply testing every program of length<n is crazy. By comparison, I could imagine some kind of tree search, possibly weighted by heuristics, to be efficient.
It’s crazy, but some universes are crazy. Pity the poor AI who wakes up inside a simulation where the programmer is in fact testing it on every program of length <n!
We could be in a simulation where the programmer is in fact testing it on every program of length <n! Doesn’t seem so bad.