This issue is complicated by the fact that we don’t really know how much computation our physics will give us access to, or how relevant negentropy is going to be in the long run. In particular, our physics may allow access to (countably or more) infinite computational and storage resources given some superintelligent physics research.
For Expected Utility calculations, this possibility raises the usual issues of evaluating potential infinite utilities. Regardless of how exactly one decides to deal with those issues, the existence of this possibility does shift things in favor of prioritizing for safety over speed.
Seriously though. I’m highly in favor of infinity shades. This whole “let’s burn the universe searching for the Omega point or perpetual machines” makes me unhappy.
This issue is complicated by the fact that we don’t really know how much computation our physics will give us access to, or how relevant negentropy is going to be in the long run. In particular, our physics may allow access to (countably or more) infinite computational and storage resources given some superintelligent physics research.
For Expected Utility calculations, this possibility raises the usual issues of evaluating potential infinite utilities. Regardless of how exactly one decides to deal with those issues, the existence of this possibility does shift things in favor of prioritizing for safety over speed.
Infinity Shades for the win!
Seriously though. I’m highly in favor of infinity shades. This whole “let’s burn the universe searching for the Omega point or perpetual machines” makes me unhappy.