Since when has provability been considered a necessary condition for decision making? For instance, before you posted your comment, did you prove that your comment would show up on the discussion board, or did you just find it likely enough to justify the effort?
Surely if you provably know what the ideal FAI would do in many situations, a giant step forward has been made in FAI theory?
Keeping the tone positive and conducive for discussion...It’s not at all clear to me what a representative friendly AI would do in any situation.
Since when has provability been considered a necessary condition for decision making? For instance, before you posted your comment, did you prove that your comment would show up on the discussion board, or did you just find it likely enough to justify the effort?
Do you not know what the word “heuristic” means?