Utopia: The human utility function is worked out by an FAI. Maximal Fun for everyone results.
Dystopia: The human utility function is worked out by a malicious uFAI. Maximal unFun results.
Weirdtopia: Maximal Fun turns out to be the experience of changing utility functions. People have fun by exploring new and strange utilities… from the inside. FAI sets time limits on the state of new utility functions to change people back even if they afterwards don’t want to. Time limits are based on the average length required to explore the possibilities of the new utility function.
Common initial examples include “love: time limit 3 years” and “orgasmium: time limit 1 minute”.
Utopia: The human utility function is worked out by an FAI. Maximal Fun for everyone results.
Dystopia: The human utility function is worked out by a malicious uFAI. Maximal unFun results.
Weirdtopia: Maximal Fun turns out to be the experience of changing utility functions. People have fun by exploring new and strange utilities… from the inside. FAI sets time limits on the state of new utility functions to change people back even if they afterwards don’t want to. Time limits are based on the average length required to explore the possibilities of the new utility function.
Common initial examples include “love: time limit 3 years” and “orgasmium: time limit 1 minute”.