You know, to successfully build a PFAI (Pebblesorter-Friendly AI), the Pebblesorters would have to figure out a way to recursively enumerate the primes. That may not be quite as difficult as formalizing Friendliness (the human version), but it’s still probably pretty dang hard.
Makes you realize that trying to extrapolate even seemingly simplistic moralities can still result in problems of epic difficulty.
You know, to successfully build a PFAI (Pebblesorter-Friendly AI), the Pebblesorters would have to figure out a way to recursively enumerate the primes. That may not be quite as difficult as formalizing Friendliness (the human version), but it’s still probably pretty dang hard.
Makes you realize that trying to extrapolate even seemingly simplistic moralities can still result in problems of epic difficulty.