As for the idea of competing AIs, if they can modify each other’s code, what’s to keep one from just deleting the other?
Or, for that matter, from modifying the other AI to change its values and goals in how the other AI modifies itself? Indirect self-modification?
This problem seems rather harder than directly implementing a FAI.
Or, for that matter, from modifying the other AI to change its values and goals in how the other AI modifies itself? Indirect self-modification?
This problem seems rather harder than directly implementing a FAI.