Slightly off-topic but Wow! this is material for an awesome RTS video-game! That would be so cool!
And a bit more on topic: that kind of video game would give the broader public a good idea of what’s coming, and researchers and leaders a way to vividly explore various scenario, all while having fun.
Imagine playing the role of an unaligned AGI, and noticing that the game dynamics push you to deceive humans to gain more compute and capabilities until you can take over or something, all because that’s the fastest way to maximize your utility function!
Slightly off-topic but Wow! this is material for an awesome RTS video-game! That would be so cool!
And a bit more on topic: that kind of video game would give the broader public a good idea of what’s coming, and researchers and leaders a way to vividly explore various scenario, all while having fun.
Imagine playing the role of an unaligned AGI, and noticing that the game dynamics push you to deceive humans to gain more compute and capabilities until you can take over or something, all because that’s the fastest way to maximize your utility function!