Yeah, as usual journalism generalizes claims for both sensationalism and comprehensibility purposes. I tried to downplay it a bit with choice of words, but still ended up channeling the original writing.
The thing that I find interesting is that these semi-autonomous systems might run into issues of defining utility (this is particularly true for systems with some level of danger, autonomous cars/drones). It might be an area where people will start feeling a need for formalization that can lead to some academics getting into FAI territory (which is good I think).
Indeed; it’s definitely on topic and interesting work, and I expect that simple people-reading models like this will do tremendous amounts of good and make significant progress in parallel to the first-principles work that SI appears to be doing.
Yeah, as usual journalism generalizes claims for both sensationalism and comprehensibility purposes. I tried to downplay it a bit with choice of words, but still ended up channeling the original writing.
The thing that I find interesting is that these semi-autonomous systems might run into issues of defining utility (this is particularly true for systems with some level of danger, autonomous cars/drones). It might be an area where people will start feeling a need for formalization that can lead to some academics getting into FAI territory (which is good I think).
Indeed; it’s definitely on topic and interesting work, and I expect that simple people-reading models like this will do tremendous amounts of good and make significant progress in parallel to the first-principles work that SI appears to be doing.