@ Venu: Modern AI efforts are so far from human-level competence, that Friendly vs. Unfriendly doesn’t really matter yet. Eliezer is concerned about having a Friendly foundation for the coming Singularity, which starts with human-level AIs. A fairly stupid program (compared to humans) that merely drives a car, just doesn’t have the power to be a risk in the sense that Eliezer worries about.
@ Venu: Modern AI efforts are so far from human-level competence, that Friendly vs. Unfriendly doesn’t really matter yet. Eliezer is concerned about having a Friendly foundation for the coming Singularity, which starts with human-level AIs. A fairly stupid program (compared to humans) that merely drives a car, just doesn’t have the power to be a risk in the sense that Eliezer worries about.
It could still kill people if it’s not programmed correctly.
This seems like a good reason to understand the program well.