People have predicted that corporations will be amoral, ruthless psychopaths too. This is what you get when you leave things like reputations out of your models.
Skimping on safety features can save you money. However, a reputation for privacy breaches, security problems and accidents doesn’t do you much good. Why model the first effect while ignoring the second one? Oh yes: the axe that needs grinding.
Reputational concerns apply to psychopaths too, and that’s why not all of them turn violent. However it doesn’t prevent all of them from turning violent.
The point I was trying to make was more along the lines that choosing which parameters to model allows you to control the outcome you get. Those who want to recruit people to causes associated with preventing the coming robot apocalypse can selectively include competitive factors, and ignore factors leading to cooperation—in order to obtain their desired outcome.
Today, machines are instrumental in killing lots of people, but many of them also have features like air bags and bumpers, which show that the manufacturers and their customers are interested in safety features—and not just retail costs. Skipping safety features has disadvantages—as well as advantages—to the manufacturers involved.
There are techniques for managing reputation, and those techniques are also amoral. For example, a powerful psychopath caring about his reputation may use legal threats and/or assassination against people who want to report about his evil acts. Alternatively, he may spread false rumors about his competitors. He may pay or manipulate people to create a positive image of him.
Just because the reputation is used, it does not guarantee the results will be moral.
A salient example is many cover-ups USSR was involved in, they even attempted to cover up Chernobyl (there was no internal news about it for 3 days, even though people were needlessly exposed to radiation)
People have predicted that corporations will be amoral, ruthless psychopaths too. This is what you get when you leave things like reputations out of your models.
Skimping on safety features can save you money. However, a reputation for privacy breaches, security problems and accidents doesn’t do you much good. Why model the first effect while ignoring the second one? Oh yes: the axe that needs grinding.
Reputational concerns apply to psychopaths too, and that’s why not all of them turn violent. However it doesn’t prevent all of them from turning violent.
The point I was trying to make was more along the lines that choosing which parameters to model allows you to control the outcome you get. Those who want to recruit people to causes associated with preventing the coming robot apocalypse can selectively include competitive factors, and ignore factors leading to cooperation—in order to obtain their desired outcome.
Today, machines are instrumental in killing lots of people, but many of them also have features like air bags and bumpers, which show that the manufacturers and their customers are interested in safety features—and not just retail costs. Skipping safety features has disadvantages—as well as advantages—to the manufacturers involved.
There are techniques for managing reputation, and those techniques are also amoral. For example, a powerful psychopath caring about his reputation may use legal threats and/or assassination against people who want to report about his evil acts. Alternatively, he may spread false rumors about his competitors. He may pay or manipulate people to create a positive image of him.
Just because the reputation is used, it does not guarantee the results will be moral.
A salient example is many cover-ups USSR was involved in, they even attempted to cover up Chernobyl (there was no internal news about it for 3 days, even though people were needlessly exposed to radiation)