It’s kind of aside, but I think this about safety systems in general. Don’t give me a backup system to shut down the nuclear reactor if the water stops pumping; design it so the reaction depends on the water. Don’t give me great ways to dispose of a chemical that destroys your flesh if it touches you; don’t make the chemical to begin with. Don’t give me a super-strong set of policies to keep the function-gained virus in the lab; don’t make function-gained viruses. Wish they’d listened to that last one 3 years ago.
Admittedly it may be too late in a lot of ways. We can’t make it so if our civilization founders we can prevent mass starvation; not starving depends on modern farming. And we probably can’t make it so we can just pull the plug on AI if it starts going all Skynet: the companies or nations that don’t pull the plug may be able to bankrupt those that do. Sometimes survival of the fittest sucks.
It’s kind of aside, but I think this about safety systems in general. Don’t give me a backup system to shut down the nuclear reactor if the water stops pumping; design it so the reaction depends on the water. Don’t give me great ways to dispose of a chemical that destroys your flesh if it touches you; don’t make the chemical to begin with. Don’t give me a super-strong set of policies to keep the function-gained virus in the lab; don’t make function-gained viruses. Wish they’d listened to that last one 3 years ago.
Admittedly it may be too late in a lot of ways. We can’t make it so if our civilization founders we can prevent mass starvation; not starving depends on modern farming. And we probably can’t make it so we can just pull the plug on AI if it starts going all Skynet: the companies or nations that don’t pull the plug may be able to bankrupt those that do. Sometimes survival of the fittest sucks.