I think “AI is software” that has “bugs” is dangerously misleading—it incorrectly implies that we know what we want AI to do, and just need to be a little more careful about how we program it. But in reality, today’s AIs are not programmed, but instead semi-randomly chosen by a process that we do not fully understand and are not fully in control of. I think it’s the latter part that need to be emphasized—we are not in control, and we do not know how to regain control of something that keeps getting further and further away from us, and a runaway crash is the only possible outcome of the current trajectory we are on.
In addition to being misleading, this just makes AI one more (small) facet of security. But security is broadly underinvested in and there is limited government pushback. In addition, there is already a security community which prioritizes other issues and thinks differently. So this would place AI in the wrong metaphorical box.
While I’m not a fan of the proposed solution I do want to note that its good that people are beginning to look at the problem.
I think “AI is software” that has “bugs” is dangerously misleading—it incorrectly implies that we know what we want AI to do, and just need to be a little more careful about how we program it. But in reality, today’s AIs are not programmed, but instead semi-randomly chosen by a process that we do not fully understand and are not fully in control of. I think it’s the latter part that need to be emphasized—we are not in control, and we do not know how to regain control of something that keeps getting further and further away from us, and a runaway crash is the only possible outcome of the current trajectory we are on.
In addition to being misleading, this just makes AI one more (small) facet of security. But security is broadly underinvested in and there is limited government pushback. In addition, there is already a security community which prioritizes other issues and thinks differently. So this would place AI in the wrong metaphorical box.
While I’m not a fan of the proposed solution I do want to note that its good that people are beginning to look at the problem.