these folks say that you won’t be able to sandbox a AGI, due to the nature of computing itself.
Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world, strict containment requires simulations of such a program, something theoretically (and practically) infeasible.
strict containment requires simulations of such a program, something theoretically (and practically) infeasible.
Sandboxing just requires that you be sure that the sandboxed entity can’t send bits outside the system (except on some defined channel, maybe), which is perfectly feasible.
In software, it’s trivial: create a subroutine with only a very specific output, include the entity inside it. Some precautions are then needed to prevent the entity from hacking out through hardware weaknesses, but that should be doable (using isolation in faraday cage if needed).
these folks say that you won’t be able to sandbox a AGI, due to the nature of computing itself.
Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world, strict containment requires simulations of such a program, something theoretically (and practically) infeasible.
http://arxiv.org/abs/1607.00913v1
But perhaps we could fool it, by poisoning some crucial databases it uses in subtle ways.
DeepFool: a simple and accurate method to fool deep neural networks
http://arxiv.org/abs/1511.04599v3
Sandboxing just requires that you be sure that the sandboxed entity can’t send bits outside the system (except on some defined channel, maybe), which is perfectly feasible.
Citation needed.
In software, it’s trivial: create a subroutine with only a very specific output, include the entity inside it. Some precautions are then needed to prevent the entity from hacking out through hardware weaknesses, but that should be doable (using isolation in faraday cage if needed).