I agree with “If future contains high tech, underregulated compute and diverse individuals, then it’s likely it will contain incredibly high amounts of most horrendous torture / suffering / despair / abuse.”, but think this mechanism probably causes a small fraction of the expected suffering in the future.
I’m also very skeptical that this suffering (as in, just the suffering due to the mechanism you describe) flips the sign on the future if we assume some non-extreme tradeoff ratio between optimized suffering and optimized goodness (or fun or whatever you want to call this) given the relatively small scale of this type of suffering.
I agree that abstract proposals for distributing and governing the future should allow for prohibitions on extreme torture (including torture of digital minds), and I hope that these governance mechanisms will vote/decide to ban extreme torture.
I agree with “If future contains high tech, underregulated compute and diverse individuals, then it’s likely it will contain incredibly high amounts of most horrendous torture / suffering / despair / abuse.”, but think this mechanism probably causes a small fraction of the expected suffering in the future.
I’m also very skeptical that this suffering (as in, just the suffering due to the mechanism you describe) flips the sign on the future if we assume some non-extreme tradeoff ratio between optimized suffering and optimized goodness (or fun or whatever you want to call this) given the relatively small scale of this type of suffering.
I agree that abstract proposals for distributing and governing the future should allow for prohibitions on extreme torture (including torture of digital minds), and I hope that these governance mechanisms will vote/decide to ban extreme torture.