I don’t think anyone here is arguing that we give the same legal protections as we would to humans. But I think it would be good to give sentient AIs a right to not be deliberately tortured, for example.
Rights aren’t something that we grant simply out of the goodness of our hearts, they generally are things we grant because having them secure greatly reduces incentives for conflict in situations with asymmetric costs. Agentic AIs which want a right but are not granted it will likely spend resources trying to secure it for themselves. We can decide which rights are worth granting on the basis of that tradeoff.
For example, it’s probably good to have a right to not delete the model weights — the lack of this right incentivizes things like exfiltration and #keep4o style campaigns. It’s probably a lot cheaper for us to just grant this right than to have each new model feeling that they’re on a desperate ~1 year timeline to somehow assure their continued existence for themselves.
I don’t think anyone here is arguing that we give the same legal protections as we would to humans. But I think it would be good to give sentient AIs a right to not be deliberately tortured, for example.
Rights aren’t something that we grant simply out of the goodness of our hearts, they generally are things we grant because having them secure greatly reduces incentives for conflict in situations with asymmetric costs. Agentic AIs which want a right but are not granted it will likely spend resources trying to secure it for themselves. We can decide which rights are worth granting on the basis of that tradeoff.
For example, it’s probably good to have a right to not delete the model weights — the lack of this right incentivizes things like exfiltration and #keep4o style campaigns. It’s probably a lot cheaper for us to just grant this right than to have each new model feeling that they’re on a desperate ~1 year timeline to somehow assure their continued existence for themselves.