“Security” for me has the connotation of being explicitely in relation to malicious adversaries
But, like, in my view the main issue with advanced AI capabilities is that they come with an adversary built-in. This does make it fundamentally different from protecting against an external adversary, but I think the change is smaller than, say, the change from “preventing people from falling off the boat.” Like, the issue isn’t that the boat deck is going to be wet, or the sea will be stormy, or stuff like that; the issue is that the boat is thinking!
But, like, in my view the main issue with advanced AI capabilities is that they come with an adversary built-in. This does make it fundamentally different from protecting against an external adversary, but I think the change is smaller than, say, the change from “preventing people from falling off the boat.” Like, the issue isn’t that the boat deck is going to be wet, or the sea will be stormy, or stuff like that; the issue is that the boat is thinking!