Maybe instead of talking about AI having ‘goals’ or ‘drives,’ which sound biological, it would be helpful to use a more mechanical-sounding term, like a ‘target state,’ or ‘termination conditions,’ or ‘prioritization heuristics’?
A surprising number of people seem to bounce off the idea of ‘AI being dangerous’ once they encounter anything that feels like anthropomorphism.
My suggestions above are all kind of clunky (and ‘termination conditions’ has an unfortunate collision with The Terminator). But I think the spirit is correct of ‘we should find ways to describe AI’s behavioral tendencies with as little anthropomorphizing as possible’?
Yeah I agree that works and feel slightly sheepish not to have already internalized that as the term to use?
I guess there’s still some distinction between an objective as a single thing, vs drives as, like, heuristics that will tend to contribute toward shaping the overall objective? I’m not sure, still feel a bit fuzzy and should probably sit with it more
Maybe instead of talking about AI having ‘goals’ or ‘drives,’ which sound biological, it would be helpful to use a more mechanical-sounding term, like a ‘target state,’ or ‘termination conditions,’ or ‘prioritization heuristics’?
A surprising number of people seem to bounce off the idea of ‘AI being dangerous’ once they encounter anything that feels like anthropomorphism.
My suggestions above are all kind of clunky (and ‘termination conditions’ has an unfortunate collision with The Terminator). But I think the spirit is correct of ‘we should find ways to describe AI’s behavioral tendencies with as little anthropomorphizing as possible’?
objective seems sufficiently unanthropomorphic
Yeah I agree that works and feel slightly sheepish not to have already internalized that as the term to use?
I guess there’s still some distinction between an objective as a single thing, vs drives as, like, heuristics that will tend to contribute toward shaping the overall objective? I’m not sure, still feel a bit fuzzy and should probably sit with it more