FYI, this is not what the word “corrigibility” means in this context. (Or, at least, it’s not how we at MIRI have been using it, and it’s not how Stuart Russell has been using it, and it’s not a usage that I, as one of the people who originally brought that word into the AI alignment space, endorse.) We use the phrase “utility indifference” to refer to what you’re calling “corrigibility”, and we use the word “corrigibility” for the broad vague problem that “utility indifference” was but one attempt to solve.
By analogy, imagine people groping around in the dark attempting to develop probability theory. They might call the whole topic the topic of “managing uncertainty,” and they might call specific attempts things like “fuzzy logic” or “multi-valued logic” before eventually settling on something that seems to work pretty well (which happened to be an attempt called “probability theory.”) We’re currently reserving the “corrigibilty” word for the analog of “managing uncertainty”; that is, we use the “corrigibility” label to refer to the highly general problem of developing AI algorithms that cause a system to (in an intuitive sense) reason without incentives to deceive/manipulate, and to reason (vaguely) as if it’s still under construction and potentially dangerous :-)
FYI, this is not what the word “corrigibility” means in this context. (Or, at least, it’s not how we at MIRI have been using it, and it’s not how Stuart Russell has been using it, and it’s not a usage that I, as one of the people who originally brought that word into the AI alignment space, endorse.) We use the phrase “utility indifference” to refer to what you’re calling “corrigibility”, and we use the word “corrigibility” for the broad vague problem that “utility indifference” was but one attempt to solve.
By analogy, imagine people groping around in the dark attempting to develop probability theory. They might call the whole topic the topic of “managing uncertainty,” and they might call specific attempts things like “fuzzy logic” or “multi-valued logic” before eventually settling on something that seems to work pretty well (which happened to be an attempt called “probability theory.”) We’re currently reserving the “corrigibilty” word for the analog of “managing uncertainty”; that is, we use the “corrigibility” label to refer to the highly general problem of developing AI algorithms that cause a system to (in an intuitive sense) reason without incentives to deceive/manipulate, and to reason (vaguely) as if it’s still under construction and potentially dangerous :-)
Good to know. I should probably move to your usage, as it’s more prevalent.
Will still use words like “corrigible” to refer to certain types of agents, though, since that makes sense for both definitions.