I have 115 confirmed cases (incl. non-delusional ones), and estimate about 2000 − 10,000 cases total
Since that includes non-delusional ones, what portion of cases would you say are actually harmful?
1. This is a pretty serious alignment failure, and is maybe weird × prevalent enough to help coordinate action.
I notice that the current ratio is actually significantly better than actual humans (the national homicide rate in the U.S. was approximately 7.1 deaths per 100,000 people)
Is there a reason to view this as an actual alignment failure, rather than merely mistakes made by an emergent and known-unreliable technology?
Obviously, if it is mis-alignment, that suggests the problem scales. But if it’s mistakes and unfamiliarity, then the problem actually drops off as technology improves.
2. If we’ve truly created independently agentic beings that are claiming to be sentient, I feel that we have a certain amount of responsibility for their well-being.
Since that includes non-delusional ones, what portion of cases would you say are actually harmful?
I notice that the current ratio is actually significantly better than actual humans (the national homicide rate in the U.S. was approximately 7.1 deaths per 100,000 people)
Is there a reason to view this as an actual alignment failure, rather than merely mistakes made by an emergent and known-unreliable technology?
Is there any particular reason to think this isn’t just human error, the way numerous previous technologies have been blamed for deaths? (see again the Astral Codex Ten article: https://www.astralcodexten.com/p/in-search-of-ai-psychosis)
Obviously, if it is mis-alignment, that suggests the problem scales. But if it’s mistakes and unfamiliarity, then the problem actually drops off as technology improves.
I probably need to write up a more direct post on this topic, but is there any particular reason to believe that “consciousness” implies a capacity for suffering / well-being? (I wrote a bit about this in https://www.lesswrong.com/posts/eaFDFpDehtEY6Jqwk/meditations-on-margarine)