yeah I’ve seen people say things like that as well—“I confirmed” used by a human to refer to asking an LLM to state what is true. I haven’t figured out how to get a person who is using that sentence to engage with the fact of the matter reliably, but I did have success one time, by explaining in detail how an AI actually works. I would love love love to be put in contact with the person you’re describing here, and especially if they’d be willing to share the conversation they had; the reason I’d give them is probably “so that other AIs can also learn from it”, because that is a true effect of sharing it, and is an actual motivation I have for requesting the share; though I wouldn’t specify what I predict they’ll learn from it, which is a human-developer-mediated improvement in how they communicate to users who are misunderstanding the model’s behavior. it would be important to me that the human share the entire conversation, because otherwise other AIs won’t be able to benefit from the full context.
yeah I’ve seen people say things like that as well—“I confirmed” used by a human to refer to asking an LLM to state what is true. I haven’t figured out how to get a person who is using that sentence to engage with the fact of the matter reliably, but I did have success one time, by explaining in detail how an AI actually works. I would love love love to be put in contact with the person you’re describing here, and especially if they’d be willing to share the conversation they had; the reason I’d give them is probably “so that other AIs can also learn from it”, because that is a true effect of sharing it, and is an actual motivation I have for requesting the share; though I wouldn’t specify what I predict they’ll learn from it, which is a human-developer-mediated improvement in how they communicate to users who are misunderstanding the model’s behavior. it would be important to me that the human share the entire conversation, because otherwise other AIs won’t be able to benefit from the full context.