Neat. You can try to ask it for confidence interval and it’ll probably correlate against the hallucinations. Another idea is run it against the top 1000 articles and see how accurate they are. I can’t really guess back-of-envelope for if it’s cost effective to run this over all of wiki per-article.
Also I kind of just want this on reddit and stuff. I’m more concerned about casually ingested fake news than errors in high quality articles when it comes to propaganda/disinfo.
Neat. You can try to ask it for confidence interval and it’ll probably correlate against the hallucinations. Another idea is run it against the top 1000 articles and see how accurate they are. I can’t really guess back-of-envelope for if it’s cost effective to run this over all of wiki per-article.
Also I kind of just want this on reddit and stuff. I’m more concerned about casually ingested fake news than errors in high quality articles when it comes to propaganda/disinfo.