Yes, we can hold intellectuals to similar public standards as athletes. Using GPT-4/5 we could use it to create a set of questions to check if the intellectual can answer the questions correctly avoiding every kind of bias already explained here on LW. For each bias already explained before, we can create new questions that show when a human fall on them, assigning a new score to that human. I would like each human to write down all his knowledge with the help of an automatic writing system, we could create a visual tree of all knowledge the system detected the human acquired on the past, and evaluate how well he performs in answering questions about the fields he visited/he claims to know about. What’s the point of asking your credentials when I can evaluate your knowledge in real-time with GPT-n systems?
On the tree of knowledge we could see which humans score higher in which domains and why. What are the questions they can answer that others can’t. Don’t ask me my credentials, ask me a hard question/ give me a hard problem to solve and let’s see who solves it first or better. GPT-n could babble about the solution presented by different humans, and other group of humans that score high on these domains could also rate/evaluate the solutions by others, choosing the score they assign for each solution.
Yes, we can hold intellectuals to similar public standards as athletes. Using GPT-4/5 we could use it to create a set of questions to check if the intellectual can answer the questions correctly avoiding every kind of bias already explained here on LW. For each bias already explained before, we can create new questions that show when a human fall on them, assigning a new score to that human. I would like each human to write down all his knowledge with the help of an automatic writing system, we could create a visual tree of all knowledge the system detected the human acquired on the past, and evaluate how well he performs in answering questions about the fields he visited/he claims to know about. What’s the point of asking your credentials when I can evaluate your knowledge in real-time with GPT-n systems?
On the tree of knowledge we could see which humans score higher in which domains and why. What are the questions they can answer that others can’t. Don’t ask me my credentials, ask me a hard question/ give me a hard problem to solve and let’s see who solves it first or better. GPT-n could babble about the solution presented by different humans, and other group of humans that score high on these domains could also rate/evaluate the solutions by others, choosing the score they assign for each solution.