The methodology of asking political questions and seeing whether it gives a balanced response may not be the best approach. While I am sure some users do exactly that, I usually find bias elsewhere. For example, LLMs seem to have a strong feminist bias that affects their ability to follow evidence and chains of reasoning that would argue against stereotypically feminist positions. I think a set of questions that separately explore evidence and moral arguments from the left and right might be better. One would be looking for whether it can follow evidence and logic to the same extent on both sides. A bias there would more frequently impact users while also being less apparent to the user at the time.
The methodology of asking political questions and seeing whether it gives a balanced response may not be the best approach. While I am sure some users do exactly that, I usually find bias elsewhere. For example, LLMs seem to have a strong feminist bias that affects their ability to follow evidence and chains of reasoning that would argue against stereotypically feminist positions. I think a set of questions that separately explore evidence and moral arguments from the left and right might be better. One would be looking for whether it can follow evidence and logic to the same extent on both sides. A bias there would more frequently impact users while also being less apparent to the user at the time.