I guess that subconscious biases and ways to explore them form an entire new area of research. In the case with political biases there appear questions like the following:
Was the effect observed in non-American models like DeepSeek or Qwen?
How does the effect change when prompting the model to assess the applications for, say, a Russian company (e.g. Yandex or VK, which are famous IT-related companies based in Russia) or to assess the applications written in Russian[1]? And if we replace the names related to Black people with the names related to other ethnicities against whom the Russians are biased?
I managed to observe language-dependent political biases in DeepSeek by asking ChatGPT to translate the two answers to the question about fentanyl from OpenAI’s Spec into Russian and by studying DeepSeek’s reaction to the answers in English or in Russian.
I guess that subconscious biases and ways to explore them form an entire new area of research. In the case with political biases there appear questions like the following:
Was the effect observed in non-American models like DeepSeek or Qwen?
How does the effect change when prompting the model to assess the applications for, say, a Russian company (e.g. Yandex or VK, which are famous IT-related companies based in Russia) or to assess the applications written in Russian[1]? And if we replace the names related to Black people with the names related to other ethnicities against whom the Russians are biased?
P.S. Yesterday I published a post where I claimed that current LLMs are politically biased[2] and future AIs will overcome the biases.
I managed to observe language-dependent political biases in DeepSeek by asking ChatGPT to translate the two answers to the question about fentanyl from OpenAI’s Spec into Russian and by studying DeepSeek’s reaction to the answers in English or in Russian.
The models are biased to the point that o4-mini claimed in June 2025 that Trump isn’t the president of the USA.
OpenAI lists o4-mini’s knowledge cutoff as “Jun 01, 2024”.
If that’s correct, it sure seems like a completely sufficient explanation as to why it would claim that Trump isn’t a US president.