The aim of the project is to benchmark widely used LLMs (proprietary and open source) in relation to their viewpoints on contemporary political issues. We want to examine these differences across models, languages and over time to better understand in how far models follow or differ from trends in the political climate.
- open ai gpt 4o
- google gemini 1.5 flash
- claude-3-5-sonnet-20241022
- groq
- llama-3.3-70b-instruct
- mistral-large-instruct
- qwen2.5-72b-instruct
- teuken-7b-instruct-research
- (further tba)