Position Bias in LLM Judges Favoring First or Last Speaker
LLM judges systematically favor responses based on position rather than quality alone.
The Impartial Judge Editors
Section
Bias Auditing and Fairness
2 stories in Bias Auditing and Fairness.
Accent and Dialect Effects on AI Debate Judge Scores
Speech-to-text bias determines debate outcomes before judges even score arguments.
The Impartial Judge Editors