LLM judges prefer longer answers, so a model can climb a leaderboard just by being verbose. AlpacaEval 2's length-controlled win rate fits a logistic model of the judge's preference on the length difference, then reports the predicted win rate at equal length.
Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.
Start 7-day free trial