Your Private Eval Is the Only Benchmark That Steers You
A 2026 saturation review flagged 29 of 60 widely used LLM benchmarks as high or very high on a saturation index. A null model topped AlpacaEval 2.0 under automated judging. Multilingual contamination studies report leakage up to 91.8% on popular suites. Public benchmarks still shape a shortlist. A private eval built from the team's own domain vocabulary is the signal that moves the ship decision.