#measurement

BenchMIRT Asks: What Are LLM Benchmarks Actually Measuring?

New research examines whether LLM benchmark scores reflect real model capability, revealing how measurement artifacts and benchmark design choices distort our picture of model performance.