Definition
What it means
A benchmark defines tasks, data, evaluation procedures, and metrics so model capabilities can be measured consistently over time or across systems.
Why it matters
Role in the system
Benchmarks turn broad capability claims into inspectable evidence, though they never capture every real-world condition.
Example
In practice
A suite measures whether models can complete professional work products under a shared rubric.