Benchmarking
Definition
The practice of running standardized test batteries (e.g. MMLU, HumanEval) to measure model capability.
Example Case
Running HumanEval coding test to compare DeepSeek-Coder vs Claude.
The practice of running standardized test batteries (e.g. MMLU, HumanEval) to measure model capability.