Module 02 · Think Like an AI Researcher

Benchmarks: What They Actually Measure

Read time: 13 min  ·  Arjun Jaggi  ·  September 2026

A model scores 89.7 on MMLU. Another scores 92.1. Your vendor says theirs is better. You need to decide whether to switch. Before you do, you need to know one thing: what does MMLU actually test?

This module names the major AI benchmarks used today, explains what each one measures, and shows you the gap between benchmark performance and performance in your actual organization.

The four benchmark types

Every AI benchmark falls into one of four categories. Knowing the category tells you instantly what the score does and does not predict.

Key Concept

A benchmark score is a proxy. It tells you how well the model performs on a specific set of tasks designed by specific researchers in a specific context. The question is always: how close is that context to yours?

The major benchmarks decoded

BenchmarkWhat it testsWhat a high score meansWhat it does NOT tell you
MMLU Multiple-choice questions across 57 subjects (law, medicine, history, STEM) Model has broad factual coverage How the model performs on open-ended or ambiguous tasks in your domain
GSM8K Grade-school math word problems requiring multi-step arithmetic Model can follow structured reasoning chains Whether the model can handle novel quantitative reasoning outside arithmetic
HumanEval Python function completion verified by unit tests Model writes syntactically correct, testable code for standard problems Whether it writes maintainable code, handles edge cases, or works in your codebase
HELM Holistic suite across accuracy, calibration, robustness, fairness, efficiency Model performs consistently across multiple dimensions Which dimensions matter most for your specific application
SWE-bench Real GitHub issues that require code changes to resolve Model can navigate real codebases and propose working patches Whether it works on your proprietary codebase with your coding conventions
MMLU-Pro Harder version of MMLU with 10 answer choices and more reasoning-heavy questions Model handles harder factual and reasoning tasks Anything specific to your industry or document type

Why benchmark leaders fail in practice

Here is a pattern that repeats in enterprise AI. A team evaluates three models on standard benchmarks. Model A wins on MMLU and GSM8K. They deploy it. Six months later, performance is disappointing. What happened?

Benchmarks measure performance on public, well-formed tasks. Enterprise work involves private, messily-formed tasks. The gap between those two environments is the "deployment gap." It shows up as:

Interactive: benchmark vs. deployment performance

Interactive: Deployment Gap Simulator

What to ask when a vendor cites a benchmark

Four questions that should become automatic:

  1. Which version of the benchmark? MMLU has a standard version and MMLU-Pro. A score on one does not translate to the other.
  2. What was the evaluation protocol? Few-shot vs. zero-shot, chain-of-thought prompting vs. direct answer, temperature settings. These choices move scores significantly.
  3. Was the test set public? Public test sets are potential training data. Models can score highly by memorizing test items, not by generalizing from them. This is the contamination problem covered in Module 3.
  4. What does this benchmark predict about my use case? If you are buying a model for contract review and the vendor cites MMLU, ask directly: what is the relationship between MMLU performance and contract review accuracy? If they cannot answer, the citation is marketing, not evidence.
Practitioner Note

The most reliable benchmarks for enterprise evaluation are ones you design yourself on your own data. Module 4 covers how to do this. Until then, use public benchmarks as a rough filter, not a selection criterion.

Knowledge check

Quiz : Module 02
1. A model achieves 91% on MMLU. What does this most reliably tell you?
2. Which benchmark is most reliable because its evaluation is objectively verifiable?
It is a useful signal, but you need to know which dimensions of HELM drove the score. HELM aggregates across accuracy, calibration, robustness, fairness, and efficiency. A model could lead HELM by excelling on three dimensions while underperforming on two that matter most to you. Ask the vendor: which HELM scenarios are most predictive of your use case, and what does the model score on those specifically?
Hands-on Exercise

Take any vendor AI evaluation report you have received in the last year. Identify every benchmark cited. For each one: (1) which type is it (knowledge, reasoning, code, holistic)? and (2) how close is that benchmark to your actual use case? Score the report's evidence quality on a 1-5 scale. Bring this to your next vendor review meeting.

Before you go

Next: Module 3 covers how benchmarks get gamed. You will learn the five manipulation patterns that inflate scores, and how to detect each one before trusting a number.