Evaluation design and benchmarks · MLD-0748
MMLU
A benchmark of multiple-choice questions spanning many academic and professional subjects.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Compare broad subject-question performance.
Original caveat
Aggregate scores hide task variation and do not measure all reasoning abilities.
Context and aliases
Level: Intermediate. Stages: Evaluation · Research.
Tags: ML · DL · LLM · SLM · Safety.
Aliases: Massive Multitask Language Understanding.