Statistics and experimental design · MLD-0870
Paired evaluation
Comparing systems on the same examples to reduce irrelevant variation.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Analyze per-question score differences.
Original caveat
Pairing must be reflected in uncertainty calculations.
Context and aliases
Level: Intermediate. Stages: Theory · Evaluation · Research.
Tags: ML · DL · SLM · LLM.
Aliases: None recorded.
Related concepts
Original references
- scikit-learn: cross-validation ↗ · Reference link
- Mathematics for Machine Learning ↗ · Reference link
- scikit-learn: evaluation metrics ↗ · Reference link
- Original reference URL ↗