Statistics and experimental design · MLD-0889
Permutation test
A test comparing the observed statistic with values under label or assignment permutations justified by the null.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Compare paired model outputs under exchangeability.
Original caveat
Invalid exchangeability assumptions invalidate the test.
Context and aliases
Level: Intermediate. Stages: Theory · Evaluation · Research.
Tags: ML · DL · SLM · LLM.
Aliases: None recorded.
Related concepts
Original references
- scikit-learn: cross-validation ↗ · Reference link
- Mathematics for Machine Learning ↗ · Reference link
- scikit-learn: evaluation metrics ↗ · Reference link
- Original reference URL ↗