Statistics and experimental design · MLD-0001
A/B test
A comparison of alternatives, commonly through randomized assignment in production.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Compare two ranking models on a fixed metric.
Original caveat
Repeated peeking and multiple metrics require care.
Context and aliases
Level: Intermediate. Stages: Theory · Evaluation · Research.
Tags: ML · DL · SLM · LLM.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- scikit-learn: cross-validation ↗ · Reference link
- Mathematics for Machine Learning ↗ · Reference link
- scikit-learn: evaluation metrics ↗ · Reference link
- Original reference URL ↗