Evaluation metrics and uncertainty · MLD-1016
Reliability diagram
A plot comparing predicted confidence with empirical outcome frequency in groups.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Inspect overconfident prediction bins.
Original caveat
Binning choices and sample counts affect the picture.
Context and aliases
Level: Intermediate. Stages: Evaluation · Research.
Tags: ML · DL · SLM · LLM.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- scikit-learn: cross-validation ↗ · Reference link
- Google Machine Learning Glossary ↗ · Consulted
- scikit-learn: evaluation metrics ↗ · Reference link
- Original reference URL ↗