Evaluation metrics and uncertainty · MLD-1093
Selective prediction
Allowing a model to decline predictions under a chosen confidence or risk rule.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Send uncertain cases to review.
Original caveat
Abstention quality depends on the selection score.
Context and aliases
Level: Intermediate. Stages: Evaluation · Research.
Tags: ML · DL · SLM · LLM.
Aliases: Abstaining prediction.
Related concepts
Concepts linking here
Original references
- scikit-learn: cross-validation ↗ · Reference link
- Google Machine Learning Glossary ↗ · Consulted
- scikit-learn: evaluation metrics ↗ · Reference link
- Original reference URL ↗