Evaluation metrics and uncertainty · MLD-0181
Cohen's kappa
Agreement beyond a specified chance-agreement baseline for two raters or labelers.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Measure categorical annotation agreement.
Original caveat
Its value is sensitive to category prevalence.
Context and aliases
Level: Intermediate. Stages: Evaluation · Research.
Tags: ML · DL · SLM · LLM.
Aliases: Kappa.
Related concepts
Concepts linking here
Original references
- scikit-learn: cross-validation ↗ · Reference link
- Google Machine Learning Glossary ↗ · Consulted
- scikit-learn: evaluation metrics ↗ · Reference link
- Original reference URL ↗