Data and feature engineering · MLD-0570
Inter-annotator agreement
A measure of how consistently different annotators label the same data.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Measure agreement on a sentiment annotation batch.
Original caveat
Agreement is not the same as correctness.
Context and aliases
Level: Intermediate. Stages: Data · Training · Evaluation.
Tags: ML · DL · SLM · LLM.
Aliases: IAA.
Related concepts
Concepts linking here
Original references
- scikit-learn: cross-validation ↗ · Reference link
- scikit-learn: missing-value imputation ↗ · Reference link
- scikit-learn: preprocessing ↗ · Reference link
- scikit-learn: feature selection ↗ · Reference link
- Original reference URL ↗