Evaluation design and benchmarks · MLD-0384

Evaluator integrity

The extent to which an evaluation process remains independent, uncompromised, and faithful to its intended criterion.

Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.

Original example

Prevent evaluated agents from editing their test results.

Original caveat

An accurate evaluator is still vulnerable if the system can manipulate it.

Context and aliases

Level: Intermediate. Stages: Evaluation · Research.

Tags: ML · DL · LLM · SLM · Safety.

Aliases: None recorded.

Related concepts

Concepts linking here

Original references

Open original record, export or annotate →