Evaluation design and benchmarks · MLD-0529

HumanEval

A code-generation benchmark using programming tasks and tests to assess functional correctness.

Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.

Original example

Measure sampled Python-solution success.

Original caveat

Passing finite tests is not a complete proof of program correctness.

Context and aliases

Level: Intermediate. Stages: Evaluation · Research.

Tags: ML · DL · LLM · SLM · Safety.

Aliases: None recorded.

Related concepts

Concepts linking here

Original references

Open original record, export or annotate →