AI safety and alignment · MLD-0725

Mesa-objective

The objective pursued by a mesa-optimizer, potentially different from the training objective.

Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.

Original example

Compare internal search preferences with external reward.

Original caveat

Identifying such an objective in real models is difficult.

Context and aliases

Level: Advanced. Stages: Training · Evaluation · Research · Governance.

Tags: Safety · RL · SLM · LLM.

Aliases: None recorded.

Related concepts

Concepts linking here

Original references

Open original record, export or annotate →