Reinforcement learning · MLD-0370
Entropy bonus
An objective term encouraging a policy to remain less deterministic.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Promote exploration during policy optimization.
Original caveat
More entropy is not always useful exploration.
Context and aliases
Level: Intermediate. Stages: Theory · Training · Evaluation.
Tags: RL · DL · SLM · LLM.
Aliases: Entropy regularization.
Related concepts
Concepts linking here
Original references
- OpenAI Spinning Up: reinforcement learning ↗ · Consulted
- TRL documentation ↗ · Consulted
- Original reference URL ↗