Mathematics and probability · MLD-0589
Jensen-Shannon divergence
A symmetric, finite mixture-based divergence between probability distributions.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Compare two models' output distributions.
Original caveat
The divergence itself is not generally the metric; its square root is.
Context and aliases
Level: Foundational. Stages: Theory · Training · Evaluation.
Tags: ML · DL · SLM · LLM.
Aliases: JSD.
Related concepts
Concepts linking here
Original references
- Deep Learning: online textbook ↗ · Consulted
- Mathematics for Machine Learning ↗ · Reference link
- Original reference URL ↗