Additional mathematical and learning concepts · MLD-0918
Power law
A relationship where one quantity scales as another quantity raised to a fixed exponent over a relevant range.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Fit a model of loss versus training compute.
Original caveat
A fitted power law need not hold outside the measured regime.
Context and aliases
Level: Intermediate. Stages: Theory · Training · Evaluation.
Tags: ML · DL.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- Deep Learning: online textbook ↗ · Consulted
- Mathematics for Machine Learning ↗ · Reference link
- scikit-learn User Guide ↗ · Consulted
- Original reference URL ↗