Foundations · MLD-0324
Distributed learning
Training using multiple computational workers or machines.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Split training across several GPUs.
Original caveat
Distribution can add communication overhead.
Context and aliases
Level: Foundational. Stages: Theory · Training · Inference.
Tags: ML · DL · SLM · LLM.
Aliases: None recorded.
Related concepts
Original references
- Deep Learning: online textbook ↗ · Consulted
- Google Machine Learning Glossary ↗ · Consulted
- Original reference URL ↗