Neural-network building blocks · MLD-0496
Group normalization
Normalizing channels within groups independently for each example.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Train vision models with small batches.
Original caveat
The chosen channel grouping affects behavior.
Context and aliases
Level: Intermediate. Stages: Training · Inference · Theory.
Tags: DL · SLM · LLM · Vision · NLP.
Aliases: GroupNorm.
Related concepts
Concepts linking here
Original references
- Deep Learning: online textbook ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- PyTorch documentation ↗ · Reference link
- Original reference URL ↗