Distillation and model compression · MLD-1199
Symmetric quantization
Quantization using a range centered around zero under a specified coding scheme.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Quantize roughly symmetric weight distributions.
Original caveat
Symmetry can waste range for strongly skewed data.
Context and aliases
Level: Intermediate. Stages: Training · Adaptation · Deployment.
Tags: DL · SLM · LLM.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- Distilling the Knowledge in a Neural Network ↗ · Consulted
- PEFT: LoRA conceptual guide ↗ · Consulted
- PEFT: quantization guide ↗ · Consulted
- Original reference URL ↗