Interpretability and mechanistic analysis · MLD-0905
Polysemanticity
A unit or direction responding to multiple seemingly unrelated concepts or features.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
One neuron activates for several distinct patterns.
Original caveat
Interpretations depend on the evaluated input distribution.
Context and aliases
Level: Advanced. Stages: Research · Evaluation.
Tags: ML · DL · SLM · LLM · Interpretability · Safety.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- Captum model interpretability documentation ↗ · Reference link
- Tracing the thoughts of a large language model ↗ · Consulted
- Towards Monosemanticity: Decomposing Language Models With Dictionary Learning ↗ · Consulted
- SHAP documentation ↗ · Reference link
- Original reference URL ↗