Sequence architectures and attention · MLD-1164
State-space model
A sequence model maintaining a latent state updated over time and mapping that state to outputs.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Model long sequences with recurrent state updates.
Original caveat
Classical and neural SSMs cover a wide family of designs.
Context and aliases
Level: Intermediate. Stages: Training · Inference · Theory.
Tags: DL · SLM · LLM · NLP.
Aliases: SSM.
Related concepts
Concepts linking here
Original references
- Attention Is All You Need ↗ · Consulted
- Transformers glossary ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- Original reference URL ↗