Sequence architectures and attention · MLD-0690
LSTM
A gated recurrent architecture with a cell state designed to retain and update information over time.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Model long sequential dependencies.
Original caveat
It mitigates but does not eliminate long-context difficulties.
Context and aliases
Level: Intermediate. Stages: Training · Inference · Theory.
Tags: DL · SLM · LLM · NLP.
Aliases: Long short-term memory.
Related concepts
Concepts linking here
Original references
- Attention Is All You Need ↗ · Consulted
- Transformers glossary ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- Original reference URL ↗