Retrieval and search · MLD-1102
Semantic chunking
Choosing chunk boundaries using meaning, discourse structure, or semantic similarity.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Keep related paragraphs together.
Original caveat
The segmentation criterion can be unstable or expensive.
Context and aliases
Level: Intermediate. Stages: Data · Retrieval · Inference · Evaluation.
Tags: ML · NLP · SLM · LLM · IR.
Aliases: None recorded.
Related concepts
Original references
- Faiss documentation ↗ · Reference link
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks ↗ · Consulted
- Sentence Transformers documentation ↗ · Reference link
- Original reference URL ↗