Technique
Chunking
Splitting documents into smaller passages before embedding for retrieval.
Definition
Chunking divides long documents into 200â1000-token passages so each one fits an embedding model's input window and matches user queries' typical scope. Strategies â fixed-size, sentence, recursive, semantic â strongly influence RAG quality.
Common use cases
- RAG ingestion
- Search indexing
- Document QA