Chunking

The process of splitting large documents or datasets into smaller, manageable pieces (chunks) for processing by AI models. Chunking is essential for RAG systems: documents are split into chunks, embedded into vectors, and retrieved based on relevance. Chunk size and overlap strategy directly affect retrieval quality and agent accuracy.