Introducing Contextual Retrieval
This is a concrete, reproducible fix for one of RAG's oldest failure modes: chunks losing meaning when stripped from their surrounding document. Anthropic reports meaningful retrieval accuracy gains when combining contextual embeddings with contextual BM25 and reranking. If you run a production RAG pipeline, this is worth testing against your own eval set before you reach for a bigger model or a pricier vector database.