arXiv cs.CLPaper
Where Should a Document Live: Context, Representations, or Parameters?
The storage-accuracy trade-off for knowledge-intensive tasks just got clarified. Representation injection (Cartridges) wins on pure budget efficiency, but real retrieval workflows still need the context window. For RAG builders: this is the paper that quantifies when caching representations beats fine-tuning, and the answer is more often than you'd expect.