arXiv cs.AIPaper
You don't need long context
This directly challenges the long-context arms race. If you can get 99% of the accuracy on most tasks with tight context management and occasional reference patterns, the ROI for 128k-token models collapses. For builders: revisit your context assumptions. For infrastructure companies: the growth story of longer-context models just got smaller.