ArtificialIntelligence.io

The Signal

Everything that matters in AI, with our take.

Updated through the day. Every headline links straight to the source. The two lines underneath are ours.

arXiv cs.CLPaper

REVA: Reusable Evidence View Aggregation for Context-Efficient RAG Serving

RAG latency is now a solved problem in principle. This work shows that compression gains are unstable across queries and that the old post-retrieval approach is adding overhead without benefit. REVA mines your own traffic to build a scoring layer that's specific to your generator and documents. If you're running knowledge-intensive applications at scale, this is worth implementing before optimizing the retrieval layer itself.

arXiv cs.CLPaper

FlexComp: One Model for Every Ratio in Context Compression

Context compression just became more practical. Existing compressors require separate models for each ratio and apply uniform compression regardless of input complexity, both wasteful. FlexComp trains once and compresses flexibly, with routing that preserves 98% accuracy at extreme compression. This is infrastructure that RAG and agent builders should test immediately—it removes a deployment friction point.

arXiv cs.LGPaper

LatentPress: Context Compression Beyond Text and Vision

This is real infrastructure for long-context systems. Bypassing text reconstruction at inference saves latency and improves accuracy at high compression ratios. If you're building long-context applications, this is immediately applicable. The 43ms per conversation speedup versus text summarization is the kind of marginal improvement that compounds at scale.

arXiv cs.AIPaper

Measurement-Driven Sub-Network Selection for On-Premise Retrieval-Augmented Factory Agents

This is deployment craft: after compression, bigger doesn't mean better, so pick sub-networks by what actually works on the hardware you have. The weight-sharing supernetwork keeps selection cheap. It's useful for anyone shipping to constrained devices, but the context is narrow: factory documentation retrieval. The real insight is transferable though: test on the real hardware, not the lab benchmark.