ArtificialIntelligence.io

The Signal

Everything that matters in AI, with our take.

Updated through the day. Every headline links straight to the source. The two lines underneath are ours.

arXiv cs.AIPaper

AlgoEvo: Self-Evolving Agentic Search for Automated Algorithm Discovery

This is agent architecture for algorithm discovery that learns to reuse patterns across tasks. It outperforms existing frameworks on six benchmarks and handles single and multi-objective problems in one workflow. If you're building agents that need to synthesize or refine code iteratively, the hierarchical experience mechanism is worth studying. The skill decoupling also signals how you should think about agent modularity.

arXiv cs.AIPaperClaude Watch

Substrate-Aware AI Agents: Execution Context as a First-Class Input

The insight is simple but underexplored: agents can't optimize for constraints they don't see. This paper shows that disclosing a 128 MB RAM and 10-second wall-time budget to Claude, GPT, and Gemini yielded structural code changes that cut execution time by up to 3.1x. For builders: your agent prompts should include the operational contract. For infrastructure: this is a forcing function to standardize how environments advertise their constraints to models.

arXiv cs.AIPaper

ACE: Adaptive Calibration-Free Expert Skipping for MoE-based LLMs

MoE routing is stuck routing the same number of experts per token, which wastes compute on tokens that don't need it. This paper's contribution is narrow: a calibration-free algorithm to decide which experts to skip. Real but incremental. It matters if you're running MoE inference at scale, but the gains are meaningful only if expert-skipping wasn't already on your roadmap.

arXiv cs.AIPaper

Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization

Agents that formulate OR models today often fail quietly on underspecified problems. This work does something underexplored: measure whether an agent detects missing information and asks. It's incremental research on a real problem, but the benchmark itself is the contribution; InterOPT's two-stage approach is competent rather than novel. Useful if you're building planning systems.

arXiv cs.CLPaper

Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG

Context compression via learned embeddings is practical and the numbers are significant. Training on both correct examples and failure cases is a straightforward but under-deployed technique. If you're running RAG systems in production and watching token costs, this is worth testing. The 4-24x speedup range suggests it's sensitive to retrieval depth and model size.

arXiv cs.LGPaper

On the Principles Behind Neural Network Optimizers

Adam's dominance in LLM training rests on special Hessian geometry that emerges during transformer training, not on general principles. If you're building custom optimizers or training at scale, this explains why Adam's diagonal preconditioner works when theory says it shouldn't, and points toward concrete improvements for specific hardware and batch sizes.

arXiv cs.CLPaper

VestigeKV: The NoPE-MLA KV Cache Carries Its Own Eviction Signal in a Vestigial Branch

This is the kind of systems-level optimization that compounded over millions of inference calls becomes real cost and latency savings. The insight is elegant: use existing model signals for cache eviction rather than observing attention patterns that don't exist yet. If you're running Kimi Linear or similar models at scale, this is immediately applicable. For inference infrastructure builders, this shows where the next efficiency gains live: not in architecture, but in reading what the architecture already learned.

arXiv cs.LGPaper

Hardware-Aware FP4 FlashAttention-4

Blackwell is shipping now and naive FP4 attention doesn't auto-unlock speed gains. This paper shows how: Direct-P for inference, causal paths with FP8 gradients for training. For teams running large models on Blackwell hardware, this translates directly to wall-clock gains. The 1.14x single-GPU update speedup is real money. Implementation details matter here, so read carefully or grab the code.

arXiv cs.CLPaper

Compile by Training: Turning Natural-Language Specifications into Local Neural Functions

This is a real engineering insight: you can reduce inference cost and latency by generating task-specific training data from a large model, then training a tiny adapter that works offline. The 83.6% accuracy on hard cases matters for production use. If you're paying for repeated API calls on high-volume paths, this pattern is worth prototyping.

arXiv cs.LGPaper

Artificial Intelligence for Energy Optimization in Data Centers

This is a useful field audit: the literature cannot presently rank its own methods because experiments are siloed and metrics don't account for full resource costs. If you're evaluating or building data center optimization systems, this tells you that published comparisons are not trustworthy and you need to benchmark against multiple approaches in your own environment. The CLEAR-DC framework sketch suggests a better direction.

arXiv cs.CLPaper

ViSAR: Training-Free Adaptive-$k$ Retrieval for Visual Document Question Answering

This is practical engineering: instead of always fetching top-k pages for a RAG pipeline, fetch as many as the query actually needs. It's training-free, so you can apply it to any late-interaction retriever today. Real latency wins in DocVQA, which matters for deployed products. For teams building on RAG: test this immediately. It's a free optimization with no downside if you're already doing retrieval-based QA.

arXiv cs.AIPaper

Can LLMs Design Video Coding Tools? A Case Study on Planar Mode

This shows LLMs can participate in tight feedback loops for specialized algorithmic work, which is interesting for codec and compressor development. The results are marginal (0.18% bitrate improvement), but the process signals that LLMs might be useful collaborators for performance-critical engineering where evaluation is fast and feedback is precise. Worth experimenting with if you're optimizing a hot path.

arXiv cs.AIPaper

AgentFactory: Towards Automated Agentic System Design and Optimization

The problem is real: manually tuning agents across model choice, tool selection, and orchestration is expensive and brittle. Joint optimization makes sense in principle. The execution is not clear from the excerpt, so the question is whether AgentFactory actually finds meaningfully better configs than manual tuning or ablation. If it does and the configs are portable, this is useful infrastructure. Worth a closer look if you are shipping production agents.

arXiv cs.CLPaper

Context-Aware Interleaved Batching for WhisperX

This is solid systems work on a production problem. Whisper's hallucination and context-loss issues are real blockers for long-form transcription pipelines. The solution trades a small amount of throughput for accuracy without losing the speed gains that made WhisperX useful in the first place. If you're shipping voice products, this is worth implementing. The approach is transferable to other streaming inference problems.

arXiv cs.LGPaper

Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusion

Mathematically interesting but practically limited. The idea of using the denoiser as a projection operator is neat, but this is a constrained-optimization technique for a narrow use case (optimizing diffusion samples while staying on manifold). Useful if you're doing generative design with structured constraints, but most applications don't need this level of sophistication.

arXiv cs.CLPaper

Batch-wise Adaptive Pruning: Periodic Neuron Activation-Aware Weight Pruning for Language Reasoning Model

Reasoning models are expensive to run at scale because you can't just mask tokens freely. This paper identifies why existing pruning breaks in batch mode (the activation distribution shifts when you aggregate) and proposes a fix. If you're deploying reasoning models for throughput, adaptive pruning is worth benchmarking. The signal is concrete: focus on whether top-k beats threshold under your actual batch sizes.

arXiv cs.CLPaper

KV Cache Compression Through the Lens of Transform Coding

Long-context inference costs money, and KV cache is the main culprit. This paper proves that the standard approach (minimize reconstruction error) doesn't minimize what actually matters (attention output fidelity), then fixes it with math from information theory. If you're running long-context models in production, the inference cost savings could be material. The trick is implementation; the theory is solid.

arXiv cs.LGPaper

Approximate Muon with low-rank adapters

Muon is a real optimizer with proven benefits, and this work makes it work with LoRA-style parameter efficiency. The gains are moderate and model-dependent, so don't expect a revolution. Useful if you're already invested in Muon and want to cut fine-tuning costs, but the bar for switching is moderate.

arXiv cs.LGPaper

Muon on the Stiefel Manifold Admits an Exact Closed-Form Update

Optimizer research on orthogonality-constrained training matters to anyone pushing large model training efficiency, since Muon-style optimizers have been gaining traction as Adam alternatives. A closed-form update with convergence guarantees is a genuine technical contribution, but it needs adoption in a major training stack before it changes anything practical. File it under infra research to monitor, not act on yet.