ArtificialIntelligence.io

The Signal · beat

Papers

arXiv publishes hundreds of AI papers a day; a handful change anything for practitioners. These are the ones that cleared the bar, each with a take on what it means outside the lab.

arXiv cs.AIPaper

Same Question, Different Answers: Auditing Persona-Dependent Variation in Six LLMs on Smoking-Cessation Advice

This is real work with hard numbers on a problem that matters: LLMs deployed at scale are already changing behavior based on inferred user attributes, often in ways that contradict evidence. For builders shipping health-related features, this is a concrete signal that persona-dependent outputs are not a hypothetical risk. For anyone in regulated domains, this paper is what happens when auditors come calling. The intervention they test—a system prompt specifying a factual floor—is deployable today.

arXiv cs.AIPaper

RoboArchitect: Automating the Design of Robotic Agents with Persistent Memory

This reframes robot policy deployment: instead of finetuning, you keep the policy frozen and let a code-writing model design the harness around it. The results are compelling: 9.7% to 43.3% on novel scenes, 12.7% to 40.2% on novel tasks. It's a pragmatic shift that lets general-purpose policies work out-of-box. For roboticists and embodied-AI teams, this is a proof of concept that harness design is learnable; the next step is whether it generalizes to your hardware without extensive rollout data.

arXiv cs.AIPaper

Latent Sparse Attention: Towards Subquadratic Ultra-Long Context Attention

The scaling problem is real: agents doing open-ended work need million-token context, but full attention becomes prohibitive. LSA clusters keys in a learned latent space so queries score clusters instead of every key, keeping accuracy while cutting cost. This is infrastructure-level work that could ship as a distillation method onto existing models. For builders, if your agent workflows are context-bound today, watch for when this reaches practitioners.

arXiv cs.CLPaper

Flide: Accelerating Decision Inference with Exact State Forking

Decision models (like Jev) are becoming the baseline for reliable agentic reasoning, and Flide makes them practical at scale. The innovation is that it lets you fork execution paths in a single token stream without recomputing shared prefix, which matters when your agent explores multiple choices. If you're deploying decision-model agents, this infrastructure layer directly improves throughput and latency. Worth tracking when it becomes available outside research.

arXiv cs.CLPaper

UpLoop: Training Looped Transformers via Upcycling at No Extra Pretraining Compute

This is genuinely clever: you get reasoning depth improvements for free by reallocating the compute budget you'd spend anyway. The 27.52 average downstream score versus 22.99 baseline at 1.3B parameters is a substantial gain, and the method scales. If you're training language models and can afford the engineering complexity of dynamic architecture growth, this is worth implementing. It changes what's achievable at a given compute budget.

arXiv cs.CLPaper

Stepwise-Querying: Distilling Reasoning without Access to Teacher Chain-of-Thought

This is a practical win for model distillation. If you're running inference at scale and need to compress a capable model into something faster and cheaper, this approach consistently outperforms baselines and works against black-box APIs. It doesn't require you to own the teacher's internals, which makes it deployable today. The method earned its place through empirical strength across benchmarks.

arXiv cs.AIPaper

Real Computation or Merely Naming? A Pre-Registered Mechanism Audit of 25 Cognitive-Architecture Modules in an LLM-Based Agent System

Cognitive architecture naming is theater until proven otherwise. This is the first rigorous audit of the gap between feature claims and actual execution paths in agent systems. The protocol is replicable and damning: if you're evaluating agent platforms, demand this audit. If you're building them, use this method before shipping.

arXiv cs.CLPaper

When Steering Shifts Discourse: Identifying and Intervening on Discourse-Level Changes due to Activation Steering in LLMs

Steering is becoming production-grade, but the side effects are real and measurable. This work shows you can't just add a vector and assume the rest of the model's behavior stays stable. If you're deploying steered models in safety-critical roles, you now have a technique to quantify and correct the collateral drift. Test your steering pipelines against this benchmark.

arXiv cs.AIPaper

Pre-Crime for Agents, at the Last Second: Probing When a Recruited Agent Gives In

This is the most important safety work here: you can catch collusion in flight by monitoring the model's internal state, not just its outputs. A linear probe catches leaks 3x better than zero-shot monitoring. For builders of multi-agent systems, this is directly applicable. For safety-conscious orgs, this validates that mechanistic detection works and should be part of your agent deployment checklist.

arXiv cs.AIPaper

Collaborative AI agents for autonomous experimental research with solid-state quantum spins

This is the clearest demo yet of agents actually doing novel science without human direction. The key innovation is the peer-checking mechanism: one agent can reject another agent's conclusion and demand experimental validation. This is closer to real autonomy than prior work. For builders: this model of agent verification scales beyond science. For investors: if this pattern holds across domains, AI-driven discovery becomes a real product category.

arXiv cs.AIPaper

From extreme weather to agricultural consequences with agentic AI

This is agentic AI solving a real economic problem where the cost of guessing wrong is high. The validation is concrete: AUC 0.98 on cyclone detection, 2% loss prediction error, rank correlation on holdout data. For builders: this shows how agents that reason over causal models beat black-box approaches. For investors: climate-linked agricultural losses are a $100B+ category that hasn't been solved yet.

arXiv cs.AIPaper

Algebraic World Model: From Exploration to Proofs

This is genuinely novel: turning empirical exploration into formal proofs is a hard problem, and AWM does it by building models iteratively and letting category theory guide abstraction. For builders of reasoning systems, this shows a path past the memorization wall: agents that can prove what's actually impossible in a domain, not just what they've seen. The constraint is complexity; it works on game puzzles now.

arXiv cs.CLPaper

Glance: The Generator Is Its Own Reranker

This solves a real operational problem: RAG systems that run separate rankers waste GPU residency and recompute context. By using the generator as its own ranker through cached prefill, you cut memory footprint and latency. For anyone running RAG at scale, this is worth benchmarking against your current setup.

arXiv cs.LGPaper

How I Aligned Your Model: Scaling Up Multilingual Safety Training with Templates

The core finding is uncomfortable: models that appear safe in English fail in translated or culturally adapted attacks. This is a real gap in safety evaluation. The template augmentation pipeline they built is clever and the MSafeTemp corpus is a useful artifact. If you're shipping a multilingual model: you need to measure safety in each language independently, not assume English safety generalizes. For safety researchers: this is a pattern to watch for in other modalities.

arXiv cs.CLPaper

Ramanujan Challenge Results: AI-Assisted Evaluation Pipeline for Multi-Format Proofs

The Ramanujan Challenge moves the goalposts on mathematical capability benchmarks. This is the first time AI has solved open conjectures, which is real progress, but the harder story is the evaluation problem. As models get better at mathematics, humans can't keep up with grading. The AI-assisted evaluation pipeline they built is probably as important as the benchmark itself. For builders in math or verification: this is the infrastructure you'll need.

arXiv cs.CLPaper

What Hallucinations Have We Measured? Semantic Illusion, Confabulation, and Expressed Uncertainty

This taxonomy clarifies what we've been lumping together as 'hallucinations' and gives you a diagnostic tool. Confabulations need external knowledge or retraining; semantic illusions need better retrieval or routing. The re-elicitation test is simple and reproducible. For teams debugging reliability issues, this gives you a clearer map of what broke and what to fix.

arXiv cs.CLPaper

Repairs for Whom? Evaluator-Executor Mismatch in Selecting Repairs for Failed LLM Agents

This is a practical problem for anyone shipping agent systems: you can't optimize repairs with a stronger model or oracle because the agent that runs them is weaker and learns differently. The fix is straightforward, use rollouts from your deployed agent to score repairs, not a proxy. For teams running agents in production, this is worth a sprint to validate on your stack.

arXiv cs.CLPaper

Weaken to Strengthen: Weakening-Induced On-Policy Self-Distillation for Large Reasoning Models

This is a practical win for reasoning models. Pruning 3.5B-parameter models by 13 percentage points without labeled data or a teacher is significant. The method sidesteps the hard problem of knowing what a good reasoning trace looks like. If you're optimizing reasoning models for deployment or fine-tuning on your own data, test this: create a pruned sibling, run it on your unlabeled reasoning tasks, use the gap as training signal.

arXiv cs.AIPaperClaude Watch

How Deterministic SAST and AI Security Agents Divide the Work: Coverage, Harness Policy and Cost in Snyk VulnBench 2.0

Claude Code's security review feature is competitive with industry-standard SAST tools, which is significant for an AI-native approach. The lack of overlap—they catch different vulnerabilities—suggests they should be used together, not as alternatives. For security teams evaluating tools, this is real data showing AI doesn't replace deterministic analysis yet, but augments it. For builders of security agents, this sets a benchmark you need to beat.

arXiv cs.CLPaper

Right Numbers, Wrong Questions: Evaluating LLMs on Underspecified Financial Queries

This is the agent failure mode you'll hit in production. Your model can fetch the right data, format it correctly, and still give financially wrong advice because the user's question had five valid interpretations and you picked the wrong one. If you're building financial assistants, this tells you that confidence in retrieved data is not confidence in correctness. Require explicit user intent specification before answering.

arXiv cs.AIPaper

When AI performs, what remains? An integrative review of generative AI and cognitive capital in individuals and organizations

The question is real but the framing matters: productivity gains and capability loss can happen simultaneously, and most organizations are tracking only the former. If you're building tools that embed domain expertise or institutional knowledge, this research signals a growing market for solutions that preserve human judgment rather than replace it. For enterprises deploying AI widely, treating cognitive capital as a depletable resource changes how you staff and train teams.

arXiv cs.LGPaper

Adversarial Self-Distillation

The insight here is structural: template-based safety training doesn't generalize to adversarial input spaces because it's supervised by fixed outputs, not by reasoning. Self-distillation forces the model to learn why it should refuse, not just when, by training on the distribution of prefixes the attacker actually explores. If you're shipping a safety-critical model, this is worth testing against your threat model because it handles a known failure mode that existing defenses don't.

arXiv cs.LGPaper

Skillful and realistic precipitation forecasting with reinforced diffusion

This is the first system to crack a hard problem: weather forecasting that is both accurate and physically coherent, which matters because blurry ML forecasts systematically miss extremes. The RL-refined diffusion approach is clever, and real-time latency means operational deployment is possible now. For weather-dependent decision-making, this is a capability shift worth testing.

arXiv cs.AIPaper

Autonomous Quantum Measurement with Agentic AI

This is the first concrete demonstration that agents can do real lab work with genuine stakes. QUANTA combines retrieval of scientific literature with planning and troubleshooting agents to run quantum characterization end-to-end. For builders: this is a clear roadmap for multi-agent workflows in domains with tight feedback loops. For labs: you now have a working template for automating expensive, expertise-heavy experimentation.

arXiv cs.CLPaperClaude Watch

What Carries Forward? Pretraining Disclosure Across Language Model Releases

This is a clear signal that model transparency is getting worse, not better. Later releases lose disclosure despite claiming improvements. The culprits are specific: corpus composition and training compute remain largely opaque. If you're evaluating models for production, this says you can't rely on vendor claims about whether a new version is actually better trained. Demand the raw numbers or treat the upgrade as unverified.

arXiv cs.CLPaper

Watermark Basins: Black-Box Detection of Distilled LLMs

Model distillation is a real threat to proprietary models, and existing token-level watermark detection fails when students are trained at low temperature. This paper's insight about geometric basins is novel and the black-box approach means watermarks could survive distillation attempts. For model providers: this changes the calculus of watermarking strategy. For researchers building defense systems: test this before assuming your distilled model is undetectable.