ArtificialIntelligence.io

The Signal

Everything that matters in AI, with our take.

Updated through the day. Every headline links straight to the source. The two lines underneath are ours.

arXiv cs.LGPaperClaude Watch

Follow the Gradient: Tracing Safety Degradation Back to Training Data

This solves a real post-training problem: safety erosion from seemingly innocent data. The gradient-based attribution is clever and the scale (millions of examples) is practical. The validation on emergent misalignment and secure code is solid. For any team fine-tuning LLMs, this is a tool to integrate into your data pipeline. It's not revolutionary but it moves safety testing from theory to practice.

arXiv cs.LGPaper

Trusting the Tool: Asymmetric Deference of LLM Vulnerability Auditors to Static-Analysis Evidence

LLMs conducting security audits using static-analysis output show asymmetric credulity: they're highly vulnerable to false negatives if the tool falsely claims something is safe, but resistant to false positives. This is the wrong asymmetry for security. If you're building LLM-plus-static-analyzer pipelines for vulnerability scanning, you need explicit confirmation logic and out-of-band verification of any safety claim, not just model-level confidence.

arXiv cs.LGPaper

The Missing Compliance Class: LLM Graders That Collapse Jailbreak Success, and a Free Check

Every jailbreak paper you've read may be measuring grader artifacts, not target-model behavior. This doesn't mean attacks don't work; it means the published success rates are noise. For builders: if you're using LLM graders for safety evaluation, audit them first. For researchers: this explains variance in published numbers and establishes a cheap diagnostic (per-class label counts). Fix your evaluation pipeline.

Simon WillisonArticle

My obituary for programming

Willison has credibility on agent tooling and LLM capability limits, so this title signals a substantive position on whether code-writing is becoming labor-optional. Without the piece itself we can't verify the claim, but it's worth reading because the answer actually matters: if Willison thinks we're there, builders need to stress-test their own assumptions about how long hand-coding stays central to their stack.

arXiv cs.LGPaper

When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers for Context-Parallel Prefill

This is infrastructure troubleshooting with real teeth. A remote KV cache sounds efficient but the paper shows it can wreck p99 latency: 17.3s instead of 3.96s. The cost model (hit pays off only above B* = sR threshold, plus fixed per-hit engine cost) gives operators a way to decide when remote tiers make sense. If you're scaling long-context serving across multiple engines, this reframes the cache strategy conversation.

arXiv cs.AIPaper

Do Factuality Methods Make LLMs More Factual? Reproducibility and Fair Comparison

This is the news: factuality alignment is broken, at least in the reproducible literature. The papers claiming better factuality don't hold up under scrutiny or comparison. If you're building with a production LLM and relying on factuality improvements from one of these methods, you should stop and test with ground truth. The field needs to rebuild this from honest baselines.