ArtificialIntelligence.io

The Signal

Everything that matters in AI, with our take.

Updated through the day. Every headline links straight to the source. The two lines underneath are ours.

arXiv cs.AIPaper

Lagged Coupling: Internal Representations Become Readable Before They Become Causal

This is important mechanistic insight. Readability and causality are decoupled, and the gap does not close with model scale. For interpretability researchers and anyone building steering or control methods for language models, this is a hard constraint you need to understand. Your probing metrics are not telling you what you think they are. The implications for alignment work are non-trivial.

arXiv cs.CLPaper

A Circuit for Plural Reference: How LLMs Represent and Retrieve Singular and Plural Entities

This is interpretability work on a narrow subtask, and the finding is incremental: LLMs do learn grammar patterns we'd expect them to learn. The mechanistic angle is solid but the scope is too small to reshape how builders work. Useful if you're doing interpretability research on pronoun handling; not relevant if you're shipping products.

arXiv cs.LGPaper

Context-Grounding Gains Are Mediated by Pre-existing Machinery: Auditing GRPO, SFT, and DPO

This matters for understanding what post-training actually does: it's not injecting new reasoning into your model, it's tuning machinery that was always there. For builders using SFT or DPO to improve instruction-following, the implication is that you're hitting a ceiling faster than you'd think. Test your grounding performance before committing to multi-week training runs.

arXiv cs.LGPaper

Scaled Idempotence in Transformer Attention: Paired OV Geometry and Shared-Value Algebras

This is mechanistic interpretability work showing that Transformers do develop structured algebraic patterns in attention. The finding is interesting but doesn't immediately change how you build or deploy models. It's the kind of paper that feeds into longer-term understanding of why Transformers work, not a signal for what to do this quarter.