ArtificialIntelligence.io

The Signal

Everything that matters in AI, with our take.

Updated through the day. Every headline links straight to the source. The two lines underneath are ours.

arXiv cs.LGPaper

Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs

Unlearning is becoming a compliance requirement, not an option. This method targets layers rather than applying blanket updates, which should preserve model utility better. The quantization-resilience angle is practical: forgotten knowledge tends to leak back in after quantization, so handling that matters for deployment. Worth testing if you're operationalizing unlearning for privacy or copyright compliance.

arXiv cs.LGPaper

On the Plasticity Collapse in Continual Machine Unlearning

This is an important negative result for the unlearning-as-a-service narrative. Real systems need to forget multiple data subjects over time, but geometry gets saturated. The theory is solid and the failure modes are concrete. For anyone building compliance-driven systems that must support ongoing unlearning, this changes the architecture question: you may need periodic model retraining rather than continuous surgical removal.

arXiv cs.CLPaper

The More Popular, The Harder to Forget: Adaptive Popularity for LLM Unlearning

Popular facts are harder to unlearn because they're memorized more deeply, and uniform gradient pressure doesn't work. AdaPop scales the forget pressure by fact popularity (via Wikidata or LLM-as-Judge) and auto-tunes the retain balance. The leakage reduction is substantial: 5x under paraphrase, 1.6x under adversarial rewording. If you're building unlearning pipelines to comply with data-deletion requests or privacy regulations, this is the strongest method to date. This is becoming a real regulatory requirement, so the timing matters.