ArtificialIntelligence.io

The Signal

Everything that matters in AI, with our take.

Updated through the day. Every headline links straight to the source. The two lines underneath are ours.

Hacker News (AI, 50+ points)Article

Tao: Open math problems being non-renewably mined by AI

A mathematician at the frontier just said AI is consuming the training data that mathematicians rely on. This isn't abstract: if AI systems mine difficult unsolved problems and those problems get published and incorporated into training sets, the renewal cycle breaks. For builders in the math-AI space, this is a signal to start thinking about synthetic problem generation. For labs, it's a hint that your pretraining pool might be shallower than you think.

Hacker News (AI, 50+ points)Article

AirTag reveals Amazon is trashing rare books to train AI

This is a data-sourcing problem at scale, and it's now documented. Amazon's discarding of rare books suggests a breakdown in data curation or a cost-cutting measure that assumes availability outweighs quality. For builders using commodity training data: this signals the data pipeline is getting messier. For companies reliant on Amazon for anything: expect regulatory attention and contractual friction if this practice spreads.

arXiv cs.CLPaper

REER-PT: Reverse-Engineered Reasoning for Perplexity-Guided Pre-training Data Augmentation

This attacks a real bottleneck: high-quality reasoning data for pre-training. Instead of expensive synthetic rollouts during training, the method tags continuations offline and inserts annotations that show the missing step. It's sparse and compatible with standard next-token prediction. For labs scaling training, this is immediately applicable and should improve reasoning capability per token. The perplexity-guided signal is a smart way to automate curation. This is the kind of data engineering that moves capability needles.

Hacker News (AI, 50+ points)Article

AI companies destroy physical books – let's scan rare books before it's too late

This is a niche but real friction point in the data supply chain feeding training corpora, and the destructive scanning claim, if verified, is the kind of story that regulators and publishers will seize on in copyright fights. Worth noting for anyone tracking the provenance and ethics side of training data, but treat the underlying claim as unverified until independently corroborated.

TechCrunch AIArticle

AI data startup Micro1 reaches $500M gross run rate amid AI training boom

Data labeling economics are booming again as post-training and RLHF pipelines scale, and a $500M run rate from a single vendor shows how much money is flowing into the unglamorous middle layer of the AI stack. For investors, this is a signal that the data-labeling category still has room before commoditization, though margins in this space have historically compressed fast once incumbents scale.

arXiv cs.CLPaper

Institutional Books - Enriched Text: A customizable multilingual open-source pipeline for denoising, deduplicating, and annotating OCR text at scale

This is genuinely useful infrastructure for anyone training on large historical text corpora, since most pipelines destroy metadata that scholars and some downstream tasks need. Worth a look if you're building on Institutional Books or similar OCR-heavy corpora, less relevant if you're not touching pretraining data curation directly.

Hacker News (AI, 50+ points)Article

We Tracked a Shipment of Rare Books. It Ended at an Amazon AI Training Facility

This is investigative journalism landing on what many in the industry already knew: training data collection is industrial and poorly labeled. It's evidence, not a surprise. For builders, it underscores the data provenance problem that models trained on web-scale text will eventually face. For platforms, it's a reputational risk if your data sourcing becomes public. The real question is whether this drives actual policy change, which the article doesn't answer.

TechCrunch AIArticle

Amazon will train on Twitch streamers’ content by default, unless they opt out

Twitch's own CPO admitted the quiet part: opt-in would kill participation, so the default gets flipped to capture data at scale. This is the standard playbook for platforms sitting on troves of creator content, and it will spread to every platform with user-generated video or audio it can monetize for training. For builders sourcing training data, watch for a wave of similar policy changes and the lawsuits that follow.

Lilian WengArticleoriginally Feb 2024

Thinking about High-Quality Human Data

Data quality is the unsexy bottleneck everyone in ML knows about and few want to fix, and Weng lays out the mechanics of annotator disagreement, rater calibration, and aggregation methods clearly. If you're running an RLHF or preference-labeling pipeline, the practical guidance on annotator selection and quality control is directly usable. Not a headline story, but a solid reference for anyone building alignment infrastructure.