Ramanujan Challenge Results: AI-Assisted Evaluation Pipeline for Multi-Format Proofs
The Ramanujan Challenge moves the goalposts on mathematical capability benchmarks. This is the first time AI has solved open conjectures, which is real progress, but the harder story is the evaluation problem. As models get better at mathematics, humans can't keep up with grading. The AI-assisted evaluation pipeline they built is probably as important as the benchmark itself. For builders in math or verification: this is the infrastructure you'll need.