arXiv cs.CLPaper
$Φ$-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them?
This is a direct test of something you're probably wondering about: can LLMs actually help optimize their own stack, or are they stuck pattern-matching on toy problems? The benchmark is grounded in real research and code, not synthetic tasks, which means results here will be actionable. If frontier models show competence at end-to-end optimization, infrastructure teams should start treating LLM-assisted engineering as a real multiplier on velocity.