arXiv cs.CLPaper
EarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction
Agent evaluation budgets are strangling iteration cycles. This work identifies a real bottleneck: most agent runs fail predictably, and catching them early saves the cost of full frontier model execution. The method is lightweight and doesn't require architectural changes. If this holds in practice, builders can now run agent benchmarks without burning through hundreds of dollars per iteration, which unlocks more aggressive hyperparameter search and ablation studies.