arXiv cs.CLPaper
Flide: Accelerating Decision Inference with Exact State Forking
Decision models (like Jev) are becoming the baseline for reliable agentic reasoning, and Flide makes them practical at scale. The innovation is that it lets you fork execution paths in a single token stream without recomputing shared prefix, which matters when your agent explores multiple choices. If you're deploying decision-model agents, this infrastructure layer directly improves throughput and latency. Worth tracking when it becomes available outside research.