The mismatch between crisp knowledge graphs and probabilistic foundation models is real, and this paper identifies a genuine architectural gap. For agents doing planning or multi-step reasoning, reasoning over explicit beliefs with Bayesian updates could be more reliable than token prediction alone. The technical question is whether this pays off in practice; the authors sketch use cases but don't ship code or benchmark against real agent tasks. Worth tracking if someone implements this end-to-end.
This is important validity work that cuts through overstated agent claims. If you're using or building code agents for security, the finding on patch memorization and surface-level fixes means you need to audit outputs for root-cause fixes, not just PoC suppression. The methodology here is a model for skeptical agent evaluation.
This is the kind of systems-level optimization that compounded over millions of inference calls becomes real cost and latency savings. The insight is elegant: use existing model signals for cache eviction rather than observing attention patterns that don't exist yet. If you're running Kimi Linear or similar models at scale, this is immediately applicable. For inference infrastructure builders, this shows where the next efficiency gains live: not in architecture, but in reading what the architecture already learned.
Blackwell is shipping now and naive FP4 attention doesn't auto-unlock speed gains. This paper shows how: Direct-P for inference, causal paths with FP8 gradients for training. For teams running large models on Blackwell hardware, this translates directly to wall-clock gains. The 1.14x single-GPU update speedup is real money. Implementation details matter here, so read carefully or grab the code.
Infrastructure capital is flowing to companies that own compute density. Crusoe's valuation signals that data center operators with custom silicon and renewable energy integration are now priced like core infra, not vendors. For builders: this means GPU availability and per-token costs will improve faster than the frontier labs expected. For investors: compute supply is becoming less constrained than model capability, which redraws the margin stack.