arXiv cs.CLPaper
ShallowStream: Index Shallow then Answer Deep for Streaming Video Understanding
This targets a real deployment constraint: streaming video through a full multimodal model is prohibitively expensive. Reusing shallow layers for indexing while deferring deep reasoning is architecturally sound. But the excerpt cuts off before results, so the signal here is incremental: yet another token-reduction technique in a crowded space. Check the full paper to see if the throughput gains justify the added complexity.