arXiv cs.CLPaper
Matryoshka Language Model Suites
This is a real infra efficiency gain for anyone maintaining a model suite across sizes, since it collapses separate training runs into one nested pipeline and gets speculative decoding almost for free. Worth watching if you're running multi-size deployments and want to cut both training and serving costs, though it needs validation at larger scales before it changes production defaults.