Transformers as In-Context Samplers: From Closed-Form Diffusion to Estimation-Free Sampling
The theoretical contribution is clean: transformers can implement sampling algorithms without parameter updates. But the practical signal is less clear. This is foundational understanding of what in-context learning can do, not a technique you'd use to build something. Worth reading if you care about the theory of why transformers work.