arXiv cs.CLPaper
Through the Looking Glass: Directly Reading and Writing Transformers
This is mechanistic work that changes how you think about what a transformer actually does. The finding that you can remove 99% of the model and still produce a prediction means sparse evaluation and adaptive computation are not speculative anymore, they're based on evidence about how these models work. For inference optimization, this is a map you can navigate from.