VISTA: Verifier-Informed Student-to-Teacher Adaptation for On-Policy Self-Distillation
Reasoning quality matters more each month, and this hits the real problem with current self-distillation: the teacher can mislead the student. The two-way adaptation is smart and the empirical gains look solid. This is worth testing if you're tuning a reasoning model for production.