MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
Paper • 2606.30406 • Published • 25
Distillation
-
-
TurnOPD: Making On-Policy Distillation Turn-Aware for Efficient Long-Horizon Agent Training
Paper • 2607.05804 • Published • 21 -
Trust Region Policy Distillation
Paper • 2607.04751 • Published • 37 -
SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning
Paper • 2607.14777 • Published • 108 -
ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation
Paper • 2607.13124 • Published • 20 -
Visual Contrastive Self-Distillation
Paper • 2607.21556 • Published • 53 -
From Proprietary to Open-Source: Bridging the Distribution Gap via Multi-Agent Protocol Distillation in Agentic Search
Paper • 2607.24280 • Published • 85 -
Pass the Baton: Trajectory-Relayed On-Policy Distillation
Paper • 2607.26057 • Published • 34 -
Enhancing Rubric-based RL via Self-Distillation
Paper • 2607.18082 • Published • 25 -
AgentOPSD: Recursive Self-Distillation for Agentic Reinforcement Learning
Paper • 2608.05987 • Published • 102 -
Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory
Paper • 2608.07169 • Published • 50 -
SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation
Paper • 2608.04419 • Published • 29 -
Self-Supervised Visual On-Policy Distillation
Paper • 2608.14144 • Published • 170 -
Latent On-Policy Self-Distillation
Paper • 2608.13040 • Published • 25 -
SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning
Paper • 2608.14277 • Published • 35 -
D^3-MOPD: Adaptive Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation
Paper • 2608.24987 • Published • 28 -
Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement
Paper • 2608.31046 • Published • 154 -
Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills
Paper • 2609.02749 • Published • 546 -
Rethinking On-Policy Distillation of Large Language Models II: One Training Example
Paper • 2609.04172 • Published • 95 -
Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation
Paper • 2609.02998 • Published • 20 -
Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation
Paper • 2609.08798 • Published • 93