T
Jul 2, 2026Two new papers push 'on-policy distillation' to fix privileged teachers and merge specialist skills
DOPD and MOPD advance on-policy distillation -- training a student on its own outputs -- with DOPD routing supervision to avoid a 'privilege illusion' and MOPD merging multiple specialist RL teachers into one model without cross-domain interference.
Jul 2, 20263 min read0 reactions0 comments