Announcement_8
Our paper D²-OPD: Separating Direction and Distance in Extrapolative On-Policy Distillation is now on arXiv! This work from my Amazon AGI internship improves language-model distillation by separating where to extrapolate from how far to move.
Enjoy Reading This Article?
Here are some more articles you might like to read next: