Reproducing and Comparing Distillation Techniques for Cross-Encoders
Victor Morand, Mathias Vast, Basile Van Cooten, Laure Soulier, Josiane Mothe, Benjamin Piwowarski, arXiv preprint, 2026
We reproduce and compare different distillation strategies for cross-encoders across a wide range of architectures, identifying robust design choices for effective re-ranking.
