You Don't Need Aligned Representations: Knowledge Distillation via Random Prototype Spaces
A widely held assumption in knowledge distillation is that teacher and student representations must occupy a compatible or explicitly aligned feature space.
By Hamza Etcibasi, Ramazan Gokberk CinbisarXiv - cs.CV (CV)
Read the full story
Originally published by arXiv - cs.CV (CV) on Oct 30, 2026.
Comments
Sign in to join the discussion.