SPADE-KD: Peer-to-Peer Collaborative Learning under Heterogeneous Settings
Peer-to-peer collaborative learning is an emerging distributed deep learning paradigm that eliminates the need for a central aggregator and disseminator, avoiding the single-point-of-failure and bottleneck issues they can bring.
arXiv cs.LG2 min read