Progressive Multi-Ancestor Bit-Depth Distillation

Model compression strategies are widely employed to reduce memory footprint and network complexity, particularly for devices with constrained computational, memory, and energy resources.