PRIME: Frequency-Aware Unified Pruning and Merging for MoE Compression
Mixture-of-Experts (MoE) models have emerged as an effective paradigm for scaling large language models, yet their massive parameter footprint poses severe memory challenges for deployment.
arXiv cs.LG2 min read
