GRAM: Group-wise Rank-Aware Model Merging via Subspace Alignment
Merging different models into a single model is highly desirable for multi-task deployment, particularly in regulated domains like healthcare. In such settings, models are often locally fine-tuned due to strict data privacy policies, necessitating that aggregation operates exclusively on the…
arXiv - cs.AI2 min read