HyperRepair: Recovering Forgotten General Capabilities of Fine-Tuned Language Models
Fine-tuning improves a language model's performance in a target domain but can weaken its general capabilities. Existing methods often face a trade-off between general capabilities and domain specialization, making it difficult to preserve both.
arXiv - cs.CL (NLP)2 min read