LoRazor: Trimming Adapter Execution for Efficient Multi-LoRA Serving
LoRA offers a parameter-efficient adaptation strategy, supporting multi-user workloads via customized adapters on a shared backbone. However, serving concurrent requests with different adapters introduces substantial computation and memory-management overhead.
arXiv - cs.AI2 min read