IrekoGPT: Turning Structured Pruning into Post-Hoc Slimmable LLMs
We introduce IrekoGPT, a post-hoc method for converting pretrained LLMs into slimmable models whose width can be adjusted at inference time. Building on SliceGPT, we retain its projection matrices without pruning them, allowing a single model to expose nested subnetworks at different widths.
arXiv - stat.ML2 min read