RL5 min read
LoReFT GRAFT Better at Preventing RL Grift
tl;dr. I show that the recently introduced GRAFT method can be improved upon by using a single layer rank 1 Low-rank Linear Subspace Representation Fine Tuning (LoReFT) adapter as the FORGET adapter, using only 0.029% of the parameters of the one used in the GRAFT paper.
By Samuel KnocheLessWrong

Read the full story
Originally published by LessWrong on Oct 24, 2026.
Comments
Sign in to join the discussion.