Know a great AI tool or AI news source? Submit it to AiByts
2 min read

What a Weight Update Buys: Leverage Across Training Stages

Post-training moves a language model's weights by about a thousandth of their norm and changes its behavior sharply; pretraining moves them by a third and buys a slow drift.

By Shikhar ShiromaniarXiv cs.LG

Read the full story

Originally published by arXiv cs.LG on Oct 30, 2026.

Read on arXiv cs.LG(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.