Progressive Misalignment Can Emerge from Benign Recursive Self-Distillation

Training models on their own outputs has attracted widespread attention as a possible route to advance AI capabilities. One prominent approach is self-distillation, where a model is trained to match the token-level predictions it would have produced when given access to additional context, such as…

Analyze with AIAnalyze with ChatGPTAnalyze with ClaudeAnalyze with PerplexityAnalyze with Google AI ModeAnalyze with GrokAnalyze with Microsoft Copilot