Know a great AI tool or AI news source? Submit it to AiByts
ReLU2 min read

Gradient Descent on Two ReLU Neurons: Global Landscape and Bifurcation Dynamics

Understanding how gradient descent learns features remains a central challenge in neural network theory. We study this question in a minimal multi-index setting that already exhibits rich multi-phase gradient dynamics: a well-specified two-neuron ReLU teacher-student model under isotropic Gaussian…

By Binghua Li, Mengzhe Li, Denny Wu, Tianhao WangarXiv - stat.ML

Read the full story

Originally published by arXiv - stat.ML on Nov 2, 2026.

Read on arXiv - stat.ML(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.