ReLU2 min read
Gradient Descent on Two ReLU Neurons: Global Landscape and Bifurcation Dynamics
Understanding how gradient descent learns features remains a central challenge in neural network theory. We study this question in a minimal multi-index setting that already exhibits rich multi-phase gradient dynamics: a well-specified two-neuron ReLU teacher-student model under isotropic Gaussian…
By Binghua Li, Mengzhe Li, Denny Wu, Tianhao WangarXiv - stat.ML
Read the full story
Originally published by arXiv - stat.ML on Nov 2, 2026.
Comments
Sign in to join the discussion.