Spectrum of the Neural Tangent Kernel in a quadratic scaling
When
3 – 4 p.m., March 5, 2025
Where
MATH Room 402
Title: Spectrum of the Neural Tangent Kernel in a quadratic scaling
Abstract: Despite their surplus of parameters, modern deep learning models often generalize well, a phenomenon exemplified by the "double descent curve." While this behavior is theoretically grasped for problems such as ridge regression under linear scaling of dimensions, intriguing phenomenon emerge under quadratic scaling, where sample size equals parameter count. In this presentation, we study the eigenvalues of the Neural Tangent Kernel, a matrix model pertinent to wide neural networks trained via gradient descent, within this quadratic regime.