Back

From Muon to Gradient Clipping: Some Thoughts on QK Stability

14 points6 daysmastergodzilla.github.io