会员服务
Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization
Arxiv
0+阅读 · 9月30日
ADAM: A Diverse Archive of Mankind for Evaluating and Enhancing LLMs in Biographical Reasoning
Arxiv
0+阅读 · 9月26日
Empirical Validation of Functional Multidimensional Scaling via Numerical Simulation and Real-World Application
Arxiv
0+阅读 · 5月20日
Continuous-Time Analysis of Heavy Ball Momentum in Min-Max Games
Arxiv
0+阅读 · 5月26日
Better Embeddings with Coupled Adam
Arxiv
0+阅读 · 8月1日
Generalised Reachability Games Revisited
Arxiv
0+阅读 · 9月17日
Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)
Arxiv
0+阅读 · 5月19日
Adam Exploits $\ell_\infty$-geometry of Loss Landscape via Coordinate-wise Adaptivity
Arxiv
0+阅读 · 6月11日
The Epochal Sawtooth Phenomenon: Unveiling Training Loss Oscillations in Adam and Other Optimizers
Arxiv
0+阅读 · 6月18日
The Epochal Sawtooth Effect: Unveiling Training Loss Oscillations in Adam and Other Optimizers
Arxiv
0+阅读 · 5月22日
Purifying Shampoo: Investigating Shampoo's Heuristics by Decomposing its Preconditioner
Arxiv
0+阅读 · 6月4日
Understanding and Improving the Shampoo Optimizer via Kullback-Leibler Minimization
Arxiv
0+阅读 · 9月3日
Architect Your Landscape Approach (AYLA) for Optimizations in Deep Learning
Architect Your Landscape Approach (AYLA) for Optimizations in Deep Learning
Arxiv
0+阅读 · 4月2日
Spectral-factorized Positive-definite Curvature Learning for NN Training
Arxiv
0+阅读 · 3月28日
Stochastic Gradient Sampling for Enhancing Neural Networks Training
Arxiv
0+阅读 · 3月18日
参考链接
微信扫码咨询专知VIP会员
Top