会员服务
Faster Rates for No-Regret Learning in General Games via Cautious Optimism
Arxiv
0+阅读 · 3月31日
Benefits of Learning Rate Annealing for Tuning-Robustness in Stochastic Optimization
Arxiv
0+阅读 · 3月12日
Towards hyperparameter-free optimization with differential privacy
Arxiv
0+阅读 · 3月2日
Gaussian On-the-Fly Splatting: A Progressive Framework for Robust Near Real-Time 3DGS Optimization
Arxiv
0+阅读 · 3月17日
Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
Arxiv
0+阅读 · 3月4日
A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
Arxiv
0+阅读 · 3月17日
Mowgli: Passively Learned Rate Control for Real-Time Video
Arxiv
0+阅读 · 3月18日
Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs
Arxiv
0+阅读 · 2月21日
Exploring Learning Rate Selection in Generalised Bayesian Inference using Posterior Predictive Checks
Arxiv
0+阅读 · 1月21日
Greedy Stein Variational Gradient Descent: An algorithmic approach for wave prospection problems
Arxiv
0+阅读 · 1月31日
Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
Arxiv
0+阅读 · 1月30日
When, Where and Why to Average Weights?
Arxiv
0+阅读 · 2月10日
Training in reverse: How iteration order influences convergence and stability in deep learning
Arxiv
0+阅读 · 2月3日
A Simple and Adaptive Learning Rate for FTRL in Online Learning with Minimax Regret of $Θ(T^{2/3})$ and its Application to Best-of-Both-Worlds
Arxiv
0+阅读 · 2月16日
Dynamic Learning Rate for Deep Reinforcement Learning: A Bandit Approach
Arxiv
0+阅读 · 2月3日
参考链接
微信扫码咨询专知VIP会员
Top