Feb 1, 2023 · SP (Stochastic Polyak step size) can be interpreted as a method specialized to interpolated models since it solves the interpolation equations.
Recently the SP (Stochastic Polyak step size) method has emerged as a competitive adaptive method for setting the step sizes of SGD.
Abstract: Recently the SP (Stochastic Polyak step size) method has emerged as a competitive adaptive method for setting the step sizes of SGD.
SP2 : A second order stochastic Polyak method. In The Eleventh International ... Compared to first-order algorithms, second-order methods typically yield faster ...
SP2 : A second order stochastic Polyak method. In The Eleventh International Conference on Learning. Representations, 2023. URL https://openreview.net/forum ...
Sp2: A second order stochastic polyak method. arXiv preprint arXiv:2207.08171, 2022. 12. Page 13. [32] Tian Li, Anit Kumar Sahu, Manzil Zaheer, Maziar Sanjabi ...
Dec 28, 2023 · SP2 : A second order stochas- tic polyak method. In The Eleventh International. Conference on Learning Representations. Li, X. and Orabona, F ...
SP2 : A Second Order Stochastic Polyak Method · Shuang Li, William Joseph Swartworth, Martin Takáč, Deanna Needell, Robert M. Gower. Published: 01 Feb 2023 ...
SP2 : A Second Order Stochastic Polyak Method · Shuang Li, William Joseph Swartworth, Martin Takáč, Deanna Needell, Robert M. Gower. Published: 01 Feb 2023 ...
SP2: A second order stochastic Polyak method. arXiv preprint arXiv:2207.08171, 2022. Cited on 2. Jinxiu Liang, Yong Xu, Chenglong Bao, Yuhui Quan, and Hui Ji ...