Mixed-Precision Kernel Recursive Least Squares

JK Lee, DS Nikolopoulos… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
IEEE Transactions on Neural Networks and Learning Systems, 2020ieeexplore.ieee.org
Kernel recursive least squares (KRLS) is a widely used online machine learning algorithm
for time series predictions. In this article, we present the mixed-precision KRLS, producing
equivalent prediction accuracy to double-precision KRLS with a higher training throughput
and a lower memory footprint. The mixed-precision KRLS applies single-precision arithmetic
to the computation components being not only numerically resilient but also computationally
intensive. Our mixed-precision KRLS demonstrates the 1.32, 1.15, 1.29, 1.09, and training …
Kernel recursive least squares (KRLS) is a widely used online machine learning algorithm for time series predictions. In this article, we present the mixed-precision KRLS, producing equivalent prediction accuracy to double-precision KRLS with a higher training throughput and a lower memory footprint. The mixed-precision KRLS applies single-precision arithmetic to the computation components being not only numerically resilient but also computationally intensive. Our mixed-precision KRLS demonstrates the 1.32, 1.15, 1.29, 1.09, and training throughput improvements using 24.95%, 24.74%, 24.89%, 24.48%, and 24.20% less memory footprint without losing any prediction accuracy compared to double-precision KRLS for a 3-D nonlinear regression, a Lorenz chaotic time series, a Mackey-Glass chaotic time series, a sunspot number time series, and a sea surface temperature time series, respectively.
ieeexplore.ieee.org
Showing the best result for this search. See all results