skip to main content
research-article

Use of Iterative Refinement in the Solution of Sparse Linear Systems

Published: 01 April 1982 Publication History

Abstract

It is well known that if Gaussian elimination with iterative refinement (IR) is used in the solution of systems of linear algebraic equations $Ax = b$ whose matrices are dense, then the accuracy of the results will usually be greater than the accuracy obtained by the use of Gaussian elimination without iterative refinement (DS). However, both more storage (about $100\% $, because a copy of matrix A is needed) and more computing time (some extra time is needed to perform the iterative process) must be used with IR. Normally, when the matrix is sparse the accuracy of the solution computed by some sparse matrix technique and IR will still be greater. In this paper it is verified (by many numerical experiments) that the use of sparse matrix techniques with IR may also result in a reduction of both the computing time and the storage requirements (this will never happen when IR is applied for dense matrices). Two parameters, a drop-tolerance $T \geqq 0$ and a stability factor $u > 1$, are introduced in the efforts to achieve such a reduction. By the use of positive values for T some “small” elements are dropped. By the use of $u > 1$ the stability requirements in the popular partial pivoting (where $u = 1$) are relaxed in an attempt to preserve the sparsity of matrix A. The use of a large T and/or a large u leads to an inaccurate factorization, but the accuracy lost is normally regained in the iterative process. Many examples are given in order to compare the use of IR with large values for T and/or u and the use of DS (where both T and u must be small) in the solution of systems whose matrices are large and sparse. The main conclusion is that iterative refinement may effectively be used as an option in many packages for the solution of sparse linear systems.

References

[1]
A˙ke Björck, J. Bunch, D. Rose, Methods for sparse linear least squares problemsSparse matrix computations (Proc. Sympos., Argonne Nat. Lab., Lemont, Ill., 1975), Academic Press, New York, 1976, 177–199
[2]
A˙ke Björck, Comment on the iterative refinement of least-squares solutions, J. Amer. Statist. Assoc., 73 (1978), 161–166
[3]
A˙. Björck, Numerical algorithms for linear least squares problems, Rep., 2, Math. Inst., Univ. of Trondheim, Trondheim, Norway, 1978
[4]
R. J. Clasen, Techniques for automatic tolerance control in linear programming, Comm. ACM, 9 (1966), 802–803
[5]
A. K. Cline, C. B. Moler, G. W. Stewart, J. H. Wilkinson, An estimate for the condition number of a matrix, SIAM J. Numer. Anal., 16 (1979), 368–375
[6]
A. R. Curtis, J. K. Reid, The solution of large sparse unsymmetric systems of linear equations, J. Inst. Math. Appl., 8 (1973), 344–353
[7]
I. S. Duff, MA28—a set of FORTRAN subroutines for sparse unsymmetric matrices, Rep., R8730, A.E.R.E., London, 1977
[8]
I. S. Duff, J. K. Reid, A comparison of some methods for the solution of sparse overdetermined systems of linear equations, J. Inst. Math. Appl., 17 (1976), 267–280
[9]
George E. Forsythe, Michael A. Malcolm, Cleve B. Moler, Computer methods for mathematical computations, Prentice-Hall Inc., Englewood Cliffs, N.J., 1977xi+259
[10]
G. H. Golub, W. Kahan, Calculating the singular values and pseudo-inverse of a matrix, J. Soc. Indust. Appl. Math. Ser. B Numer. Anal., 2 (1965), 205–224
[11]
G. H. Golub, C. Reinsch, Singular value decomposition and least squares solutions, Numer. Math., 14 (1970), 403–420
[12]
G. H. Golub, J. H. Wilkinson, Note on the iterative refinement of least squares solution, Numer. Math., 9 (1966), 139–148
[13]
F. G. Gustavson, D. J. Rose, R. A. Willoughby, Some basic techniques for solving sparse systems of linear equationsSparse Matrices and Their Applications, Plenum Press, New York, 1972, 41–52
[14]
M. Jankowski, H. Wózniakowski, Iterative refinement implies numerical stability, Nordisk Tidskr. Informationsbehandling (BIT), 17 (1977), 303–311
[15]
Harry M. Markowitz, The elimination form of the inverse and its application to linear programming, Management Sci., 3 (1957), 255–269
[16]
N. Munksgaard, Solving sparse symmetric sets of linear equations by preconditioned conjugate gradients, ACM Trans. Math. Software, 6 (1980), 206–219
[17]
S. P. Nørsett, Semi explicitRunge-Kutta methods, Rep., 6, Dept. of Mathematics, Univ. of Trondheim, Trondheim, Norway, 1974
[18]
K. Schaumburg, J. Wasniewski, Use of semiexplicit Runge-Kutta integration algorithm in a spectroscopic problem, Comput. Chem., 2 (1978), 19–24
[19]
K. Schaumburg, J. Wasniewski, Z. Zlatev, Solution of ordinary differential equations with time dependent coefficients. Development of a semi explicit Run ge-Kutta algorithm and application to a spectroscopic problem, Comput. Chem., 3 (1979), 57–63
[20]
K. Schaumburg, J. Wasniewski, Z. Zlatev, The use of sparse matrix technique in the numerical integration of linear ordinary differential equations, Comput. Chem., 4 (1980), 1–12
[21]
G. W. Stewart, Introduction to matrix computations, Academic Press [A subsidiary of Harcourt Brace Jovanovich, Publishers], New York-London, 1973xiii+441
[22]
Reginald P. Tewarson, Sparse matrices, Academic Press, New York, 1973xv+160
[23]
J. H. Wilkinson, Rounding errors in algebraic processes, Prentice-Hall Inc., Englewood Cliffs, N.J., 1963vi+161
[24]
J. H. Wilkinson, The algebraic eigenvalue problem, Clarendon Press, Oxford, 1965xviii+662
[25]
J. H. Wilkinson, D. A. H. Jacobs, Some recent advances in numerical linear algebraThe state of the art in numerical analysis (Proc. Conf., Univ. York, Heslington, 1975), Academic Press, London, 1977, 3–23
[26]
J. H. Wilkinson, D. Jacobs, Singular value decomposition-basic aspectsNumerical Software-Needs and Availability, Academic Press, New York, 1978, 109–135
[27]
Philip Wolfe, L. B. Rall, Error in the solution of linear programming problemsError in Digital Computation, Vol. 2 (Proc. Sympos. Math. Res. Center, U .S. Army, Univ. Wisconsin, Madison, Wis., 1965), Wiley, New York, 1965, 271–284
[28]
Zahari Zlatev, On some pivotal strategies in Gaussian elimination by sparse technique, SIAM J. Numer. Anal., 17 (1980), 18–30
[29]
Z. Zlatev, P. G. Thomsen, Application of backward differentiation methods to the finite element solution of time dependent problems, Internat. J. Numer. Methods Engrg., 14 (1979), 1051–1061
[30]
Z. Zlatev, J. Wasniewski, Package Y12M—solution of large and sparse systems of linear algebraic equations, 1978, Preprint Ser. 24, Math. Inst. Univ. of Copenhagen, Copenhagen, Denmark

Cited By

View all

Index Terms

  1. Use of Iterative Refinement in the Solution of Sparse Linear Systems
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image SIAM Journal on Numerical Analysis
      SIAM Journal on Numerical Analysis  Volume 19, Issue 2
      Apr 1982
      213 pages
      ISSN:0036-1429
      DOI:10.1137/sjnaam.1982.19.issue-2
      Issue’s Table of Contents

      Publisher

      Society for Industrial and Applied Mathematics

      United States

      Publication History

      Published: 01 April 1982

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 08 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      View options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media