Energy-Efficient Iterative Refinement Using Dynamic Precision

• Published in: IEEE journal on emerging and selected topics in circuits and systems Vol. 8; no. 4; pp. 722 - 735
• Main Authors: Lee, JunKyu, Vandierendonck, Hans, Arif, Mahwish, Peterson, Gregory D., Nikolopoulos, Dimitrios S.
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.12.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Approximation algorithms; Circuits and systems; dynamic algorithm; dynamic precision; Energy conservation; Energy management; energy savings; Heuristic algorithms; Iterative algorithms; Iterative methods; iterative refinement; Numerical methods; Parallel processing; Runtime; Transprecision
• ISSN: 2156-3357; 2156-3365
• DOI: 10.1109/JETCAS.2018.2850665

Mixed precision is a promising approach to save energy in iterative refinement algorithms since it obtains speed-up without necessitating additional cores and parallelization. However, conventional mixed precision methods utilize statically defined precision in a loop, thus hindering further speed-up and energy savings. We overcome this problem by proposing novel methods which allow iterative refinement to utilize variable precision arithmetic dynamically in a loop (i.e., a trans-precision approach). Our methods restructure a numeric algorithm dynamically according to runtime numeric behavior and remove unnecessary accuracy checks. We implemented our methods by extending one conventional mixed precision iterative refinement algorithm on an Intel Xeon E5-2650 2GHz core with MKL 2017 and XBLAS 1.0. Our dynamic precision approach demonstrates 2.0-2.6× speed-up and 1.8-2.4× energy savings compared with mixed precision iterative refinement when double precision solution accuracy is required for forward error and with matrix dimensions ranging from 4K to 32K.