ArmorAll: Compiler-based Resilience Targeting GPU Applications

[n.d.]. Enabling on-the-fly manipulations with LLVM IR code of CUDA sources. Retrieved from https://github.com/apc-llc/nvcc-llvm-ir.

Alfred V. Aho, Ravi Sethi, and Jeffrey D. Ullman. 1986. Compilers: Principles, Techniques, and Tools. Addison-Wesley Longman Publishing Co., Inc., Boston, MA.

E. Alerstam, T. Svensson, and S. Andersson-Engels. 2008. Parallel computing with graphics processing units for high-speed Monte Carlo simulation of photon migration. Journal of Biomedical Optics 13, 6, Article 060504 (2008) https://doi.org/10.1117/1.3041496

W. Bartlett and L. Spainhower. 2004. Commercial fault tolerance: A tale of two systems. IEEE Transactions on Dependable and Secure Computing 1, 1 (Jan. 2004), 87--96.

Ian Briggs, Arnab Das, Mark Baranowski, Vishal Sharma, Sriram Krishnamoorthy, Zvonimir Rakamariundefined, and Ganesh Gopalakrishnan. 2019. FailAmp: Relativization transformation for soft error detection in structured address generation. ACM Transactions on Architecture and Code Optimization 16, 4, Article 50 (Dec. 2019), 21 pages.

Ron Cytron, Jeanne Ferrante, Barry K. Rosen, Mark N. Wegman, and F. Kenneth Zadeck. 1991. Efficiently computing static single assignment form and the control dependence graph. ACM Transactions on Programming Languages and Systems 13, 4 (Oct. 1991), 451--490.

Moslem Didehban and Aviral Shrivastava. 2016. NZDC: A compiler technique for near zero silent data corruption. In Proceedings of the 53rd Annual Design Automation Conference (DAC).

Martin Dimitrov, Mike Mantor, and Huiyang Zhou. 2009. Understanding software approaches for GPGPU reliability. In Proceedings of the 2nd Workshop on General Purpose Processing on Graphics Processing Units (GPGPU-2). ACM, New York, NY, 94--104.

Jack Dongarra, Pete Beckman, Terry Moore, Patrick Aerts, Giovanni Aloisio, Jean-Claude Andre, David Barkai, Jean-Yves Berthou, Taisuke Boku, Bertrand Braunschweig, Franck Cappello, Barbara Chapman, Xuebin Chi, Alok Choudhary, Sudip Dosanjh, Thom Dunning, Sandro Fiore, Al Geist, Bill Gropp, Robert Harrison, Mark Hereld, Michael Heroux, Adolfy Hoisie, Koh Hotta, Zhong Jin, Yutaka Ishikawa, Fred Johnson, Sanjay Kale, Richard Kenway, David Keyes, Bill Kramer, Jesus Labarta, Alain Lichnewsky, Thomas Lippert, Bob Lucas, Barney Maccabe, Satoshi Matsuoka, Paul Messina, Peter Michielse, Bernd Mohr, Matthias S. Mueller, Wolfgang E. Nagel, Hiroshi Nakashima, Michael E. Papka, Dan Reed, Mitsuhisa Sato, Ed Seidel, John Shalf, David Skinner, Marc Snir, Thomas Sterling, Rick Stevens, Fred Streitz, Bob Sugar, Shinji Sumimoto, William Tang, John Taylor, Rajeev Thakur, Anne Trefethen, Mateo Valero, Aad Van Der Steen, Jeffrey Vetter, Peg Williams, Robert Wisniewski, and Kathy Yelick. 2011. The international exascale software project roadmap. International Journal of High Performance Computing Applications 25, 1 (Feb. 2011), 3--60.

Shuguang Feng, Shantanu Gupta, Amin Ansari, and Scott Mahlke. 2010. Shoestring: Probabilistic soft error reliability on the cheap. In Proceedings of the 15th Edition of ASPLOS on Architectural Support for Programming Languages and Operating Systems (ASPLOS XV). ACM, New York, NY, 385--396.

Rohan Garg, Apoorve Mohan, Michael Sullivan, and Gene Cooperman. 2018. CRUM: Checkpoint-restart support for CUDA’s unified memory. In Proceedings of the IEEE International Conference on Cluster Computing (Cluster’18).

Scott Grauer-Gray, William Killian, Robert Searles, and John Cavazos. 2013. Accelerating financial applications on the GPU. In Proceedings of the 6th Workshop on General Purpose Processor Using Graphics Processing Units (GPGPU-6). ACM, New York, NY, 127--136.

M. Gupta, D. Lowell, J. Kalamatianos, S. Raasch, V. Sridharan, D. Tullsen, and R. Gupta. 2017. Compiler techniques to reduce the synchronization overhead of GPU redundant multithreading. In 2017 54th ACM/EDAC/IEEE Design Automation Conference (DAC). 1--6.

H. Jeon and M. Annavaram. 2012. Warped-DMR: Light-weight error detection for GPGPU. In 2012 45th Annual IEEE/ACM International Symposium on Microarchitecture. 37--47.

Manolis Kaliorakis, Sotiris Tselonis, Athanasios Chatzidimitriou, and Dimitris Gizopoulos. 2015. Accelerated microarchitectural fault injection-based reliability assessment.

Charu Kalra. 2015. MS Thesis: Design and Evaluation of Register Allocation on GPUs. Master’s Thesis. Northeastern University.

Charu Kalra. 2019. Compiler-based Resilience Prediction and Enhancements for GPU Applications. Ph.D. Dissertation. Northeastern University.

Charu Kalra, Daniel Lowell, John Kalamatianos, Vilas Sridharan, and David Kaeli. 2016. Performance evaluation of compiler-based software rmt in an hsa environment. In The 12th Workshop on Silicon Errors in Logic-System Effects, SELSE.

Charu Kalra, Fritz Previlon, Xiangyu Li, Norman Rubin, and David Kaeli. 2018. Analyzing the vulnerability of vector-scalar execution on data-parallel architectures. In The 14th Workshop on Silicon Errors in Logic - System Effects, SELSE.

Charu Kalra, Fritz Previlon, Xiangyu Li, Norman Rubin, and David Kaeli. 2018. PRISM: Predicting resilience of GPU applications using statistical methods. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC’18). IEEE Press, Piscataway, NJ, Article 69, 14 pages. http://dl.acm.org/citation.cfm?id=3291656.3291748

Andrew Kerr, Gregory Diamos, and Sudhakar Yalamanchili. 2009. A characterization and analysis of PTX kernels. In Proceedings of the 2009 IEEE International Symposium on Workload Characterization (IISWC’09). IEEE Computer Society, Washington, DC, 3--12.

Junsung Kim, Hyoseung Kim, Karthik Lakshmanan, and Ragunathan Rajkumar. 2013. Parallel scheduling for cyber-physical systems: Analysis and case study on a self-driving car. In Proceedings of the ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS).

R. Koo and S. Toueg. 1987. Checkpointing and rollback-recovery for distributed systems. IEEE Transactions on Software Engineering SE-13, 1 (Jan 1987), 23--31.

Chris Lattner and Vikram Adve. 2004. LLVM: A compilation framework for lifelong program analysis 8 transformation. In International Symposium on Code Generation and Optimization (CGO’04). IEEE, 75--86.

R. Leveugle, A. Calvez, P. Maistri, and P. Vanhauwaert. 2009. Statistical fault injection: Quantified error and confidence. In Design, Automation Test in Europe Conference Exhibition (DATE’09). 502--506.

G. Li, K. Pattabiraman, C. Y. Cher, and P. Bose. 2016. Understanding error propagation in GPGPU applications. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. 240--251.

Guanpeng Li, Karthik Pattabiraman, Siva Kumar Sastry Hari, Michael Sullivan, and Timothy Tsai. 2018. Modeling soft-error propagation in programs. In IEEE/IFIP International Conference on Dependable Systems and Networks (DSN). IEEE.

Robert Lucas, James Ang, Keren Bergman, and Shekhar et al. Borkar. 2014. Top Ten Exascale Research Challenges. http://science.energy.gov/ /media/ascr/ascac/pdf/meetings/20140210/Top10reportFEB14.pdf.

Abdulrahman Mahmoud, Siva Hari, Mike Sullivan, Timothy Tsai, and Steve Keckler. 2018. Optimizing software-directed instruction replication for GPU error detection. In International Conference for High-Performance Computing, Networking, Storage and Analysis (SC).

Jose Maiz, Scott Hareland, Kevin Zhang, and Patrick Armstrong. 2003. Characterization of multi-bit soft error events in advanced SRAMs. In IEEE International Technical Digest Electron Devices Meeting (IEDM’03). IEEE, 21--4.

Mei-Chen Hsueh, T. K. Tsai, and R. K. Iyer. 1997. Fault injection techniques and tools. Computer 30, 4, 75--82.

Harshitha Menon, Michael O. Lam, Daniel Osei-Kuffuor, Markus Schordan, Scott Lloyd, Kathryn Mohror, and Jeffrey Hittinger. 2018. ADAPT: Algorithmic differentiation applied to floating-point precision tuning. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC’18). IEEE Press, Piscataway, NJ, Article 48, 13 pages. http://dl.acm.org/citation.cfm?id=3291656.3291720

Shubu Mukherjee. 2011. Architecture Design for Soft Errors. Morgan Kaufmann.

Bin Nie, Lishan Yang, Adwait Jog, and Evgenia Smirni. 2018. Fault site pruning for practical reliability analysis of gpgpu applications. In 2018 51st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO). IEEE, 749--761.

NVIDIA. [n.d.]. CUDA binary utilities. Retrieved from http://docs.nvidia.com/cuda/pdf/CUDA-Binary-Utilities.pdf.

NVIDIA. [n.d.]. NVCC, https://developer.nvidia.com/cuda-llvm-compiler.

NVIDIA. [n.d.]. NVIDIA, CUDA SDK, V6.0.

NVIDIA. [n.d.]. NVIDIA Kepler GK110 architecture white paper.

NVIDIA. [n.d.]. Tegra K1 techinical reference manual.

Hamza Omar, Qingchuan Shi, Masab Ahmad, Halit Dogan, and Omer Khan. 2018. Declarative resilience: A holistic soft-error resilient multicore architecture that trades off program accuracy for efficiency. ACM Transactions on Embedded Computing Systems 17, 4, Article 76 (July 2018), 27 pages.

Fritz G. Previlon, Babatunde Egbantan, Devesh Tiwari, Paolo Rech, and David R. Kaeli. 2017. Combining architectural fault-injection and neutron beam testing approaches toward better understanding of GPU soft-error resilience. In 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS). IEEE, 898--901.

Fritz G. Previlon, Charu Kalra, David R. Kaeli, and Paolo Rech. 2019. A comprehensive evaluation of the effects of input data on the resilience of GPU applications. In 2019 IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems (DFT). IEEE, 1--6.

Fritz G. Previlon, Charu Kalra, Devesh Tiwari, and David R. Kaeli. 2019. PCFI: Program counter guided fault injection for accelerating GPU reliability assessment. In 2019 Design, Automation Test in Europe Conference Exhibition (DATE). 308--311.

Sandra Rapps and Elaine J. Weyuker. 1982. Data flow analysis techniques for test data selection. In Proceedings of the 6th International Conference on Software Engineering (ICSE’82). IEEE Computer Society Press, Los Alamitos, CA, 272--278. http://dl.acm.org/citation.cfm?id=800254.807769

G. A. Reis, J. Chang, N. Vachharajani, R. Rangan, and D. I. August. 2005. SWIFT: Software implemented fault tolerance. In International Symposium on Code Generation and Optimization. 243--254.

Siva Kumar Sastry Hari, Timothy Tsai, Mark Stephenson, Steve Keckler, and Joel Emer. 2017. SASSIFI: An architecture-level fault injection tool for GPU application resilience evaluation. In 2017 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS). 249--258.

Michael C. Schatz, Cole Trapnell, Arthur L. Delcher, and Amitabh Varshney. 2007. High-throughput sequence alignment using graphics processing units. BMC Bioinformatics 8, 1 (2007), 1--10.

Mark Stephenson, Siva Kumar Sastry Hari, Yunsup Lee, Eiman Ebrahimi, Daniel R. Johnson, David Nellans, Mike O’Connor, and Stephen W. Keckler. 2015. Flexible software profiling of GPU architectures. In Proceedings of the 42nd Annual International Symposium on Computer Architecture (ISCA’15). ACM, New York, NY, 185--197.

J. E. Stone, J. C. Philips, P. L. Freddolino, D. J. Hardy, L. G. Trabuco, and K. Schulten. 2007. Accelerating molecular modeling applications with graphics processors. Journal of Computational Chemistry 28 (2007), 2618--2640.

Michael B. Sullivan, Siva Kumar Sastry Hari, Brian Zimmer, Timothy Tsai, and Stephen W. Keckler. 2018. SwapCodes: Error codes for hardware-software cooperative GPU pipeline error detection. In 2018 51st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO). IEEE, 762--774.

Jingweijia Tan and Xin Fu. 2012. RISE: Improving the streaming processors reliability against soft errors in Gpgpus. In Proceedings of the 21st International Conference on Parallel Architectures and Compilation Techniques (PACT’12). ACM, New York, NY, 191--200.

Yash Ukidave, Fanny Nina Paravecino, Leiming Yu, Charu Kalra, Amir Momeni, Zhongliang Chen, Nick Materise, Brett Daley, Perhaad Mistry, and David Kaeli. 2015. NUPAR: A benchmark suite for modern GPU architectures. In Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering (ICPE’15). ACM, New York, NY, 253--264.

Dani Voitsechov, Arslan Zulfiqar, Mark Stephenson, Mark Gebhart, and Stephen W. Keckler. 2018. Software-directed techniques for improved GPU register file utilization. ACM Transactions on Architecture and Code Optimization (TACO) 15, 3, 38.

Jack Wadden, Alexander Lyashevsky, Sudhanva Gurumurthi, Vilas Sridharan, and Kevin Skadron. 2014. Real-world design and evaluation of compiler-managed GPU redundant multithreading. In Proceeding of the 41st Annual International Symposium on Computer Architecture. IEEE Press, 73--84.