ANACIN-X: Analysis and Modeling of Nondeterminism and Associated Costs in eXtreme Scale Applications

Funded by the National Science Foundation (NSF) under grants number 1900888 and 1900765


Nondeterminism is a growing and often forgotten challenge for HPC execution. In order to approach this problem, this project has four main goals:
Model non-deterministic executions by identifying sources of non-determinism in HPC applications, and detailing the characteristics of these sources in a given communication topology.
Improve understanding of non-deterministic features across various HPC applications via tracing techniques mixed with modeling and comparison of event graphs.
Study the types and sources of communication non-determinism via both application of existing tools for graph comparison and development of new tools for graph alignment.
Provide lightweight, portable methods for modeling and identifying application non-determinism, allowing for efficient analysis and debugging of arbitrary HPC codes.
Foster an understanding of non-determinism in the next generation of HPC experts via development and release of interactive and educational software and media about non-determinism, collaboration with computer science and HPC organizations such as the SIGHPC Resource Constrained Environments Chapter to reach out to edge communities, and engagement of students in research opportunities.

ANACIN-X Tutorial

Learn more about ANACIN-X with our Comprehensive Tutorial.

Selected Publications

Bell P, Suarez K, Fossum B, Chapp D, Bhowmick S, Taufer M. A Research-Based Course Module to Study Non-determinism in High Performance Applications. IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW). (2022). doi: 10.1109/IPDPSW55747.2022.00067. [link forthcoming]
D. Chapp, N. Tan, S. Bhowmick and M. Taufer. Identifying Degree and Sources of Non-Determinism in MPI Applications Via Graph Kernels, in IEEE Transactions on Parallel and Distributed Systems, vol. 32, no. 12, pp. 2936-2952, 1 Dec. 2021, doi:10.1109/TPDS.2021.3081530. [link]
Bell P, Suarez K, Chapp D, Tan N, Bhowmick S, Taufer M. ANACIN-X: A Software Framework for Studying Non-determinism in MPI Applications. Software impacts. 9 Oct. 2021, doi: 10.1016/j.simpa.2021.100151. [link]
D. Chapp, D. Rorabaugh (#), K. Sato, D. Ahn, and M. Taufer. A Three-phase Workflow for General and Expressive Representations of Nondeterminism in HPC Applications. International Journal of High-Performance Computing Applications(IJHPCA), 1175-1184 (2019). [link]
D. Chapp, K. Sato, D. Ahn, and M. Taufer. Record-and-Replay Techniques for HPC Systems: A survey. Journal of Supercomputing Frontiers and Innovations, 5(1):11-30,. (2018). [link]
D. Chapp, T. Johnston, and M. Taufer. On the Need for Reproducible Numerical Accuracy through Intelligent Runtime Selection of Reduction Algorithms at the Extreme Scale. In Proceedings of IEEE Cluster Conference, pp. 166 – 175. Chicago, Illinois, USA. September 8 – 11, 2015. [link]