Design space exploration of next-generation HPC machines

Abstract

The landscape of High Performance Computing (HPC) system architectures keeps expanding with new technologies and increased complexity. With the goal of improving the efficiency of next-generation large HPC systems, designers require tools for analyzing and predicting the impact of new architectural features on the performance of complex scientific applications at scale. We simulate five hybrid (MPI+OpenMP) applications over 864 architectural proposals based on stateof-the-art and emerging HPC technologies, relevant both in industry and research. This paper significantly extends our previous work with MUltiscale Simulation Approach (MUSA) enabling accurate performance and power estimations of large-scale HPC systems. We reveal that several applications present critical scalability issues mostly due to the software parallelization approach. Looking at speedup and energy consumption exploring the design space (i.e., changing memory bandwidth, number of cores, and type of cores), we provide evidence-based architectural recommendations that will serve as hardware and software codesign guidelines.This work is partially supported by the Spanish Gov-ernment through Programa Severo Ochoa (SEV-2015-0493),by the Spanish Ministry of Science and Technology project(TIN2015-65316-P), by the Generalitat de Catalunya (2017-SGR-1414 and 2017-SGR-1328), and by the European Com-munity’s Horizon 2020 Framework Programme under theMont-Blanc project, grant agreement n. (671697 and 779877).A. Armejach has been partially supported by the SpanishMinistry of Economy, Industry and Competitiveness underJuan de la Cierva postdoctoral fellowship number FJCI-2015-24753 M. Moret ́o has been partially supported by the SpanishMinistry of Economy, Industry and Competitiveness underRamon y Cajal fellowship number RYC-2016-21104. M.Casas has been partially supported by the Spanish Ministry of Economy, Industry and Competitiveness under Ramon y Cajal fellowship number RYC-2017-23269.Peer ReviewedPostprint (published version