Application-Specific Communication Systems for Clusters

Abstract

Several communication systems that claim to support high performance computing in clusters focus on “the best” solution for a given host/network architecture. However, a definitive best solution, independently of how fine-tuned to the underlying hardware it is, cannot exist, whereas parallel applications simply communicate differently. In this paper, we describe a design method that enables the construction of communication systems as an assemblage of adaptable components that can be configured to closely match the demands of given applications. We also describe the deployment of this method in the EPOS project, which delivers automatic-generated, application-tailored runtime support systems, including a communication system for the MYRINET high-speed network