Dynamic reconfiguration of noniterative scientific applications A case study with HPG aligner
View/ Open
Impact
Scholar |
Other documents of the author: Iserte, Sergio; Martínez Pérez, Héctor; Barrachina Mir, Sergio; Castillo Catalán, María Isabel; Mayo, Rafael; Peña Monferrer, Antonio J.
Metadata
Show full item recordcomunitat-uji-handle:10234/9
comunitat-uji-handle2:10234/7036
comunitat-uji-handle3:10234/8620
comunitat-uji-handle4:
INVESTIGACIONMetadata
Title
Dynamic reconfiguration of noniterative scientific applications A case study with HPG alignerAuthor (s)
Date
2018-09Publisher
SpringerBibliographic citation
ISERTE, Sergio, et al. Dynamic reconfiguration of noniterative scientific applications: A case study with HPG aligner. The International Journal of High Performance Computing Applications, 2018, 1094342018802347.Type
info:eu-repo/semantics/articlePublisher version
https://journals.sagepub.com/doi/abs/10.1177/1094342018802347Version
info:eu-repo/semantics/updatedVersionSubject
Abstract
Several studies have proved the benefits of job malleability, that is, the capacity of an application to adapt its parallelism to a dynamically changing number of allocated processors. The most remarkable advantages ... [+]
Several studies have proved the benefits of job malleability, that is, the capacity of an application to adapt its parallelism to a dynamically changing number of allocated processors. The most remarkable advantages of executing malleable jobs as part of a high performance computer workload are the throughput increase and the more efficient utilization of the underlying resources. Malleability has been mostly applied to iterative applications where all the processes execute the same operations over different sets of data and with a balanced per process load. Unfortunately, not all scientific applications adhere to this process-level malleable job structure. There are scientific applications which are either noniterative or present an irregular per process load distribution. Unlike many other reconfiguration tools, the Dynamic Management of Resources Application Programming Interface (DMR API) provides the necessary flexibility to make malleable these out-of-target applications. In this article, we study the particular case of using the DMR API to generate a malleable version of HPG aligner, a distributed-memory noniterative genomic sequencer featuring an irregular communication pattern among processes. Through this first conversion of an out-of-target application to a malleable job, we both illustrate how the DMR API may be used to convert this type of applications into malleable and test the benefits of this conversion in production clusters. Our experimental results reveal an important reduction of the malleable HPG aligner jobs completion time compared to the original HPG aligner version. Furthermore, HPG aligner malleable workloads achieve a greater throughput than their fixed counterparts. [-]
Investigation project
MINECO and FEDER (Project TIN2014-53495-R and TIN2015-65316-P) ; MINECO, Juan de la Cierva fellowship (IJCI-2015-23266).Rights
Copyright © 2018 by SAGE Publications
http://rightsstatements.org/vocab/InC/1.0/
info:eu-repo/semantics/openAccess
http://rightsstatements.org/vocab/InC/1.0/
info:eu-repo/semantics/openAccess
This item appears in the folowing collection(s)
- ICC_Articles [417]