Evaluation and Performance Modeling of a Burst Buffer Solution

W. Schenck, S. El Sayed, M. Foszczynski, W. Homberg, D. Pleiter, ACM SIGOPS Operating Systems Review 50 (2017) 12–26.

Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Artikel | Veröffentlicht | Englisch
Autor*in
Schenck, WolframFH Bielefeld ; El Sayed, Salem; Foszczynski, Maciej; Homberg, Wilhelm; Pleiter, Dirk
Abstract
Hierarchical storage architectures are required to meet both, capacity and bandwidth requirements for future high-end storage architectures. In this paper we present the results of an evaluation of an emerging technology, DataDirect Networks' (DDN) Infinite Memory Engine (IME). IME allows to realize a fast buffer in front of a large capacity storage system. We collected benchmarking data with IOR and with the HPC application NEST. The IOR bandwidth results show how well network bandwidth towards such fast buffer can be exploited compared to the external storage system. The NEST benchmarks clearly demonstrate that IME can reduce I/O-induced load imbalance between MPI ranks to a minimum while speeding up I/O as a whole by a considerable factor. In addition to these direct measurements, a performance model for NEST is developed. In combination with a generic and abstract burst buffer architecture, this model generates predictions about appropriate burst buffer and I/O parameters to achieve specific performance goals for NEST on HPC clusters of varying size. Specifically, it is investigated in which parameter range burst buffers are able to counteract the widening performance gap between compute and I/O.
Erscheinungsjahr
Zeitschriftentitel
ACM SIGOPS Operating Systems Review
Band
50
Zeitschriftennummer
2
Seite
12-26
ISSN
FH-PUB-ID

Zitieren

Schenck, Wolfram ; El Sayed, Salem ; Foszczynski, Maciej ; Homberg, Wilhelm ; Pleiter, Dirk: Evaluation and Performance Modeling of a Burst Buffer Solution. In: ACM SIGOPS Operating Systems Review Bd. 50, Association for Computing Machinery (ACM) (2017), Nr. 2, S. 12–26
Schenck W, El Sayed S, Foszczynski M, Homberg W, Pleiter D. Evaluation and Performance Modeling of a Burst Buffer Solution. ACM SIGOPS Operating Systems Review. 2017;50(2):12-26. doi:10.1145/3041710.3041714
Schenck, W., El Sayed, S., Foszczynski, M., Homberg, W., & Pleiter, D. (2017). Evaluation and Performance Modeling of a Burst Buffer Solution. ACM SIGOPS Operating Systems Review, 50(2), 12–26. https://doi.org/10.1145/3041710.3041714
@article{Schenck_El Sayed_Foszczynski_Homberg_Pleiter_2017, title={Evaluation and Performance Modeling of a Burst Buffer Solution}, volume={50}, DOI={10.1145/3041710.3041714}, number={2}, journal={ACM SIGOPS Operating Systems Review}, publisher={Association for Computing Machinery (ACM)}, author={Schenck, Wolfram and El Sayed, Salem and Foszczynski, Maciej and Homberg, Wilhelm and Pleiter, Dirk}, year={2017}, pages={12–26} }
Schenck, Wolfram, Salem El Sayed, Maciej Foszczynski, Wilhelm Homberg, and Dirk Pleiter. “Evaluation and Performance Modeling of a Burst Buffer Solution.” ACM SIGOPS Operating Systems Review 50, no. 2 (2017): 12–26. https://doi.org/10.1145/3041710.3041714.
W. Schenck, S. El Sayed, M. Foszczynski, W. Homberg, and D. Pleiter, “Evaluation and Performance Modeling of a Burst Buffer Solution,” ACM SIGOPS Operating Systems Review, vol. 50, no. 2, pp. 12–26, 2017.
Schenck, Wolfram, et al. “Evaluation and Performance Modeling of a Burst Buffer Solution.” ACM SIGOPS Operating Systems Review, vol. 50, no. 2, Association for Computing Machinery (ACM), 2017, pp. 12–26, doi:10.1145/3041710.3041714.

Export

Markierte Publikationen

Open Data LibreCat

Suchen in

Google Scholar