System, User and Developer Perspectives on Parallel I/O

Event content

Parallel file systems provide the storage backend of HPC clusters. Since their characteristics have a large impact on the I/O performance and in consequence on the runtime of compute jobs, it is important to understand them and how to use them efficiently. This applies for both the perspectives of a simple user as well as on developers creating their own codes. The course will give an overview of parallel file systems and parallel-IO. It also covers anti-patterns which result in reduced performance. Furthermore, examples for efficient parallel-IO will be given.

Learning goal

• Overview of parallel file systems and object storage, storage-IO
• Understanding of the performance and behavior of storage systems
• Understanding of good practices for implementing parallel-IO

Information about the event

Max. participants

30

Requirements

• Basic experience in using the GWDG SCC and/or GWDG NHR clusters, including Slurm job submission
• For practical testing either a GWDG NHR account, or a course account for GWDG NHR
• For implementation of course content, practical experience with the Linux command line needed and software development experience is useful.

Speakers

Patrick Höhn

Dr. Sebastian Krey