Parallel I/O and Portable Data Formats @ JSC

CET
Computer Lab no. 021 (Jülich Supercomputing Centre)

Computer Lab no. 021

Jülich Supercomputing Centre

Forschungszentrum Jülich, Germany
Description

Numerical simulations conducted on current high-performance computing (HPC) systems face an ever growing need for scalability. Larger HPC platforms provide opportunities to push the limitations on size and properties of what can be accurately simulated. Therefore, it is needed to process larger data sets, be it reading input data or writing results. Serial approaches on handling I/O in a parallel application will dominate the performance on massively parallel systems, leaving a lot of computing resources idle during those serial application phases.

In addition to the need for parallel I/O, input and output data is often processed on different platforms. Heterogeneity of platforms can impose a high level of maintenance, when different data representations are needed. Portable, selfdescribing data formats such as HDF5 and netCDF are examples of already widely used data formats within certain communities.

This course will introduce the use of parallel I/O (MPI I/O) and the HDF5 as well as the netCDF and the SIONlib library interfaces. Participants should have experience in parallel programming with MPI, and either C/C++ or Fortran in particular.

This course is a Prace Advanced Training Centres (PATC) course.

Application
Registrations are only considered until 9 May 2014;
due to available space, the maximal number of participants is limited.
Applicants will be notified, whether they are accepted for participitation.

Instructors:

Wolfgang Frings, Dr. Michael Stephan and Dr. Florian Janetzko, JSC

Contact
For any questions concerning the course please send an e-mail to w.frings@fz-juelich.de
    • 09:00 12:30
      Introduction to different I/O strategies

      Talk and hands-on training
      Coffee break in between

    • 12:30 13:30
      Lunch Break 1h
    • 13:30 16:30
      MPI I/O

      Talk and hands-on session
      coffee break in between

    • 19:00 22:00
      Social event (Dinner at a restaurant in Jülich) 3h
    • 09:00 12:30
      HDF5

      Talk and hands-on session
      coffee break in between

    • 12:30 13:30
      Lunch break 1h
    • 13:30 16:30
      NetCDF

      Talk and hands-on session
      coffee break in between

    • 09:00 12:30
      SIONlib

      Talk an hands-on session
      coffee break in between

    • 12:30 13:30
      Lunch break 1h
    • 13:30 16:00
      SIONlib

      Talk an hands-on session
      coffee break in between

    • 16:00 16:30
      Summary and Conclusion