Parallel I/O and management of large scientific data @ CINECA



via de Tizii, 6 Roma ITALY

The growing availability and power of computing resources, has led in recent years to the production of a huge amount of data. However, writing results of numerical simulations from memory to disk is a well known bottleneck in high-performance computing. Moreover, sometimes data are stored in files without a specific organization or format, making them no portable neither accessible on other resources, severely limiting their use.
Thus, crucial issues are both the choice of the better way to write and to read data taking into account of the hardware resources available, like the bandwidth and the filesystem's properties; and the choice of the better techniques to write and to read data in order to obtain portable and accessible files.
Aim of this course is to introduce the basis for the usage of the MPI-2 I/O library for binary data, and the standard data formats as HDF5, that allow for data writing and reading in an organized, efficiency and portable way
Some note about the hardware features affecting the I/O performance are also provided, in order to choose the better way to write and to read data.
Target Audience
Students and researchers of any scientific field, interested in improving their knowledge in production and managment of scientific data.
•                     I/O: basic concepts
•                     Managment of large scientific data
•                     Parallel file I/O with MPI2
•                     HDF5 library
•                     Knowledge and experience of Fortran, C, or  C++.
•                     Experience with UNIX operating systems
•                     Knowledge of MPI

The lunch for the three days will be offered to all the participants and some grants are available. The only requirement to be eligible is to be not funded by your institution to attend the course and to work or live in an institute outside the Roma area. The grant  will be 200 euros for students working and living outside Italy and 100 euros for students working and living in Italy. Some documentation will be required and the grant will be paid only after a certified presence of minimum 80% of the lectures.

Further information about how to request the grant, will be provided at the confirmation of the course: about 3 weeks before the starting date.


The agenda of this meeting is empty