As our HPC resources become more an more powerful, there is a corresponding increase in the size of output files produced (and in some cases, input files required).
Whether you're using HECToR, ARCHER, another PRACE resource, EUDAT's data services, or using the RDF directly, the problems are similar, and the best practice for moving large data files the same. This course will cover the techniques used to move large amounts of data (such as the use of GridFTP) and also provide a background to the authentication mechanisms required to get GridFTP working for you. We'll also introduce you to iRODS and to EUDAT's data services which can provide additional services (such as replication of your data between sites).
Whether you're using HECToR, ARCHER, another PRACE resource, EUDAT's data services, or using the RDF directly, the problems are similar, and the best practice for moving large data files the same. This course will cover the techniques used to move large amounts of data (such as the use of GridFTP) and also provide a background to the authentication mechanisms required to get GridFTP working for you. We'll also introduce you to iRODS and to EUDAT's data services which can provide additional services (such as replication of your data between sites).