Data Staging and Data Movement @ EPCC

Europe/London
3305 (EPCC)

3305

EPCC

The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
Description
As our HPC resources become more an more powerful, there is a corresponding increase in the size of output files produced (and in some cases, input files required).

Whether you're using HECToR, ARCHER, another PRACE resource, EUDAT's data services, or using the RDF directly, the problems are similar, and the best practice for moving large data files the same. This course will cover the techniques used to move large amounts of data (such as the use of GridFTP) and also provide a background to the authentication mechanisms required to get GridFTP working for you. We'll also introduce you to iRODS and to EUDAT's data services which can provide additional services (such as replication of your data between sites).
  • Tuesday, 25 February
    • 09:15 09:30
      Arrival & Registration 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 09:30 10:00
      Welcome and Introduction 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 10:00 10:30
      The PRACE network 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 10:30 11:00
      Overview of EUDAT’s Services 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 11:00 11:20
      Break 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 11:20 12:00
      GridFTP 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 12:00 12:40
      Introduction to iRODS 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 12:40 13:40
      Lunch 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 13:40 14:40
      Authentication 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 14:40 15:40
      B2STAGE: The EUDAT Data Staging service 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 15:40 16:00
      Break 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 16:00 17:00
      B2SAFE: The EUDAT Replication service 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
  • Wednesday, 26 February
    • 09:15 10:15
      Data Staging Hands-On 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 10:15 11:15
      Data Replication Hands-On 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 11:15 11:30
      Break 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 11:30 12:00
      Persistent Identifiers & Handles 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 12:00 13:00
      Lunch 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 13:00 14:00
      iRODS Hands-On 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 14:00 15:00
      Data Movement: Future Directions 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ
    • 15:00 16:00
      EUDAT, PRACE and ARCHER staff will be available until 1600 to discuss issues you face with dealing with data in your own work. 3305

      3305

      The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9 3JZ