Whether you're undertaking very data-intensive HPC computations or working with large files that need to be transferred on or off a remote supercomputer, a good understanding of data management best practices will help you to make the most of available resources.
This course covers best practice for data management using the UK's National Supercomputer service, ARCHER, and its associated RDF data archive and Data Analytics Cluster as specific examples.
Day 1 will cover best practices for working with your files on ARCHER. It will describe ARCHER's local file systems and the relationship between ARCHER and the Research Data Facility, the associated system for long-term archiving. It will introduce tools such as GridFTP for moving large amounts of data on and off ARCHER and the RDF. We will also cover how to do data analysis and visualisation on the Data Analytics Cluster attached to the RDF.
Day 2 will introduce file formats that have associated libraries for high-performance IO (such as HDF5 and NetCDF). We then cover ways to achieve good IO performance on parallel systems using these formats and the lower-level MPI-IO library. We conclude with general advice on how to develop practical data management plans for your own research that are useful and address the requirements of research funding bodies.
This course is free to all academics.
Attendees are expected to have experience of using desktop computers, but no programming, Linux or HPC experience is necessary.
This course is part-funded by the PRACE project and is free to all. Please register using the online form. If you have any questions, please consult the course forum page or contact firstname.lastname@example.org.
Information about how to find the James Clerk Maxwell Building (JCMB) can be found on the School of Physics and Astronomy website.
Note that parking on the King's Buildings campus is by permit only, and that parking just outside on Mayfield Road is restricted before 09:15 and after 16:30 - and cars will be removed (with a hefty fee payable to get your car back) if parked there during the restricted times. Unrestricted free parking is available on nearby Hallhead Road, Ross Road, Blackbarony Road and Gordon Terrace to the east of the campus, and along the north side of the campus on West Mains Road.
A number of B&Bs and hotels can be found approximately 10 minutes' walk from EPCC, including:
* Smiths' Guest House, 77 Mayfield Road, Edinburgh EH9 3AA
* Mayfield Lodge Guest House, 75 Mayfield Road, Edinburgh EH9 3AA
* Highfield Guest House, 83 Mayfield Road, Edinburgh EH9 3AE
* Lauderville Guest House, 52 Mayfield Road, Edinburgh EH9 2NH
* Glenisla Hotel, 12 Lygon Road, Edinburgh EH16 5QB
* Glendale House Guest House, 5 Lady Road, Edinburgh EH16 5PA
There is also the Travelodge Cameron Toll, 43 Craigmillar Park, Edinburgh EH16 5PD. Note that the room price does not include breakfast.