28-29 January 2015
EPCC, UK
Europe/London timezone

Please note the course will be held in EPCC Edinburgh:
 

ARCHER, the UK's national supercomputing service, offers training in software development and high-performance computing to scientists and researchers across the UK. As part of our training service we are running a 2 day Data Management: IO, Transfer and Storage course at EPCC.
 
Whether you're undertaking very data-intensive computations or working with large input or output files that need to be transferred on or off an HPC machine, a good understanding of data management best practices will help you to make the most of available resources.
 
This two day course will fall into two parts:
 
The first part will cover best practices for working with your files on ARCHER. It will describe ARCHER's file systems and the relationship between ARCHER and the RDF. It will introduce GridFTP as a mechanism for moving large amounts of data on and off ARCHER and the RDF. We'll then introduce file formats that have associated libraries for high-performance IO (such as HDF5 and NetCDF).
 
The second part will cover alternative data storage and transmission techniques. It will introduce both traditional "SQL" databases and more modern "NoSQL" databases that are particularly suited for some big data applications. Finally, we'll cover some of the widely used file formats used when working with data on the Internet, such as XML and JSON.



 

Starts
Ends
Europe/London
EPCC, UK
3305
The University of Edinburgh James Clerk Maxwell Building Peter Guthrie Tait Road Edinburgh EH9 3FD (Use our old postcode EH9 3JZ in your sat-nav - same building but the postcode was updated recently and some sat-navs can't find the new version)

This course is being run by EPCC, as part of ARCHER. The course is in collaboration with EPCC's PRACE Advanced Training Centre (PATC).

PATC courses are available free of charge to all attendees (academic and industrial). Lunches and refreshments will be provided.

Please register using the online form. If you have any questions, please consult the course forum page or contact epcc-support@epcc.ed.ac.uk.

Information about how to find the James Clerk Maxwell Building (JCMB) can be found on the School of Physics and Astronomy website.

Note that parking on the King's Buildings campus is by permit only, and that parking just outside on Mayfield Road is restricted before 09:15 and after 16:30 - and cars will be removed (with a hefty fee payable to get your car back) if parked there during the restricted times. Unrestricted free parking is available on nearby Hallhead Road, Ross Road, Blackbarony Road and Gordon Terrace to the east of the campus, and along the north side of the campus on West Mains Road.

A number of B&Bs and hotels can be found approximately 10 minutes' walk from EPCC, including:
* Smiths' Guest House, 77 Mayfield Road, Edinburgh EH9 3AA
* Mayfield Lodge Guest House, 75 Mayfield Road, Edinburgh EH9 3AA
* Highfield Guest House, 83 Mayfield Road, Edinburgh EH9 3AE
* Lauderville Guest House, 52 Mayfield Road, Edinburgh EH9 2NH
* Glenisla Hotel, 12 Lygon Road, Edinburgh EH16 5QB
* Glendale House Guest House, 5 Lady Road, Edinburgh EH16 5PA
There is also the Travelodge Cameron Toll, 43 Craigmillar Park, Edinburgh EH16 5PD. Note that the room price does not include breakfast.

Your browser is out of date!

Update your browser to view this website correctly. Update my browser now

×