Introduction to High-Performance Machine Learning @SURFsara

CET
VK1/VK2 (SURFsara)

VK1/VK2

SURFsara

Science Park 140, 1098 XG Amsterdam
Description

In recent years machine learning and deep learning techniques in particular have developed tremendously. Neural networks are being used in more and more application domains going from computer vision to speech recognition, and even replacing parts of the compute pipeline for scientific HPC applications.

 

In this course you will start from the essential concepts up to the efficient use of HPC infrastructures to get the best performance out of different machine learning tools. Several hands-on sessions are set up to present general algorithms and some scalability challenges involved in when using both large-scale data and large-scale models.

 

IMPORTANT INFORMATION: WAITING LIST

If the course gets fully booked, no more registrations are accepted through this website. However, you can be included in the waiting list: for that, please send an email to training@surfsara.nl and you'll be informed when a place becomes available.

    • 09:00 09:15
      Welcome & Introduction
      Convener: Zheng Meyer-Zhao (SURFsara)
    • 09:15 09:45
      Introduction to Neural Networks
    • 09:45 10:30
      Hands-on: Neural Networks 45m
    • 10:30 10:45
      Coffee break 15m
    • 10:45 11:15
      Neural Networks - knobs and dials
    • 11:15 12:00
      Hands-on: Neural Networks - parameter tuning
    • 12:00 13:00
      Lunch break 1h
    • 13:00 13:30
      Convolutional Neural Networks
    • 13:30 14:30
      Hands-on: Convolutional Neural Networks
    • 14:30 14:45
      Coffee break 15m
    • 14:45 15:15
      Interpreting deep learning models and results 30m
    • 15:15 16:15
      Inspecting a Convolutional Neural Network 1h
    • 16:15 17:00
      Open discussion
  • Wednesday, 12 June
    • 09:00 09:45
      Parallel computing for Deep Learning
    • 09:45 10:30
      Hardware bottlenecks (and how to overcome them)
    • 10:30 10:45
      Coffee break 15m
    • 10:45 11:30
      Hands-on: Profiling: creation and interpretation
    • 11:30 12:00
      Frameworks 30m
    • 12:00 13:00
      Lunch break 1h
    • 13:00 13:30
      Hands-on: Hovorod
    • 13:30 14:30
      Hands-on: CNN data distributed with Cifar 10
    • 14:30 14:45
      Coffee break 15m
    • 14:45 15:15
      Hands-on: CNN data distributed with Cifar 10
    • 15:15 15:30
      Hybrid parallelism & Mesh tensorflow
    • 15:30 16:15
      Hands-on: Hybrid parallelism
    • 16:15 17:00
      Open discussion