[ONLINE] Introduction to High-Performance Machine Learning @SURFsara

CET
[ONLINE]

[ONLINE]

Description

Would you like to learn high-performance cutting-edge deep learning techniques?

Our online course on high-performance machine learning provides the necessary skills to train neural networks and extract the most relevant information from datasets. During our hands-on sessions you will have the opportunity to work on our high-performance systems with different types of data, and learn how to tune your model to obtain optimal results in the most efficient way. The high-performance machine learning team at SURFsara will guide you online during the presentations and exercises and indicate how to start applying machine learning to your projects.

What?

In this course you will:

- Understand the fundamental theories of machine learning and the intuitions/ideas behind the algorithms

- Work with a high-level machine learning API (Keras)

- Explore hyperparameter space to improve a neural network

- Understand the pitfalls of classic machine learning algorithms

- Upscale large machine learning models with parallel training on a supercomputer

Who?

- Everyone interested in getting familiar with machine learning at scale, from the beginning up to more advanced topics

Requirements:

- Basic knowledge on statistics

- Basic knowledge on general programming. Some experience with Python and the use of Jupyter Notebooks is desirable.

- Basic knowledge on parallel computing. No specific experience with supercomputing systems is necessary.

You should have:

- Your own laptop with an up-to-date browser and a terminal emulator. The use of the operating systems Linux and macOS is preferred, but not mandatory. For Windows users we recommend to download MobaXterm (portable version) as terminal emulator.

 

IMPORTANT INFORMATION: WAITING LIST

If the course gets fully booked, no more registrations are accepted through this website. However, you can be included in the waiting list: for that, please send an email to training@surfsara.nl and you'll be informed when a place becomes available.

  • Monday, 14 September
    • 09:00 09:15
      Welcome & Introduction
    • 09:15 09:45
      Introduction to Neural Networks
    • 09:45 10:30
      Hands-on: Neural Networks with MNIST 45m
    • 10:30 11:00
      Coffee break 30m
    • 11:00 11:30
      Neural Networks - knobs and dials
    • 11:30 12:00
      Hands-on: Neural Networks - hyperparameter tuning for optimizing the MNIST prediction
    • 12:00 13:30
      Lunch break 1h 30m
    • 13:30 14:30
      Introduction to CNNs, RNNs, and generative models
    • 14:30 15:15
      Hands-on: CNNs with CIFAR
    • 15:15 15:45
      Coffee break 30m
    • 15:45 16:30
      DNN inspection and result Interpretation 45m
    • 16:30 17:00
      Open discussion
  • Tuesday, 15 September
    • 09:00 09:30
      Introduction to Parallel Computing
    • 09:30 10:30
      Parallel Computing for Deep Learning: basic ideas, algorithms, frameworks, and hardware bottlenecks
    • 10:30 11:00
      Coffee break 30m
    • 11:00 11:30
      Structure of Deep Learning Frameworks: computational graph, autodiff, and optimizers
    • 11:30 12:30
      Hands-on: Profiling TensorFlow with TensorBoard 1h
    • 12:30 14:00
      Lunch break 1h 30m
    • 14:00 15:00
      Hands-on: Data Parallelism with Horovod (CIFAR10)
    • 15:00 15:30
      Coffee break 30m
    • 15:30 16:15
      Introduction to Hybrid parallelism
    • 16:15 17:00
      Open discussion