Name: [ONLINE] Introduction to High-Performance Machine Learning @SURF
Start: 2022-06-27T09:00:00+02:00
End: 2022-06-28T17:00:00+02:00
Location: [ONLINE]

[ONLINE] Introduction to High-Performance Machine Learning @SURF

from Monday, June 27, 2022 (9:00 AM) to Tuesday, June 28, 2022 (5:00 PM)

Monday, June 27, 2022

9:00 AM Welcome & Introduction

9:00 AM - 9:15 AM

9:15 AM Introduction to Neural Networks

9:15 AM - 9:45 AM

9:45 AM Hands-on: Neural Networks with MNIST
Hands-on: Neural Networks with MNIST
9:45 AM - 10:45 AM

10:45 AM Coffee break
Coffee break
10:45 AM - 11:00 AM

11:00 AM Neural Networks - knobs and dials

11:00 AM - 11:30 AM

11:30 AM Hands-on: Neural Networks - hyperparameter tuning for optimizing the MNIST prediction

11:30 AM - 12:00 PM

12:00 PM Lunch break
Lunch break
12:00 PM - 1:00 PM

1:00 PM Introduction to CNNs, RNNs, and generative models

1:00 PM - 2:00 PM

2:00 PM Hands-on: CNNs with CIFAR

2:00 PM - 3:00 PM

3:00 PM Coffee break
Coffee break
3:00 PM - 3:15 PM

3:15 PM DNN inspection and result Interpretation
DNN inspection and result Interpretation
3:15 PM - 4:30 PM

4:30 PM Open discussion

4:30 PM - 5:00 PM
Tuesday, June 28, 2022

9:00 AM Introduction to Parallel Computing

9:00 AM - 9:30 AM

9:30 AM Parallel Computing for Deep Learning: basic ideas, algorithms, frameworks, and hardware bottlenecks

9:30 AM - 10:45 AM

10:45 AM Coffee break
Coffee break
10:45 AM - 11:00 AM

11:00 AM Structure of Deep Learning Frameworks: computational graph, autodiff, and optimizers

11:00 AM - 11:30 AM

11:30 AM Hands-on: Profiling TensorFlow with TensorBoard
Hands-on: Profiling TensorFlow with TensorBoard
11:30 AM - 12:30 PM

12:30 PM Lunch break
Lunch break
12:30 PM - 1:30 PM

1:30 PM Hands-on: Data Parallelism with Horovod (CIFAR10)

1:30 PM - 3:00 PM

3:00 PM Coffee break
Coffee break
3:00 PM - 3:15 PM

3:15 PM Introduction to Hybrid parallelism

3:15 PM - 4:30 PM

4:30 PM Open discussion

4:30 PM - 5:00 PM

Choose timezone