[ONLINE] Introduction to High-Performance Machine Learning @SURFsara

from Monday, 14 September 2020 (09:00) to Tuesday, 15 September 2020 (17:00)
[ONLINE]

        : Sessions
    /     : Talks
        : Breaks
14 Sep 2020
15 Sep 2020
AM
09:00
Welcome & Introduction (until 09:15) ()
09:15
Introduction to Neural Networks (until 09:45) ()
09:45 Hands-on: Neural Networks with MNIST   ()
10:30 --- Coffee break ---
11:00
Neural Networks - knobs and dials (until 11:30) ()
11:30
Hands-on: Neural Networks - hyperparameter tuning for optimizing the MNIST prediction (until 12:00) ()
09:00
Introduction to Parallel Computing (until 09:30) ()
09:30
Parallel Computing for Deep Learning: basic ideas, algorithms, frameworks, and hardware bottlenecks (until 10:30) ()
10:30 --- Coffee break ---
11:00
Structure of Deep Learning Frameworks: computational graph, autodiff, and optimizers (until 11:30) ()
11:30 Hands-on: Profiling TensorFlow with TensorBoard   ()
PM
12:00 --- Lunch break ---
13:30
Introduction to CNNs, RNNs, and generative models (until 14:30) ()
14:30
Hands-on: CNNs with CIFAR (until 15:15) ()
15:15 --- Coffee break ---
15:45 DNN inspection and result Interpretation   ()
16:30
Open discussion (until 17:00) ()
12:30 --- Lunch break ---
14:00
Hands-on: Data Parallelism with Horovod (CIFAR10) (until 15:00) ()
15:00 --- Coffee break ---
15:30
Introduction to Hybrid parallelism (until 16:15) ()
16:15
Open discussion (until 17:00) ()