PRACE Autumn school 2021 - Big Data with Hadoop and Keras

Session

Introduction to HADOOP

27 Sep 2021, 13:00

IV/2 (Fakulteta za strojništvo)

Conveners

Introduction to HADOOP: Introduction to HADOOP I

• Giovanna Roda (TU Wien)

Description

• Introduction to the Apache Hadoop framework
• The Hadoop Distributed File System (HDFS)
  • Architecture and basic usage
• Hadoop MapReduce
  • Data partitioning
  • Sorting and shuffling
  • Hadoop streaming
• a simple hands-on demo

Presentation materials

Chat Day 1 - Part 2.txt

hadoop2021.tar.gz

HDFS_commands.txt

Introduction to Hadoop slides.pdf

mapper.py

MapReduce_commands.txt

reducer.py

swap_keyval.py

Video Day 1 - Introduction to Hadoop part 1.mp4

Video Day 1 - Introduction to Hadoop part 2.mp4

wiki_1k_lines

wiki_24K_lines

word_count.py

Timetable