Hadoop for Systems Administrators (GL660) (H6C60S)

This course covers the essentials of deploying and managing an Apache™ Hadoop® cluster. The course is lab intensive with each participant creating their own Hadoop cluster using either the CDH (Cloudera’s Distribution, including Apache Hadoop) or Hortonworks Data Platform stacks. Core Hadoop services are explored in depth with emphasis on troubleshooting and recovering from common cluster failures. The fundamentals of related services such as Ambari, Zookeeper, Pig, Hive, HBase, Sqoop, Flume, and Oozie are also covered. The course is approximately 60% lecture and 40% labs.
 
Audience
Systems Administrators who will be responsible for managing and administering Hadoop clusters.
 
Prerequisites
Qualified participants should be comfortable with the Linux commands and have some systems administration experience, but do not need previous Hadoop experience.
 
Details anzeigen
 
Detailed Course Outline
 
Module 1: Hadoop Overview
  • Data Analysis
  • Big Data
  • Origins of Hadoop
  • Hadoop Marketplace
  • Hadoop Core
  • Hadoop Ecosystem
  • Cluster Architecture
  • Hardware/Software Requirements
  • Running Commands on Multiple Systems
 
Module 2: HDFS
  • Design Goals
  • Design
  • Blocks
  • Block Replication
  • Namenode Daemon
  • Secondary Namenode Daemon
  • Datanode Daemon
  • Accessing HDFS
  • Permissions and Users
  • Adding and Removing Datanodes
  • Balancing
 
Module 3: YARN
  • YARN Design Goals
  • YARN Architecture
  • Resource Manager
  • Node Manager
  • Containers
  • YARN: Other Important Features
  • Slider
 
Module 4: MapReduce
  • MapReduce
  • Terminology and Data Flow
 
Module 5: Installing Hadoop with Ambari
 
Module 6: Data Ingestion
  • Sqoop
  • Flume
  • Kafka
 
Module 7: Data Lineage and Governance
  • Falcon
  • Atlas
  • Oozie
 
Module 8: Data Processing Frameworks
  • The Bane of MapReduce
  • Tez overview
  • Pig
  • Hive
  • Spark
  • Storm
  • Solr
 
Module 9: NoSQL Implementations
  • HBase
  • Phoenix
 
Module 10: Cluster Management
  • Ambari Metrics System (AMS)
  • Zookeeper