HADOOP DEVELOPER IN REAL WORLD
Hadoop Developer In Real World
Free Cluster Access * HDFS * MapReduce * YARN * Pig * Hive * Flume * Sqoop * AWS * EMR * Optimization * Troubleshooting.
Course Description
From the creators of the successful Hadoop Starter Kit course hosted in Udemy, comes Hadoop In Real World course. This course is designed for anyone who aspire a career as a Hadoop developer. In this course we have covered all the concepts that every aspiring Hadoop developer must know to SURVIVE in REAL WORLD Hadoop environments.
The course covers all the must know topics like HDFS, MapReduce, YARN, Apache Pig and Hive etc. and we go deep in exploring the concepts. We just don’t stop with the easy concepts, we take it a step further andcover important and complex topics like file formats, custom Writables, input/output formats, troubleshooting, optimizations etc.
All concepts are backed by interesting hands-on projects like analyzing million song dataset to find less familiar artists with hot songs, ranking pages with page dumps from wikipedia, simulating mutual friends functionality in Facebook just to name a few.
What are the requirements?
- Although you don’t have to be an expert in Java, basic knowledge in Java programming is required as we will be looking at programs in Java.
- Basic Linux commands
What am I going to get from this course?
- Understand what is Big Data, the challenges with Big Data and how Hadoop propose a solution for the Big Data problem
- Work and navigate Hadoop cluster with ease
- Install and configure a Hadoop cluster on cloud services like Amazon Web Services (AWS)
- Understand the difference phases of MapReduce in detail
- Write optimized Pig Latin instruction to perform complex data analysis
- Write optimized Hive queries to perform data analysis on simple and nested datasets
- Work with file formats like SequenceFile, AVRO etc
- Understand Hadoop architecture, Single Point Of Failures (SPOF), Secondary/Checkpoint/Backup nodes, HA configuration and YARN
- Tune and optimize slowing running MapReduce jobs, Pig instructions and Hive queries
- What is the target audience?
- This course is for anyone who aspire a career as a Hadoop Developer
- This course is for anyone who want to learn and understand in depth about Hadoop and Big Data.
