top of page

Big Data - Hadoop 2 Day Bootcamp

​

The Hadoop training bootcamp is designed to help you become a top Hadoop developer. During this course, our expert instructors will train you to:

​

  • Master the concepts of HDFS and MapReduce framework

  • Understand Hadoop 2.x Architecture

  • Setup Hadoop Cluster and write Complex MapReduce programs

  • Learn data loading techniques using Sqoop and Flume

  • Perform data analytics using Pig, Hive and YARN

  • Implement HBase and MapReduce integration

  • Implement Advanced Usage and Indexing

  • Schedule jobs using Oozie

  • Implement best practices for Hadoop development

  • Understand Spark and its Ecosystem

  • Learn how to work in RDD in Spark

  • Work on a real life Project on Big Data Analytics

​

Outline:

​

 Introduction to Big Data

​

  • Big Data - beyond the obvious trends

    • Technologies involved

    • Business drivers

    • Implications for enterprise computing

  • Exponentially increasing data

    • ERP Data

    • CRM Data

    • Web Data

    • Big Data

  • Big data sources

    • Sensors

    • Social

    • Geospatial

    • Video

    • Machine to machine

    • Others

  • Data warehousing, business intelligence, analytics, predictive statistics, data science

 

2. Survey of Big Data technologies

​

  • First generation systems

    • RDBMS systems

    • ETL systems

    • BI systems

  • Second generation systems

    • Columnar databases with compression

    • MPP architectures

    • Data warehousing appliances

  • Enterprise search

  • Visualizing and understanding data with processing

    • Streaming processing

    • Statistical processing

    • Data visualization

  • NOSQL databases

    • How do technologies like mongodb, MarkLogic and couchdb fit in?

    • What is polyglot persistence?

  • Apache Hadoop

 

3. Introduction to Hadoop

​

  • What is Hadoop? Who are the major vendors? 

  • A dive into the Hadoop Ecosystem

  • Benefits of using Hadoop

  • How to use Hadoop within your infrastructure?

    • Where do we use Hadoop?

    • Where do we look at options besides Hadoop?

 

4. Introduction to MapReduce

​

  • What is MapReduce?

  • Why do you need MapReduce?

  • Using Mapreduce with Java and Ruby

Lab: How to use MapReduce in Hadoop?

 

5. Introduction to Yarn

​

  • What is Yarn?

  • What are the advantages of using Yarn over classical MapReduce?

  • Using Yarn with Java and Ruby

Lab: How to use Yarn within Hadoop?

 

6. Introduction to HDFS

​

  • What is HDFS?

  • Why do you need a distributed file system?

  • How is a distributed file system different from a traditional file system?

  • What is unique about HDFS when compared to other file systems?

  • HDFS and reliability?

  • Does it offer support for compressions, checksums and data integrity?

Lab: Overview of HDFS commands

 

7. Data Transformation 

​

  • Why do you need to transform data?

  • What is Pig?

  • Use cases for Pig

Lab: Hands on activities with Pig

 

8. Structured Data Analysis?

​

  • How do you handle structured data with Hadoop?

  • What is Hive/HCatalog?

  • Use cases for Hive/HCatalog

Lab: Hands on activities with Hive/HCatalog

 

9. Loading data into Hadoop

​

  • How do you move your existing data into Hadoop?

  • What is Sqoop?

Lab: Hands on activities with Sqoop

 

10. Automating workflows in Hadoop

​

  • Benefits of Automation

  • What is oozie?

  • Automatically running workflows

  • Setting up workflow triggers

Lab: Demonstration of oozie

 

11. Exploring opportunities in your own organization

​

  • Framing scenarios

  • Understanding how to ask questions

  • Tying possibilities to your own business drivers

  • Common opportunities

  • Real world examples

 

Hands-on Exercises

​

You'll experience "in-the-trenches" practice built around actual big data implementations. You'll learn to avoid pitfalls and do it right the first time. Your instructor will help you map the tools and techniques you learn in this class to your own business, so they can be applied in your own organization immediately after the class.

 

How to use MapReduce in Hadoop?

  • How does it work from languages like Java?

  • How does it work with languages like Ruby?

 

How to use Yarn within Hadoop?

  • How does it work from languages like Java?

  • How does it work with languages like Ruby?

 

Overview of HDFS commands

  • Standard file system commands

  • Moving data to and from HDFS

 

Hands-on activities with Pig

  • Joining Data

  • Filtering Data

  • Storing and Loading Data

 

Hands-on activities with Hive/HCatalog

  • Storing and Loading Data

  • Select expressions

  • Hive vs SQL

 

Hands-on activities with Sqoop

  • Running evaluation commands with Sqoop

  • Importing data from relational databases

  • Exporting data to relational databases

 

Demonstration of Oozie

  • Creating a workflow

  • Running a workflow automatically at regular intervals

  • Running a workflow automatically when some events are triggered

bottom of page