Apache Kafka - 2 Day Bootcamp
Apache Kafka course is designed to provide knowledge and skills to become a successful Kafka Big Data Developer. It will encompass the fundamental concepts like Kafka cluster, Kafka API to advance topics such as Kafka integration with Hadoop, Storm, Spark, Maven etc. The course also covers installation & configuration of Kafka and other components like Hadoop, Spark, Storm, Maven etc.
All attendees will learn how to:
-
Understand Kafka and its components
-
Set up an end to end Kafka cluster along with Hadoop and Yarn cluster
-
Integrating Kafka with real time streaming systems like Spark & Storm
-
Describe the basic and advanced features involved in designing and developing a high throughput messaging system
-
Use Kafka to produce and consume messages from various sources including real time streaming sources like Twitter
-
Understanding the insights of Kafka API
-
Work on a real life Project, implementing Twitter streaming with Kafka, Hadoop & Storm
Outline:
1. Introduction to Big Data and Apache Kafka
Learning Objectives
-
In this module, you will understand Big Data, Kafka and Kafka Architecture.
Topics
-
Introduction to Big Data, Big Data Customer Scenarios, What is Kafka?, Need for Kafka, Core Concepts of Kafka, Kafka Architecture, Where is Kafka Used?
2. Deep Dive into Kafka Cluster
Learning Objectives
-
In this module, you will be instructed about the details of Kafka Custer and you learn all the components of Kafka Cluster in detail.
Topics
-
Understanding the components of Kafka Cluster, Installation of Kafka Cluster, Configuring Kafka Cluster, Producer of Kafka, Consumer of Kafka, Producer and Consumer in Action.
3. Kafka Operations and Performance Tuning
Learning Objectives
-
In this module, you will understand Kafka Operations and Performance Tuning
Topics
-
Offset, Design, Hardware, Kafka Monitoring and Issues, Kafka Performance Tuning, Reading data from Kafka, Demo-Twitter Kafka Producer, Introduction to Scala, Mixed Paradigm-Functional Programming, Scala Installation & Configuration, Scala REPL, Scala Project Using Eclipse
4. Integration of Kafka with Hadoop and Storm
Learning Objectives
-
In this module, you will understand how to integrate Kafka with Big Data frameworks like Hadoop and Storm.
Topics
-
Understanding the Hadoop Cluster, Integrating Kafka with Hadoop Cluster, Understanding Apache Storm, Implementing Spouts and Bolts, Kafka with Storm Spout.
5. Kafka with Spark and Project
Learning Objectives
-
In this module, you will understand Spark Ecosystem, Configuring Spark Cluster, Integrating Kafka with Spark and Twitter, Use cases with Kafka, Storm and Hadoop.
Topics
-
Ecosystem of Spark, Understanding the Spark Cluster, Integrating Kafka with Spark.