Skip to content

Contact sales

By filling out this form and clicking submit, you acknowledge our privacy policy.

Kafka Internals

Course Summary

The Kafka Internals training course is designed to teach students about the publish/subscribe messaging system with many advanced configurations. Apache Kafka is an open-source stream processing platform used to provide a unified, high-throughput, low-latency system for handling real-time data feeds from a wide range of source systems.

The course begins with covering configurations, allowing students to discover brokers, consumers, producers, and topics. Next, students will build their own Kafka cluster using Linux Academy servers. The course will conclude by looking at applying their knowledge from the course to real-world scenarios like processing real-time stock price updates from an API and consolidating that into a data lake.

Learn to use Apache Kafka as a distributed messaging system.
Developers and developer teams looking to leverage Kafka architecture that know Java and basic Linux commands.
Software Developer
Skill Level
2 Days
Related Technologies
Java | Linux


Productivity Objectives
  • Understand the Kafka architecture and describe the roles and responsibilities of various Daemons
  • Use producers, consumers, and brokers within Kafka
  • Construct a streaming ETL pipeline using Kafka Connect
  • Explain how and when to use Kafka developer APIs
  • Perform real-time analytics using KSQL

What You'll Learn:

In the Kafka Internals training course, you'll learn:
  • Kafka Fundamentals & Internals
    • Logical Architecture of Kafka
    • Physical Architecture of Kafka
      • Partitions
      • Topics
      • Replicas
      • Producers & Consumers
      • Brokers
    • Roles and Responsibilities of various components
    • Replication mechanism
    • Message Delivery Semantic
    • Key Terminologies
    • Key configuration settings of Brokers, Producers, Consumers, etc.
    • Schema Evolution Concepts
    • Hands-on Exercise(s)
  • Zookeeper
    • Role of Zookeeper
    • Zookeeper Basic Operations
    • Apache Kafka - Zookeeper Role
    • Exploring Zookeeper
  • Kafka Administration
    • Things to consider in Administration
    • Monitoring Kafka
    • Kafka Security
    • Performance Tuning Kafka Cluster
  • Kafka Integrations
    • End to End Data Pipeline using Kafka
    • Why Kafka Connect?
    • Architecture
    • Tuning
    • Build End to End Streaming ETL Pipeline
    • Hands-on Exercise(s)
  • Kafka Core APIs
    • Overview
    • Producer API
      • Sync Producers
      • Async Producers
      • Message Acknowledgement
      • Batching Messages
      • Keyed and Non-Keyed Messages
      • Compression
      • Batching
    • Consumer API
    • Hands-on Exercise(s)
    • Overview
    • What is KSQLDB
    • Why KSQLDB
    • Hands-on Exercise(s)
“I appreciated the instructor's technique of writing live code examples rather than using fixed slide decks to present the material.”


Dive in and learn more

When transforming your workforce, it's important to have expert advice and tailored solutions. We can help. Tell us your unique needs and we'll explore ways to address them.

Let's chat

By filling out this form and clicking submit, you acknowledge our privacy policy.