Kafka: Build, Deploy, and Monitor Your First Real-world Application

This course targets data developers who are looking to learn how to funnel all their disparate incoming data through a Kafka pipeline wanting to better understand and maintain it.
Course info
Level
Intermediate
Updated
Apr 1, 2019
Duration
3h 47m
Table of contents
Reviewing the Basics: Topics, Producers, and Consumers
Moving Beyond the Basics: Customizing Your Code and Broker
Production Finalization: Configuring Towards Reliable Data
Kafka DevOps
Course Overview
Description
Course info
Level
Intermediate
Updated
Apr 1, 2019
Duration
3h 47m
Description

Companies nowadays are finding it critical to be able to gather and analyze massive amounts of disparately sourced data, quickly and reliably. In this course, Kafka: Build, Deploy, and Monitor Your First Real-world Application, you'll learn how it can be more than a superior, distributed messaging system, but a platform to handle all your stream processing needs. First, you’ll review the basics; topics, producers, consumers, and beyond. Then, you’ll discover how to operationalize your data pipelines. Finally, you'll learn how easily maintaining and monitoring the data pipeline throughout a full production lifecycle. By the end of this course, you’ll have learned how to use Kafka for many of your data needs, merging the worlds of data consuming, processing, and devops.

About the author
About the author

Justin is a software journeyman, continuously learning and honing his skills.

More from the author
Apache Spark Fundamentals
Intermediate
4h 27m
Oct 27, 2015
More courses by Justin Pihony
Section Introduction Transcripts
Section Introduction Transcripts

Course Overview
Hi everyone, my name is Justin Pihony, and welcome to my course, Kafka: Build, Deploy, and Monitor Your First Real-world Application. Being the developer support manager at Lightbend has provided me with a lot of insight into the inner workings of Kafka, and this course will pass much of that information to you. Kafka has become the go-to messaging intermediary in the distributed processing world, but navigating its many configuration options and having he appropriate monitoring knowhow can be challenging. In this course, we're going to provide Kafka clarity by taking a project through the entire software lifecycle, first, reviewing the basics of Kafka, covering producers, consumers, brokers, and more, such that we can then learn how to turn the knobs and levers to achieve the most optimal production, storage, and consumption of your data, covering a vast swath of the available configurations, especially finishing on the DevOps side where we'll cover the most vital metrics needed for successfully monitoring a running Kafka application, even building a full monitoring solution using Prometheus and Grafana to visualize those learned metrics. By the end of the course, you should be ready to handle just about any aspect of a Kafka application, whether it be developing, tuning, monitoring, or more. I hope you'll join me on this journey to learn about Apache Kafka from beginning to end with the Kafka: Build, Deploy, and Monitor Your First Real-world Application course, at Pluralsight.