Kafka: Build, Deploy, and Monitor Your First Real-world Application
Course info
Course info
Description
Companies nowadays are finding it critical to be able to gather and analyze massive amounts of disparately sourced data, quickly and reliably. In this course, Kafka: Build, Deploy, and Monitor Your First Real-world Application, you'll learn how it can be more than a superior, distributed messaging system, but a platform to handle all your stream processing needs. First, you’ll review the basics; topics, producers, consumers, and beyond. Then, you’ll discover how to operationalize your data pipelines. Finally, you'll learn how easily maintaining and monitoring the data pipeline throughout a full production lifecycle. By the end of this course, you’ll have learned how to use Kafka for many of your data needs, merging the worlds of data consuming, processing, and devops.
About the author
Justin is a software journeyman, continuously learning and honing his skills.
More from the author
Section Introduction Transcripts
Course Overview (Will be moved to Module 1 after edits)
Hi everyone, my name is Justin Pihony, and welcome to my course, Kafka: Build, Deploy, and Monitor Your First Real-world Application. Being the developer support manager at Lightbend has provided me with a lot of insight into the inner workings of Kafka, and this course will pass much of that information to you. Kafka has become the go-to messaging intermediary in the distributed processing world, but navigating its many configuration options and having he appropriate monitoring knowhow can be challenging. In this course, we're going to provide Kafka clarity by taking a project through the entire software lifecycle, first, reviewing the basics of Kafka, covering producers, consumers, brokers, and more, such that we can then learn how to turn the knobs and levers to achieve the most optimal production, storage, and consumption of your data, covering a vast swath of the available configurations, especially finishing on the DevOps side where we'll cover the most vital metrics needed for successfully monitoring a running Kafka application, even building a full monitoring solution using Prometheus and Grafana to visualize those learned metrics. By the end of the course, you should be ready to handle just about any aspect of a Kafka application, whether it be developing, tuning, monitoring, or more. I hope you'll join me on this journey to learn about Apache Kafka from beginning to end with the Kafka: Build, Deploy, and Monitor Your First Real-world Application course, at Pluralsight.