This course is a technical introduction to Kafka Connect and how to use it to quickly transfer data in and out of the Apache Kafka ecosystem, to and from common data systems like databases, key-value stores, search indexes, and file systems.
You may be wondering why the word "Connect" has suddenly sprung up next to "Kafka". Isn’t Kafka a Distributed Streaming Platform? Well, Kafka is more than that. Apache Kafka is an entire ecosystem and Kafka Connect is a part of it. In this course, Kafka Connect Fundamentals, you will gain the ability to create your own real-time ETL pipelines from and to Apache Kafka. First, you will learn what the ETL model is and how to set up your own ETL pipeline using Kafka Connect. Next, you will discover the inner details of Kafka Connect by exploring its architecture. Finally, you will explore how to successfully manage your Kafka Connect installation in a production environment. When you are finished with this course, you will have the skills and knowledge of Kafka Connect needed to set up, build, and maintain your own Kafka Connect installation.
Bogdan Sucaciu is a Software Engineer at Axual in The Netherlands, where he is taking part in building a Streaming Platform designed to share information in real-time, enabling instant processing of incoming events.
He has several years of experience "cooking" software with JVM-based languages, some flavors of web technologies and garnishing with automated testing.
Course Overview [Autogenerated] Hi, My name is broken. So catch you and welcome to my course Casca Connect fundamentals. I'm a ticket, but actually in the Netherlands, where I'm taking part in building a streaming platform designed to share information in real time. You may be wondering where the word connect has suddenly sprung up in CAF Connect. Isn't caf got a distributed assuming platform? Well, he's more than that. Apache Kafka is an entire ecosystem and capture connect this part of it in the scores. We're going to explore how we can leverage Kafka Connect to quickly transfer data in and out off the Apache Kafka ecosystem to and from common data systems like databases, Key Value Store's searching exists and follow systems. Some of the major topics that will cover include building real time video pipelines using Apache Kafka deep dive into calf, connects architecture, creating and customizing your own connector, and also some tips and tricks that will help you to run Cathcart connecting production. By the end of this course, you should be comfortable to set up your own data processing pipeline using Apache, Kafka and Kafka Connect and safely around it without any surprises before beginning the course you should already be familiar with Apache Kafka concepts, any ecosystem. Also, I'll be using Dr Continuously to keep the differences between systems to a minimum. So it shouldn't matter if you swing those lean ox or Mac. Finally, we're going to build our own connector and customize it using Java. So a basic understanding off the Java programming language would definitely help you to follow along. I hope you'll join me on this journey to learn CAF connect with the CAF connect. Fundamental. Of course, there's blower side.