Path icon Learning Paths
Skills

Handling Streaming Data with Messaging Systems

  • Number of Courses11 courses
  • Duration29 hours
  • Skill IQ available Skill IQ

Processing streaming data poses unique challenges that traditional batch data systems are unable to handle. Messaging systems are a useful platform for managing and processing streams of data. In this skill, you will learn the foundations of messaging systems used in streaming data processing, including Kafka, Pulsar, AWS Kinesis, Azure Event Hub, and Google Cloud Pub/Sub.

Courses in this path

Beginner

Learn the basis of processing streaming data using Kafka.

Deploying a Kafka 2 Cluster

  • by Pawe Kordek
  • 2h 30m 41s Duration
  • 4.5  (42)

Handling Streaming Data with a Kafka Cluster

  • by Bogdan Sucaciu
  • 2h 9m 57s Duration
  • 4.6  (59)

Intermediate

Learn to migrate your streaming data systems to the cloud, using Apache Pulsar, AWS Kinesis, Azure Event Hub, and Google Cloud Pub/Sub.

Deploying Apache Pulsar to Google Kubernetes Engine

  • by James Wilson
  • 2h 27m 27s Duration

Handling Streaming Data with Apache Pulsar 2

  • by Axel Sirota
  • 2h 7m 37s Duration
  • 3.3  (11)

Developing Stream Processing Applications with AWS Kinesis

  • by Ivan Mushketyk
  • 4h 11m 29s Duration
  • 4.6  (53)

Handling Streaming Data with Azure Event Hub

  • by Eugene Meidinger
  • 2h 23m 53s Duration
  • 4.4  (40)

Architecting Stream Processing Solutions Using Google Cloud Pub/Sub

  • by Vitthal Srinivasan
  • 1h 44m 22s Duration
  • 4.3  (23)

Kafka Connect Fundamentals

  • by Bogdan Sucaciu
  • 2h 14m 33s Duration
  • 4.5  (55)

Building ETL Pipelines from Streaming Data with Kafka and ksqlDB

  • by Eugene Meidinger
  • 2h 35m 17s Duration
  • 4.4  (25)

Advanced

Enforce data contracts and implement event logs using Kafka event processing features.

Enforcing Data Contracts with Kafka Schema Registry

  • by Bogdan Sucaciu
  • 2h 30m 21s Duration
  • 4.6  (27)

Implementing an Event Log with Kafka

  • by Ivan Mushketyk
  • 3h 35m 26s Duration
  • 4.9  (62)

Learn with the best

Pawe Kordek
Pawe Kordek
Paweł is a software engineer passionate about knowledge sharing. He's especially focused on processing and exploring data sets (be it big or small) and is always searching for emerging tools that will make working with data simpler in the future. Paweł is currently at Farfetch where he develops data applications and sees his favorite tools like Pandas, Kafka or ElasticSearch (just to name a few) being applied to solve complex business problems. He mostly works with JVM languages and Python, but ... more
Bogdan Sucaciu
Bogdan Sucaciu
Software Engineer by day, Pluralsight author by night, Bogdan likes to experiment with cutting-edge technologies and teach about them. His favorite talking subjects are streaming data, event-driven architectures, distributed systems, and cloud technologies. He has several years of experience “cooking” software with JVM based languages, some flavors of web technologies, and garnishing with automated testing. He holds a BS in Robotics where he spent countless hours programming microcontrollers an... more
James Wilson
James Wilson
As a mobile developer, James always had a passion for building exciting apps and always striving to make user interfaces that were easy and intuitive to use. Today, he is focusing on building Augmented Reality applications that scale. Never satisfied with his knowledge, he is a life-long learner and is always interested in looking to grow and learn and then shares his knowledge with others. James has worked in a wide array of fields whether as a technician working with radar and communication... more
Axel Sirota
Axel Sirota
Axel Sirota is a Microsoft Certified Trainer with a deep interest in Deep Learning and Machine Learning Operations. He has a Masters degree in Mathematics and after researching in Probability, Statistics and Machine Learning optimisation, he works as an AI and Cloud Consultant as well as being an Author and Instructor at Pluralsight, Develop Intelligence, and O'Reilly Media.
Ivan Mushketyk
Ivan Mushketyk
Ivan is a Principal Software Engineer and a Tech Lead who is passionate about Big Data and Cloud Computing. He has worked for numerous big IT companies including Samsung and Amazon Web Services. He is an Open Source enthusiast and has contributed to a number of projects including Gatling and Apache Flink. When he is not writing code or working on a new course, he is probably writing another technical article for his blog.
Eugene Meidinger
Eugene Meidinger
Eugene Meidinger works as an independent BI consultant and Pluralsight author, specializing in Power BI and the Azure Data Platform. He has been working with data for over 8 years and speaks regularly at user groups and conferences. He also helps run the GroupBy online conference.
Vitthal Srinivasan
Vitthal Srinivasan
Vitthal has spent a lot of his life studying - he holds Masters Degrees in Math and Electrical Engineering from Stanford, an MBA from INSEAD, and a Bachelors Degree in Computer Engineering from Mumbai. He has also spent a lot of his life working - as a derivatives quant at Credit Suisse in New York, then as a quant trader, first with a hedge fund in Greenwich and then on his own, and finally at Google in Singapore and Flipkart in Bangalore. In all these roles, he has written a lot of code, and b... more

Join our learners and upskill
in leading technologies