- A Cloud Guru
Tuning a Kafka Producer
Configuring Kafka producers is a relatively simple process. The real challenge is knowing what configuration options to change in order to tune the producer for your use case. In this lab, you will have the opportunity to work hands-on with the process of tuning a Kafka producer. You will be presented with a few issues that can be addressed through configuration tuning. You will then need to determine what configuration changes to make in order to address these issues, and you will need to implement those changes in the producer.
Table of Contents
Clone the Starter Project from GitHub and Perform a Test Run
Clone the starter project from GitHub.:
cd ~/ git clone https://github.com/linuxacademy/content-ccdak-producer-tuning-lab.git
Perform a test run to make sure the code is able to compile and run:
cd content-ccdak-producer-tuning-lab ./gradlew run
The code should compile, and tests should succeed.
Implement the Configuration Changes in the Producer
Open the file:
Fix the issue with data loss by setting
Fix the out-of-order record issue caused by retries by setting
Increase the batch size by setting
Run your code to verify that it still works:
What's a lab?
Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.