Expanded

Machine Learning & Apache Kafka: Bringing Intelligent Software to the Next Level

This talk compares a modern streaming architecture to traditional batch and big data alternatives and benefits.
Course info
Level
Intermediate
Updated
Oct 27, 2020
Duration
24m
Table of contents
Machine Learning & Apache Kafka: Bringing Intelligent Software to the Next Level
Description
Course info
Level
Intermediate
Updated
Oct 27, 2020
Duration
24m
Description

Machine Learning (ML) is separated into model training and model inference. ML frameworks typically use a data lake like HDFS or S3 to process historical data and train analytic models. But it’s possible to completely avoid such a data store, using a modern streaming architecture. This talk compares a modern streaming architecture to traditional batch and big data alternatives and benefits like the simplified architecture, the ability to reprocess events in the same order for training different models, and the possibility to build a scalable, mission-critical ML architecture for real-time predictions. The talk explains how this can be achieved by leveraging Apache Kafka, Tiered Storage, and TensorFlow.

About the author
About the author

Big Data LDN is the UK’s largest data and analytics conference and exhibition.

More from the author
ETL vs. ELT: Who Cares?
Intermediate
44m
Oct 27, 2020
More courses by Big Data LDN