Building, Deploying, and Monitoring Your First Apache NiFi Dataflow
This course introduces you to Apache NiFi and provides an in-depth analysis of its ideas and architecture. You will learn how convenient and flexible it is for creating and managing real-time data pipelines.
What you'll learn
The today’s fast growing and changing world of data requires a flexible, scalable, and reliable system to process and distribute data in real-time. In this course, Building, Deploying, and Monitoring Your First Apache NiFi Dataflow, you will gain the ability to comprehend why and how Apache NiFi perfectly meets these requirements. First, you will understand the high-level capabilities and objectives of Apache NiFi by directly addressing key data challenges. Next, you will discover the Apache NiFi’s main components and how they relate to the flow-based programming concept. Finally, you will explore how to set up and work with Apache NiFi. When you are finished with this course, you will have the skills and knowledge of building, deploying, and monitoring dataflows in Apache NiFi needed to manage real-time data pipelines and to automate the movement of data between disparate systems.
Table of contents
- Overview 1m
- Timeline of Apache NiFi 2m
- Listing Four Key Data Challanges 5m
- Analyzing Changing Data Integration Patterns 3m
- Identifying High-level Capabilities and Objectives of Apache NiFi 4m
- Relating Apache NiFi to Big Data Integration Challanges 3m
- Integrating Apache NiFi with Hadoop and Comparing It with Other Tools 4m
- Summary 1m
- Overview 1m
- Mapping Concepts of Flow-based Programming to Apache NiFi 2m
- Taking Apart Apache NiFi and Identifying Its Main Components 3m
- Analyzing Main Components in Detail 5m
- Examing Lifecycle of a FlowFile and Interaction with Repositories 3m
- Clustering Apache NiFi: Using Site-to-site Connections and Apache MiNiFi 3m
- Demo: Getting Familiar with the Apache NiFi UI 4m
- Summary 1m
- Overview 1m
- Differing between Service and Dataflow Monitoring 2m
- Getting to Know Inbuilt Monitoring Utilities 4m
- Demo: Monitoring the Service and Dataflow Using NiFi Summary 3m
- Demo: Using NiFi Data Provenance Tools, NiFi Counters, and Bulletins 4m
- Observing and Interacting with Queues inlcuding Demo 3m
- Exploring Custom Monitoring Functionalities 2m
- Demo: Configuring Notification Service and Utilizing MonitorActivity Processor 4m
- Demo: Configuring a Site-to-site Reporting Task 3m
- Summary 1m
About the author
Patrick has been designing, implementing, and managing data, analytics and AI applications ranging from small to large scale for over a decade by utilizing both proprietary as well as open source frameworks. He is CEO of Creative Data, a consultancy enabling sustainable data architectures. Patrick loves sharing his knowledge through online sources, technical articles and also by contributing to various open-source projects. He holds a Bachelor’s degree in Business Informatics and a Master’s degr... more