Kafka Streams Archives

Data Streaming Trends for 2025 - Leading with Apache Kafka and Flink

5.1K views
18 minute read

Top Trends for Data Streaming with Apache Kafka and Flink in 2025

ByKai Waehner
2. December 2024
No comments

Apache Kafka and Apache Flink are leading open-source frameworks for data streaming that serve as the foundation for cloud services, enabling organizations to unlock the potential of real-time data. Over recent years, trends have shifted from batch-based data processing to real-time analytics, scalable cloud-native architectures, and improved data governance powered by these technologies. Looking ahead to 2025, the data streaming ecosystem is set to undergo even greater changes. Here are the top trends shaping the future of data streaming for businesses.

3.4K views
3 minute read

When NOT to Use Apache Kafka? (Lightboard Video)

ByKai Waehner
26. March 2024
1 share
No comments

Apache Kafka is the de facto standard for data streaming to process data in motion. With its significant adoption growth across all industries, I get a very valid question every week: When NOT to use Apache Kafka? What limitations does the event streaming platform have? When does Kafka simply not provide the needed capabilities? How to qualify Kafka out as it is not the right tool for the job? This blog post contains a lightboard video that gives you a twenty-minute explanation of the DOs and DONTs.

Machine Learning and Data Science with Apache Kafka in Healthcare

3.6K views
4 minute read

Machine Learning and Data Science with Kafka in Healthcare

ByKai Waehner
18. April 2022
No comments

IT modernization and innovative new technologies change the healthcare industry significantly. This blog series explores how data streaming with Apache Kafka enables real-time data processing and business process automation. Real-world examples show how traditional enterprises and startups increase efficiency, reduce cost, and improve the human experience across the healthcare value chain, including pharma, insurance, providers, retail, and manufacturing. This is part five: Machine Learning and Data Science. Examples include Recursion and Humana.

Streaming ETL with Apache Kafka in Healthcare

4.7K views
4 minute read

Streaming ETL with Apache Kafka in the Healthcare Industry

ByKai Waehner
1. April 2022
No comments

Apache Kafka for Government and Citizen Services in the Public Sector

2.2K views
5 minute read

Apache Kafka in the Public Sector – Part 3: Government and Citizen Services

ByKai Waehner
15. October 2021
No comments

The public sector includes many different areas. Some groups leverage cutting-edge technology, like military leverage. Others like the public administration are years or even decades behind. This blog series explores both edges to show how data in motion powered by Apache Kafka adds value for innovative new applications and modernizing legacy IT infrastructures. This is part 3: Use cases and architectures for Government and Citizen Services.

Cyber Threat Intelligence with Apache Kafka and SIEM SOAR Machine Learning

3.2K views
6 minute read

Kafka for Cybersecurity (Part 3 of 6) – Cyber Threat Intelligence

ByKai Waehner
15. July 2021
No comments

This blog series explores use cases and architectures for Apache Kafka in the cybersecurity space, including situational awareness, threat intelligence, forensics, air-gapped and zero trust environments, and SIEM / SOAR modernization. This post is part three: Cyber Threat Intelligence.

Cyber Situational Awareness with Apache Kafka

5.2K views
8 minute read

Kafka for Cybersecurity (Part 2 of 6) – Cyber Situational Awareness

ByKai Waehner
8. July 2021
No comments

Apache Kafka and MQTT - Match Made in Heaven

16.5K views
4 minute read

Apache Kafka and MQTT (Part 1 of 5) – Overview and Comparison

ByKai Waehner
15. March 2021
25 shares
2 comments

Apache Kafka and MQTT are a perfect combination for many IoT use cases. This blog series covers various use cases across industries including connected vehicles, manufacturing, mobility services, and smart city. This is part 1: Overview + Comparison.