ETL Archives - Kai Waehner

1.4K views
5 minute read

The Top 20 Problems with Batch Processing (and How to Fix Them with Data Streaming)

ByKai Waehner
1. April 2025

Batch processing introduces delays, complexity, and data quality issues that modern businesses can no longer afford. This article outlines the most common problems with batch workflows—ranging from outdated insights to compliance risks—and illustrates each with real-world examples. It also highlights how real-time data streaming offers a more reliable, scalable, and future-proof alternative.

Streaming ETL with Apache Kafka in Healthcare

5.5K views
4 minute read

Streaming ETL with Apache Kafka in the Healthcare Industry

ByKai Waehner
1. April 2022

IT modernization and innovative new technologies change the healthcare industry significantly. This blog series explores how data streaming with Apache Kafka enables real-time data processing and business process automation. This is part three: Streaming ETL. Examples include Babylon Health and Bayer.

21.0K views
13 minute read

When to use Apache Camel vs. Apache Kafka?

ByKai Waehner
28. January 2022
4 shares

Should I use Apache Camel or Apache Kafka for my next integration project? The question is very valid and comes up regularly. This blog post explores both open-source frameworks and explains the difference between application integration and event streaming. The comparison discusses when to use Kafka or Camel, when to combine them, when not to use them at all. A decision tree shows how you can quickly qualify out one for the other.