Kai Waehner

314 posts

builds cloud-native event streaming infrastructures for real-time data processing and analytics

Apache Kafka for Public Utilities and Energy Sector

2.1K views
6 minute read

Apache Kafka in the Public Sector – Part 4: Energy and Utilities

ByKai Waehner
18. October 2021
No comments

The public sector includes many different areas. Some groups leverage cutting-edge technology, like military leverage. Others like the public administration are years or even decades behind. This blog series explores both edges to show how data in motion powered by Apache Kafka adds value for innovative new applications and modernizing legacy IT infrastructures. This is part 4: Use cases and architectures for energy, utilities, and smart grid infrastructures.

Apache Kafka for Government and Citizen Services in the Public Sector

2.0K views
5 minute read

Apache Kafka in the Public Sector – Part 3: Government and Citizen Services

ByKai Waehner
15. October 2021
No comments

The public sector includes many different areas. Some groups leverage cutting-edge technology, like military leverage. Others like the public administration are years or even decades behind. This blog series explores both edges to show how data in motion powered by Apache Kafka adds value for innovative new applications and modernizing legacy IT infrastructures. This is part 3: Use cases and architectures for Government and Citizen Services.

Apache Kafka in the Public Sector for Smart City Infrastructure

2.4K views
6 minute read

Apache Kafka in the Public Sector – Part 2: Smart City

ByKai Waehner
12. October 2021
No comments

2.5K views
4 minute read

Apache Kafka in the Public Sector – Blog Series about Use Cases and Architectures

ByKai Waehner
7. October 2021
1 share
No comments

The public sector includes many different areas. Some groups leverage cutting-edge technology, like military leverage. Others like the public administration are years or even decades behind. This blog series explores both edges to show how data in motion powered by Apache Kafka adds value for innovative new applications and modernizing legacy IT infrastructures. Examples include a broad spectrum of use cases across smart cities, citizen services, energy and utilities, and national security.

Reverse ETL Anti Pattern vs Event Streaming with Apache Kafka

5.7K views
9 minute read

When to Use Reverse ETL and when it is an Anti-Pattern

ByKai Waehner
30. September 2021
1 share
No comments

This blog post explores why software vendors (try to) introduce new solutions for Reverse ETL, when Reverse ETL is really needed, and how it fits into the enterprise architecture. The involvement of event streaming to process data in motion is a key piece of Reverse ETL for real-time use cases.

Kappa Architecture vs Lambda Architecture for Apache Kafka Pulsar Data Lakes

29.6K views
17 minute read

Kappa Architecture is Mainstream Replacing Lambda

ByKai Waehner
23. September 2021
4 shares
4 comments

Real-time data beats slow data. That’s true for almost every use case. Nevertheless, enterprise architects build new infrastructures with the Lambda architecture that includes separate batch and real-time layers. This blog post explores why a single real-time pipeline, called Kappa architecture, is the better fit. Real-world examples from companies such as Disney, Shopify, Uber, and Twitter explore the benefits of Kappa but also show how batch processing fits into this discussion positively without the need for Lambda.

Cloud Native Telecom 5G MEC OSS BSS OTT powered by Kubernetes and Apache Kafka

2.1K views
2 minute read

Cloud-Native 5G, MEC and OSS/BSS/OTT Telco with Apache Kafka and Kubernetes

ByKai Waehner
6. September 2021
No comments

This post shares a slide deck and video recording for architectures and use cases for event streaming with the open-source frameworks Kubernetes and Apache Kafka in the Telco sector. Demonstrated use cases include building 5G networks, NFV management and orchestration, proactive OSS network monitoring, integration with hybrid and multi-cloud BSS and OTT services.

1.8K views
5 minute read

Panel Discussion about Kafka, Edge, Networking and 5G in Oil and Gas and Mining Industry

ByKai Waehner
20. August 2021
No comments

The oil & gas and mining industries require edge computing for low latency and zero trust use cases. Most IT architectures are hybrid with big data analytics in the cloud and safety-critical data processing in disconnected and often air-gapped environments. This blog post shares a panel discussion that explores the challenges, use cases, and hardware/software/network technologies to reduce cost and innovate. A key focus is on the open-source framework Apache Kafka, the de facto standard for processing data in motion at the edge and in the cloud.

SIEM and SOAR Modernization with Apache Kafka Elasticsearch Splunk QRadar Arcsight Cortex

4.9K views
10 minute read

Kafka for Cybersecurity (Part 6 of 6) – SIEM / SOAR Modernization

ByKai Waehner
9. August 2021
No comments

This blog series explores use cases and architectures for Apache Kafka in the cybersecurity space, including situational awareness, threat intelligence, forensics, air-gapped and zero trust environments, and SIEM / SOAR modernization. This post is part six: SIEM / SOAR modernization and integration.