Kai Waehner

314 posts
builds cloud-native event streaming infrastructures for real-time data processing and analytics
Why I Replaced Deutsche Telekom DSL with Starlink Satellite Internet in Germany
Read More
  • 12.7K views
  • 13 minute read

Why I Replaced Deutsche Telekom DSL with Starlink Satellite Internet

This report summarizes my experiences using Starlink satellite internet at my home in Germany for three months in 2023. I replaced my high-speed internet DSL from Deutsche Telekom successfully. In summary, I am surprised positively and thrilled about Starlink. This blog post explores my experiences with Starlink for work and leisure, including the order and installation, pricing trade-offs, and the pros and cons of satellite network quality.
Read More
0
0
0
SAP Datasphere and Apache Kafka as Data Fabric for ERP Integration
Read More
  • 4.6K views
  • 12 minute read

SAP Datasphere and Apache Kafka as Data Fabric for S/4HANA ERP Integration

SAP is the leading ERP solution across industries around the world. Data integration with other data platforms, applications, databases, and APIs is one of the hardest challenges in the IT and software landscape. This blog post explores how SAP Datasphere in conjunction with the data streaming platform Apache Kafka enables a reliable, scalable and open data fabric for connecting SAP business objects of ECC and S/4HANA ERP with other real-time, batch, or request-response interfaces.
Read More
0
0
0
Data Streaming Landscape 2024 around Kafka Flink and Cloud
Read More
  • 9.0K views
  • 21 minute read

The Data Streaming Landscape 2024

The research company Forrester defines data streaming platforms as a new software category in a new Forrester Wave. Apache Kafka is the de facto standard used by over 100,000 organizations. Plenty of vendors offer Kafka platforms and cloud services. Many complementary open source stream processing frameworks like Apache Flink and related cloud offerings emerged. And competitive technologies like Pulsar, Redpanda, or WarpStream try to get market share leveraging the Kafka protocol. This blog post explores the data streaming landscape of 2024 to summarize existing solutions and market trends. The end of the article gives an outlook to potential new entrants in 2025.
Read More
0
0
2
MQTT Market Trends for 2024 including Sparkplug Data Governance Kafka Cloud
Read More
  • 4.4K views
  • 15 minute read

MQTT Market Trends for 2024: Cloud, Unified Namespace, Sparkplug, Kafka Integration

The lightweight and open IoT messaging protocol MQTT gets adopted more widely across industries. This blog post explores relevant market trends for MQTT: cloud deployments and fully managed services, data governance with unified namespace and Sparkplug B, MQTT vs. OPC-UA debates, and the integration with Apache Kafka for OT/IT data processing in real-time.
Read More
0
0
0
Tiered Storage for Apache Kafka - Use Cases Architecture Benefits.png
Read More
  • 7.6K views
  • 10 minute read

Why Tiered Storage for Apache Kafka is a BIG THING…

Apache Kafka added Tiered Storage to separate compute and storage. The capability enables more scalable, reliable and cost-efficient enterprise architectures. This blog post explores the architecture, use cases, benefits, and a case study for storing Petabytes of data in the Kafka commit log. The end discusses why Tiered Storage does NOT replace other databases and how Apache Iceberg might change future Kafka architectures even more.
Read More
0
0
0
Read More
  • 6.7K views
  • 10 minute read

Top 5 Trends for Data Streaming with Kafka and Flink in 2024

Do you wonder about my predicted TOP 5 data streaming trends with Apache Kafka and Flink in 2024 to set data in motion? Discover new technology trends and best practices for event-driven architectures, including data sharing, data contracts, serverless stream processing, multi-cloud architectures, and GenAI.
Read More
0
0
1
The State of Data Streaming for Healthcare in 2023 with Apache Kafka and Flink
Read More
  • 2.7K views
  • 6 minute read

The State of Data Streaming for Healthcare with Apache Kafka and Flink

This blog post explores the state of data streaming for the healthcare industry powered by Apache Kafka and Apache Flink. IT modernization and innovation with pioneering technologies like sensors, telemedicine, or AI/machine learning are explored. I look at enterprise architectures and customer stories from Humana, Recursion, BHG (former Bankers Healthcare Group), and more. A complete slide deck and on-demand video recording are included.
Read More
0
0
0
Read More
  • 16.3K views
  • 12 minute read

Apache Kafka + Vector Database + LLM = Real-Time GenAI

Generative AI (GenAI) enables advanced AI use cases and innovation but also changes how the enterprise architecture looks like. Large Language Models (LLM), Vector Databases, and Retrieval Augmentation Generation (RAG) require new data integration patterns. Data streaming with Apache Kafka and Apache Flink processes incoming data sets in real-time at scale, connects various platforms, and enables decoupled data products.
Read More
0
0
0
Dish Wireless Cloud-native 5G Telco Network powered by Data Streaming with Apache Kafka
Read More
  • 2.4K views
  • 8 minute read

How Apache Kafka helps Dish Wireless building cloud-native 5G Telco Infrastructure

5G telco infrastructure provides the basic foundations of data movement and increasingly unlocks new capabilities for low latency and critical SLAs. Real-time data processing with data streaming using Apache Kafka enables innovation across industries. This blog post explores the success story of Dish Wireless and its cloud-native standalone 5G infrastructure leveraging data streaming.
Read More
0
0
0