Apache Iceberg – The Open Table Format for Lakehouse AND Data Streaming

1 year ago

An open table format framework like Apache Iceberg is essential in the enterprise architecture to ensure reliable data management and…

The Digitalization of Airport and Airlines with IoT and Data Streaming using Kafka and Flink

1 year ago

The vision for a digitalized airport includes seamless passenger experiences, optimized operations, consistent integration with airlines and retail stores, and…

Energy Trading with Apache Kafka and Flink

1 year ago

Energy trading and data streaming are connected because real-time data helps traders make better decisions in the fast-moving energy markets.…

Hello, K.AI – How I Trained a Chatbot of Myself Without Coding Evaluating OpenAI Custom GPT, Chatbase, Botsonic, LiveChatAI

1 year ago

Generative AI (GenAI) enables many new use cases for enterprises and private citizens. While I work on real-time enterprise scale…

The Shift Left Architecture – From Batch and Lakehouse to Real-Time Data Products with Data Streaming

1 year ago

Data integration is a hard challenge in every enterprise. Batch processing and Reverse ETL are common practices in a data…

Apache Kafka in Manufacturing at Automotive Supplier Brose for Industrial IoT Use Cases

1 year ago

Data streaming unifies OT/IT workloads by connecting information from sensors, PLCs, robotics and other manufacturing systems at the edge with…

Real-Time GenAI with RAG using Apache Kafka and Flink to Prevent Hallucinations

1 year ago

How do you prevent hallucinations from large language models (LLMs) in GenAI applications? LLMs need real-time, contextualized, and trustworthy data…

Open Standards for Data Lineage: OpenLineage for Batch AND Streaming

2 years ago

One of the greatest wishes of companies is end-to-end visibility in their operational and analytical workflows. Where does data come…

My Data Streaming Journey with Kafka & Flink: 7 Years at Confluent

2 years ago

Time flies… I joined Confluent seven years ago when Apache Kafka was mainly used by a few tech giants and…

Apache Kafka + Flink + Snowflake: Cost Efficient Analytics and Data Governance

2 years ago

Snowflake is a leading cloud data warehouse and transitions into a data cloud that enables various use cases. The major…