Browsing Category

Apache Flink

75 posts
Flink CEP - When and how to use it
Read More
  • 1.9K views
  • 16 minute read

Complex Event Processing (CEP) with Apache Flink: What It Is and When (Not) to Use It

Complex Event Processing is the most underused capability in Apache Flink. It detects meaningful event sequences in real time, fires only when a pattern is confirmed, and even catches events that never arrive. This guide covers what Flink CEP is, when to reach for it instead of stream processing, how to implement it, and what happened to the legacy CEP market.
Read More
0
0
0
dbt Meets Open Source Apache Flink Plugin - One Data Engineering SQL Tool for ETL Integration in Batch and Streaming
Read More
  • 3.7K views
  • 7 minute read

dbt Meets Apache Flink: One Workflow for Data Engineers on Snowflake, BigQuery, Databricks, and Confluent

Two toolchains, two skill sets, two CI/CD pipelines — that has been the reality for data engineers working across batch and streaming. dbt extending to Apache Flink changes that equation. One workflow, one tool, one engineering team for both worlds.
Read More
0
0
1
Shift Left Architecture 2.0 for the Era of Agentic AI with Kafka Flink Iceberg and MCP
Read More
  • 2.3K views
  • 10 minute read

The Shift Left Architecture 2.0: Operational, Analytical and AI Interfaces for Real-Time Data Products

The Shift Left Architecture moves data integration logic into an event-driven architecture where governed data products are built once and served to multiple consumers. The original pattern covered two interfaces: operational via Apache Kafka and analytical via Apache Iceberg. This post introduces the third: AI applications via MCP, powered by a real-time context engine that gives AI agents access to current operational data. Governance spans the full data stack through enterprise catalog tools. Together, the three interfaces turn a single data streaming investment into the foundation for operational, analytical, and AI-powered enterprise software.
Read More
0
0
0
Data Streaming and AI Telco Trends at MWC 2026 in Barcelona
Read More
  • 4.9K views
  • 8 minute read

Data Streaming at MWC 2026: How Apache Kafka, Flink and Agentic AI Power Telecom Trends

Mobile World Congress (MWC) 2026 highlights the shift from batch systems to real time data streaming in telecom. AI and agentic automation, network APIs, sovereign cloud, autonomous networks, and 5G monetization all depend on continuous, governed data flows at scale. A Data Streaming Platform built on Apache Kafka and Apache Flink enables operators to collect, process, and act on live data across network and business systems. It provides the foundation for applied AI, SLA enforcement, API monetization, and usage based billing. MWC shows that telecom innovation and measurable business value now rely on real time data streaming.
Read More
0
0
0
Qantas Airline Data Streaming Platform with Apache Kafka for Airline Operations
Read More
  • 3.5K views
  • 5 minute read

From Takeoff to Touchdown: Real-Time Aviation with Data Streaming at Qantas

This blog post explores how data streaming transforms airline operations by enabling real-time visibility, faster decision-making, and improved customer experience. Using Qantas as a leading example, it highlights how a modern data streaming platform powered by Apache Kafka supports flight operations, crew coordination, baggage handling, and airport collaboration. It also explains technical integrations using Kafka Connect for AIDX message processing. The Qantas story illustrates how real-time data creates tangible business value across the aviation industry.
Read More
0
0
0
Data Streaming in Automotive Industry with Apache Kafka and Flink for Connected Vehicles Cars using Shift Left Architecture Telemetry Signal Processing
Read More
  • 4.4K views
  • 9 minute read

Shift Left in Automotive: Real-Time Intelligence from Vehicle Telemetry with Data Streaming at Rivian

Rivian and Volkswagen, through their joint venture RV Tech, process high-frequency telemetry from connected vehicles using Apache Kafka and Apache Flink. With a shift left architecture and smart filtering, they reduced data volume by 88 percent and enabled over 250 downstream consumer applications to access curated data products. This blog explores how RV Tech transforms raw vehicle data into real-time intelligence, supporting use cases across engineering, operations, and customer experience.
Read More
0
0
0
Real Time Airline Operations at Etihad Airways with Data Streaming Using Apache Kafka and Flink
Read More
  • 3.7K views
  • 5 minute read

Etihad Airways Makes Airline Operations Real-Time with Data Streaming

Airlines face constant pressure to deliver reliable service while managing complex operations and rising customer expectations. This blog post explores how Etihad Airways uses real-time data streaming with Apache Kafka and Flink to improve operational efficiency and passenger experience. Based on a presentation at the Data Streaming World Tour in Dubai, it highlights how Etihad built an event-driven platform to move from delayed insights to real-time action. The post also connects this story to other data streaming success cases in the aviation industry, including Lufthansa , Cathay Pacific, Virgin Australia, and Schiphol Airport in Amsterdam.
Read More
0
0
0
Stream Processing on the IBM Mainframe with Apache Flink - Genius or a Glitch in the Matrix
Read More
  • 3.1K views
  • 6 minute read

Stream Processing on the Mainframe with Apache Flink: Genius or a Glitch in the Matrix?

Running Apache Flink on a mainframe may sound surprising, but it is already happening and for good reason. As modern mainframes like IBM z17 evolve to support Linux, Kubernetes, and AI workloads, they are becoming a powerful platform for real-time stream processing. This blog explores why enterprises are deploying Apache Flink on IBM LinuxONE, how it works in practice, and what business value it brings. With Kafka providing the data backbone, Flink enables intelligent processing close to where business-critical data lives. The result is a modern hybrid architecture that connects core systems with cloud-based innovation without needing to fully migrate off the mainframe.
Read More
0
0
0
Data Streaming Trends for 2026 with Apache Kafka Flink Diskless Cloud Agentic AI
Read More
  • 19.1K views
  • 9 minute read

Top Trends for Data Streaming with Apache Kafka and Flink in 2026

Each year brings new momentum to the data streaming space. In 2026, six key trends stand out. Platforms and vendors are consolidating. Diskless Kafka and Apache Iceberg are reshaping storage. Real-time analytics is moving into the stream. Enterprises demand zero data loss and regional compliance. Streaming is now powering operational AI with real-time context. Data streaming has evolved. It is now strategic infrastructure at the heart of modern enterprise systems.
Read More
0
0
0
Automotive Innovation with Data Streaming using Apache Kafka Flink Confluent at CARIAD Volkswagen Group VW
Read More
  • 9.4K views
  • 6 minute read

CARIAD’s Unified Data Platform: A Data Streaming Automotive Success Story Behind Volkswagen’s Software-Defined Vehicles

The automotive industry transforms rapidly. Cars are now software-defined vehicles (SDVs) that demand constant, real-time data flow. This post highlights the CARIAD success story inside the Volkswagen Group. CARIAD tackled data fragmentation. It built the Unified Data Ecosystem (UDE). Learn how Confluent’s data streaming platform, powered by Apache Kafka and Flink, serves as the central nervous system. This platform connects millions of vehicles and cloud services globally. The event-driven architecture helps CARIAD achieve faster development, meet compliance (like the EU Data Act), and reduce costs. The platform unlocks high-value use cases, such as predictive maintenance and AI-powered fleet management.
Read More
0
0
0