Browsing Tag

open source

176 posts
Data Streaming with Apache Kafka and Flink in the Media Industry at Netflix Disney Plus Hotstar and Reliance JioCinema
Read More
  • 1.9K views
  • 8 minute read

Data Streaming with Apache Kafka and Flink in the Media Industry: Disney+ Hotstar and JioCinema

The $8.5 billion merger of Disney+ Hotstar and Reliance’s JioCinema marks a transformative moment for India’s media industry, combining two of the most influential streaming platforms into a data streaming powerhouse. This blog explores how technologies like Apache Kafka and Flink power these platforms, enabling massive-scale content distribution, real-time analytics, and user engagement. With tools like MirrorMaker and Cluster Linking, the merger presents opportunities for seamless Kafka migrations, hybrid multi-cloud flexibility, and new innovations like multi-angle viewing and advanced personalization. The transparency of both platforms about their Kafka-based architectures highlights their technical leadership and the lessons they offer the data streaming community. The integration of their infrastructures sets the stage for redefining media streaming in India, offering exciting insights and benchmarks for organizations leveraging data streaming at scale.
Read More
0
0
0
Online Model Training and Model Drift in Machine Learning with Apache Kafka and Flink
Read More
  • 1.3K views
  • 5 minute read

Online Model Training and Model Drift in Machine Learning with Apache Kafka and Flink

The rise of real-time AI and machine learning is reshaping the competitive landscape. Traditional batch-trained models struggle with model drift, leading to inaccurate predictions and missed opportunities. Platforms like Apache Kafka and Apache Flink enable continuous model training and real-time inference, ensuring up-to-date, high-accuracy predictions. This blog explores TikTok’s groundbreaking AI architecture, its use of data streaming for real-time recommendations, and how businesses can leverage Kafka and Flink to modernize their ML pipelines. I also examine how data streaming complements platforms like Databricks, Snowflake, and Microsoft Fabric to create scalable, adaptive AI systems.
Read More
0
0
0
Tesla Energy Platform - The Power of Data Streaming with Apache Kafka
Read More
  • 2.5K views
  • 7 minute read

Tesla Energy Platform – The Power of Data Streaming with Apache Kafka

Tesla’s Virtual Power Plant (VPP) turns thousands of home batteries, solar panels, and energy storage systems into a coordinated, intelligent energy network. By leveraging Apache Kafka for event streaming and WebSockets for real-time IoT connectivity, Tesla enables instant energy redistribution, dynamic grid balancing, and automated market participation. This event-driven architecture ensures millisecond-level decision-making, allowing homeowners to optimize energy usage and utilities to stabilize power grids. Tesla’s approach highlights how real-time data streaming and intelligent automation are reshaping the future of decentralized, resilient, and sustainable energy systems.
Read More
0
0
0
Top 10 Real Time Innovations in FinServ with Data Streaming using Apache Kafka and Flink
Read More
  • 2.8K views
  • 10 minute read

How Data Streaming with Apache Kafka and Flink Drives the Top 10 Innovations in FinServ

The financial industry is rapidly shifting toward real-time, intelligent, and seamlessly integrated services. From IoT payments and AI-driven banking to embedded finance and RegTech, financial institutions must process vast amounts of data instantly and securely. Data Streaming with Apache Kafka and Apache Flink provides the backbone for real-time payments, fraud detection, personalized financial insights, and compliance automation. This blog post explores the top 10 emerging financial technologies and how data streaming enables them, helping banks, fintechs, and central institutions stay ahead in the future of finance.
Read More
0
0
0
Read More
  • 1.0K views
  • 6 minute read

Free Ebook: Data Streaming Use Cases and Industry Success Stories Featuring Apache Kafka and Flink

Real-time data is no longer optional—it’s essential. Businesses across industries use data streaming to power insights, optimize operations, and drive innovation. After 7+ years at Confluent, I’ve seen firsthand how Apache Kafka and Flink transform organizations. That’s why I wrote The Ultimate Data Streaming Guide: Concepts, Use Cases, Industry Stories—a free eBook packed with insights, real-world examples, and best practices. Download your free copy now and start your data streaming journey!
Read More
0
0
0
Data Streaming with Apache Kafka and Flink vs Visual Coding with Low-Code No-Code
Read More
  • 2.1K views
  • 9 minute read

Why Generative AI and Data Streaming Are Replacing Visual Coding with Low-Code / No-Code Platforms

Low-code/no-code tools have revolutionized software development and data engineering by providing visual interfaces that empower non-technical users. However, their limitations in scalability, consistency, and integration pose significant challenges in modern, real-time architectures. Generative AI is emerging as a game-changer, offering unprecedented flexibility and customization, addressing many of the pitfalls of traditional low-code/no-code platforms. Simultaneously, the data ecosystem is evolving with Apache Kafka and Flink, enabling real-time, event-driven architectures that resolve inefficiencies of fragmented, batch-driven systems. This blog explores the evolution of low-code/no-code tools, their challenges, when (not) to use visual coding, and how generative AI and data streaming are reshaping the landscape.
Read More
0
0
0
SaaS vs PaaS Cloud Service for Data Streaming with Apache Kafka and Flink
Read More
  • 1.9K views
  • 6 minute read

Fully Managed (SaaS) vs. Partially Managed (PaaS) Cloud Services for Data Streaming with Kafka and Flink

The cloud revolution has reshaped how businesses deploy and manage data streaming with solutions like Apache Kafka and Flink. Distinctions between SaaS and PaaS models significantly impact scalability, cost, and operational complexity. Bring Your Own Cloud (BYOC) expands the options, giving businesses greater flexibility in cloud deployment. Misconceptions around terms like “serverless” highlight the need for deeper analysis to avoid marketing pitfalls. This blog explores deployment options, enabling informed decisions tailored to your data streaming needs.
Read More
0
0
0
Virgin Australia Journey with Apache Kafka - Innovation in the Airline and Aviation Industry
Read More
  • 1.7K views
  • 5 minute read

Virgin Australia’s Journey with Apache Kafka: Driving Innovation in the Airline Industry

Data streaming with Apache Kafka and Flink is transforming the airline industry, enabling real-time efficiency and exceptional customer experiences. Virgin Australia exemplifies this innovation to modernize its Flight State Engine and overhaul its loyalty program. By embracing event-driven architecture, the airline has improved operational reliability and personalized services, setting a benchmark for aviation digitalization.
Read More
0
0
0
Stateless and Stateful Stream Processing with Kafka Streams and Apache Flink
Read More
  • 3.1K views
  • 8 minute read

Stateless vs. Stateful Stream Processing with Kafka Streams and Apache Flink

The rise of stream processing has changed how we handle and act on data. While traditional databases, data lakes, and warehouses are effective for many batch-based use cases, they fall short in scenarios demanding low latency, scalability, and real-time decision-making. This post explores the key concepts of stateless and stateful stream processing, using Kafka Streams and Apache Flink as examples.
Read More
0
0
0
Data Streaming with Apache Kafka and Flink in Healthcare and Manufacturing at Siemens Healthineers
Read More
  • 2.4K views
  • 6 minute read

How Siemens Healthineers Leverages Data Streaming with Apache Kafka and Flink in Manufacturing and Healthcare

Siemens Healthineers, a global leader in medical technology, delivers solutions that improve patient outcomes and empower healthcare professionals. A significant aspect of their technological prowess lies in their use of data streaming to unlock real-time insights and optimize processes. This blog post explores how Siemens Healthineers uses data streaming with Apache Kafka and Flink, their cloud-focused technology stack, and the use cases that drive tangible business value, such as real-time logistics, robotics, SAP ERP integration, AI/ML, and more.
Read More
0
0
0