Browsing Tag

apache kafka

37 posts
Data Lineage for Data Streaming with OpenLineage Apache Kafka and Flink
Read More
  • 11.8K views
  • 11 minute read

Open Standards for Data Lineage: OpenLineage for Batch AND Streaming

One of the greatest wishes of companies is end-to-end visibility in their operational and analytical workflows. Where does data come from? Where does it go? To whom am I giving access to? How can I track data quality issues? The capability to follow the data flow to answer these questions is called data lineage. This blog post explores market trends, efforts to provide an open standard with OpenLineage, and how data governance solutions from vendors such as IBM, Google, Confluent and Collibra help fulfil the enterprise-wide data governance needs of most companies, including data streaming technologies such as Apache Kafka and Flink.
Read More
0
0
0
When NOT to use Apache Kafka
Read More
  • 3.4K views
  • 3 minute read

When NOT to Use Apache Kafka? (Lightboard Video)

Apache Kafka is the de facto standard for data streaming to process data in motion. With its significant adoption growth across all industries, I get a very valid question every week: When NOT to use Apache Kafka? What limitations does the event streaming platform have? When does Kafka simply not provide the needed capabilities? How to qualify Kafka out as it is not the right tool for the job? This blog post contains a lightboard video that gives you a twenty-minute explanation of the DOs and DONTs.
Read More
0
0
1
How Intersport uses Apache Kafka as Database with Compacted Topic in Retail
Read More
  • 3.1K views
  • 6 minute read

How the Retailer Intersport uses Apache Kafka as Database with Compacted Topic

Compacted Topic is a feature of Apache Kafka to persist and query the latest up-to-date event of a Kafka Topic. The log compaction and key/value search is simple, cost-efficient and scalable. This blog post shows in a success story of Intersport how some use cases store data long term in Kafka with no other database. The retailer requires accurate stock info across the supply chain, including the point of sale (POS) in all international stores.
Read More
0
0
0
Real Time Customer Loyalty and Reward Platform with Apache Kafka
Read More
  • 2.7K views
  • 13 minute read

Customer Loyalty and Rewards Platform with Apache Kafka

Loyalty and rewards platforms are crucial for customer retention and revenue growth for many enterprises across industries. Apache Kafka provides context-specific real-time data and consistency across all applications and databases for a modern and flexible enterprise architecture. This blog post looks at case studies from Albertsons (retail), Globe Telecom (telco), Virgin Australia (aviation), Disney+ Hotstar (sports and gaming), and Porsche (automotive) to explain the value of data streaming for improving the customer loyalty.
Read More
0
0
0
Dish Wireless Cloud-native 5G Telco Network powered by Data Streaming with Apache Kafka
Read More
  • 2.7K views
  • 8 minute read

How Apache Kafka helps Dish Wireless building cloud-native 5G Telco Infrastructure

5G telco infrastructure provides the basic foundations of data movement and increasingly unlocks new capabilities for low latency and critical SLAs. Real-time data processing with data streaming using Apache Kafka enables innovation across industries. This blog post explores the success story of Dish Wireless and its cloud-native standalone 5G infrastructure leveraging data streaming.
Read More
0
0
0
Data Streaming with Apache Kafka at Airlines - Lufthansa Case Study
Read More
  • 6.0K views
  • 5 minute read

How Lufthansa uses Apache Kafka for Middleware and Analytics

Aviation and travel are notoriously vulnerable to social, economic, and political events, as well as the ever-changing expectations of consumers. The coronavirus was just a piece of the challenge. This post explores how Lufthansa leverages data streaming powered by Apache Kafka as cloud-native middleware for mission-critical data integration projects and as data fabric for AI/machine learning scenarios such as real-time predictions in fleet management. An interactive conversation with Lufthansa as an on-demand video is added at the end as a highlight if you want to learn more.
Read More
0
0
0
The State of Data Streaming for the Public Sector in 2023
Read More
  • 2.4K views
  • 5 minute read

The State of Data Streaming for the Public Sector

This blog post explores the state of data streaming for the public sector and government. Data streaming provides consistency across all layers and allows integrating and correlating data in real-time at any scale. I look at public sector trends to explore how Apache Kafka helps as a business enabler, including case studies from the US Department of Defense (DoD), NASA, Deutsche Bahn (German Railway), and others. A complete slide deck and on-demand video recording are included.
Read More
0
0
0
From Smart Factory to Cloud with Data Streaming
Read More
  • 5.1K views
  • 4 minute read

Data Streaming from Smart Factory to Cloud

A smart factory organizes itself without human intervention to produce the desired products. This blog post explores how data streaming powered by Apache Kafka helps connect and move data to the cloud at scale in real-time, including a case study from BMW and a simple lightboard video about the related enterprise architecture.
Read More
0
0
0
Apache Kafka for Data Consistency (and Real-Time Data Streaming)
Read More
  • 6.8K views
  • 6 minute read

Apache Kafka for Data Consistency (and Real-Time Data Streaming)

Real-time data beats slow data in almost all use cases. But as essential is data consistency across all systems, including non-real-time legacy systems and modern request-response APIs. Apache Kafka’s most underestimated feature is the storage component based on the append-only commit log. It enables loose coupling for domain-driven design with microservices and independent data products in a data mesh. This blog post explores how Kafka enables data consistency with a real-world case study from financial services.
Read More
10
0
0
Top Use Cases and Architectures for Data Streaming with Apache Kafka in 2023
Read More
  • 5.8K views
  • 7 minute read

Top 5 Data Streaming Trends for 2023

Data Streaming is one of the most relevant buzzwords in tech to build scalable real-time applications in the cloud and innovative business models. Do you wonder about my predicted TOP 5 data streaming trends in 2023 to set data in motion? Check out the following presentation and learn what role Apache Kafka plays. Learn about decentralized Data Mesh, cloud-native lakehouse, data sharing, improved user experience, and advanced data governance.
Read More
0
0
0