Browsing Category

Data in Motion

15 posts
Kappa Architecture vs Lambda Architecture for Apache Kafka Pulsar Data Lakes
Read More
  • 32.1K views
  • 17 minute read

Kappa Architecture is Mainstream Replacing Lambda

Real-time data beats slow data. That’s true for almost every use case. Nevertheless, enterprise architects build new infrastructures with the Lambda architecture that includes separate batch and real-time layers. This blog post explores why a single real-time pipeline, called Kappa architecture, is the better fit. Real-world examples from companies such as Disney, Shopify, Uber, and Twitter explore the benefits of Kappa but also show how batch processing fits into this discussion positively without the need for Lambda.
Read More
1
0
3
Apache Kafka in the Automotive Industry including Car Makers Tier 1 Suppliers Manufacturing Connected Cars Mobility Services Smart City
Read More
  • 4.8K views
  • 9 minute read

Real-World Deployments of Kafka in the Automotive Industry

Apache Kafka became the central nervous system of many applications in various different areas related to the automotive industry. This blog post explores various real-world deployments across several fields including connected vehicles, smart manufacturing, and innovative mobility services. Examples include car makers such as Audi, BMW, Porsche, and Tesla, plus a few mobility services such as Uber, Lyft, and Here Technologies.
Read More
0
0
0
Cyber Situational Awareness with Apache Kafka
Read More
  • 4.1K views
  • 8 minute read

Kafka for Cybersecurity (Part 2 of 6) – Cyber Situational Awareness

This blog series explores use cases and architectures for Apache Kafka in the cybersecurity space, including situational awareness, threat intelligence, forensics, air-gapped and zero trust environments, and SIEM / SOAR modernization. This post is part two: Situational awareness with continuous real-time data integration and data processing at scale.
Read More
0
0
0
Apache Kafka - The Backbone for Cybersecurity including SIEM and SOAR
Read More
  • 6.5K views
  • 8 minute read

Kafka for Cybersecurity (Part 1 of 6) – Data in Motion as Backbone

This blog series explores use cases and architectures for Apache Kafka in the cybersecurity space, including situational awareness, threat intelligence, forensics, air-gapped and zero trust environments, and SIEM / SOAR modernization. This post is part one: Data in motion as cybersecurity backbone.
Read More
0
0
0
Serverless Kafka for Data in Motion as Rescue for Data at Rest in the Data Lake
Read More
  • 7.0K views
  • 12 minute read

Serverless Kafka in a Cloud-native Data Lake Architecture

Apache Kafka became the de facto standard for processing data in motion. Kafka is open, flexible, and scalable. Unfortunately, the latter makes operations a challenge for many teams. Ideally, teams can use a serverless Kafka SaaS offering to focus on business logic. However, hybrid scenarios require a cloud-native platform that provides automated and elastic tooling to reduce the operations burden. This blog post explores how to leverage cloud-native and serverless Kafka offerings in a hybrid cloud architecture. We start from the perspective of data at rest with a data lake and explore its relation to data in motion with Kafka.
Read More
0
0
0