kafka Archives - Page 11 of 18

Apache Kafka - The Backbone for Cybersecurity including SIEM and SOAR

6.8K views
8 minute read

Kafka for Cybersecurity (Part 1 of 6) – Data in Motion as Backbone

ByKai Waehner
2. July 2021
No comments

This blog series explores use cases and architectures for Apache Kafka in the cybersecurity space, including situational awareness, threat intelligence, forensics, air-gapped and zero trust environments, and SIEM / SOAR modernization. This post is part one: Data in motion as cybersecurity backbone.

Serverless Kafka for Data in Motion as Rescue for Data at Rest in the Data Lake

7.3K views
12 minute read

Serverless Kafka in a Cloud-native Data Lake Architecture

ByKai Waehner
25. June 2021
1 share
No comments

Apache Kafka became the de facto standard for processing data in motion. Kafka is open, flexible, and scalable. Unfortunately, the latter makes operations a challenge for many teams. Ideally, teams can use a serverless Kafka SaaS offering to focus on business logic. However, hybrid scenarios require a cloud-native platform that provides automated and elastic tooling to reduce the operations burden. This blog post explores how to leverage cloud-native and serverless Kafka offerings in a hybrid cloud architecture. We start from the perspective of data at rest with a data lake and explore its relation to data in motion with Kafka.

8.1K views
7 minute read

Apache Kafka in the Insurance Industry

ByKai Waehner
7. June 2021
3 shares
No comments

The rise of data in motion in the insurance industry is visible across all lines of business including life, healthcare, travel, vehicle, and others. Apache Kafka changes how enterprises rethink data. This blog post explores use cases and architectures for insurance-related event streaming. Real-world examples from Generali, Centene, Humana, and Tesla show innovative data integration and stream processing in real-time.

8.1K views
13 minute read

Low Latency Data Streaming with Apache Kafka and Cloud-Native 5G Infrastructure

ByKai Waehner
23. May 2021
No comments

This blog post explores low latency data processing and edge computing with Apache Kafka, 5G telco networks, and cloud-native AWS Wavelength infrastructure. Learn about use cases and architectures across industries to combine mission-critical and analytics workloads, and a concrete hybrid implementation for energy production and distribution.

3.9K views
3 minute read

Apache Kafka for Industrial IoT and Manufacturing 4.0

ByKai Waehner
19. May 2021
No comments

This post explores use cases and architectures for processing data in motion with Apache Kafka in Industrial IoT (IIoT) across verticals such as automotive, energy, steel manufacturing, oil&gas, cybersecurity, shipping, logistics. Use cases include predictive maintenance, quality assurance, track and track, real-time locating system (RTLS), asset tracking, customer 360, and more. Examples include BMW, Bosch, Baader, Intel, Porsche, and Devon.

De Facto Standard API - Amazon S3 for Object Storage and Apache Kafka for Event Streaming

8.4K views
13 minute read

Kafka API is the De Facto Standard API for Event Streaming like Amazon S3 for Object Storage

ByKai Waehner
9. May 2021
4 shares
One comment

Real-time beats slow data in most use cases across industries. The rise of event-driven architectures and data in motion powered by Apache Kafka enables enterprises to build real-time infrastructure and applications. This blog post explores why the Kafka API became the de facto standard API for event streaming like Amazon S3 for object storage, and the tradeoffs of these standards and corresponding frameworks, products, and cloud services.

How to choose the right Apache Kafka Offering - Confluent Cloudera Red Hat IBM Amazon AWS MSK

19.3K views
21 minute read

Comparison of Open Source Apache Kafka vs Vendors including Confluent, Cloudera, Red Hat, Amazon MSK

ByKai Waehner
20. April 2021
3 shares
2 comments

Apache Kafka became the de facto standard for event streaming. Various vendors added Kafka and related tooling to their offerings or provide a Kafka cloud service. This blog post uses the car analogy – from the motor engine to the self-driving car – to explore the different Kafka offerings available on the market. The goal is not a feature-by-feature comparison. Instead, the intention is to educate about the different deployment models, product strategies, and trade-offs from the available options.

MQTT and Kafka for Smart City and 5G Architectures

4.3K views
5 minute read

Apache Kafka and MQTT (Part 5 of 5) – Smart City and 5G

ByKai Waehner
29. March 2021
No comments

Apache Kafka and MQTT are a perfect combination for many IoT use cases. This blog series covers the pros and cons of both technologies. Various use cases across industries, including connected vehicles, manufacturing, mobility services, and smart city are explored. The examples use different architectures, including lightweight edge scenarios, hybrid integrations, and serverless cloud solutions. This post is part five: Smart City and 5G.