Apache Kafka + MQTT = End-to-End IoT Integration (Code, Slides, Video)

MQTT and Apache Kafka are a perfect combination for end-to-end IoT integration from edge to data center. This post discusses two different approaches and refers to implementations on Github using Apache Kafka, Kafka Connect, Confluent MQTT Proxy and Mosquitto.
Read More

Deep Learning KSQL UDF for Streaming Anomaly Detection of MQTT IoT Sensor Data

KSQL UDF for sensor analytics. Leverages the new API features of KSQL to build UDF / UDAF functions easily with Java to do continuous stream processing with Apache Kafka. Use Case: Connected Cars – Real Time Streaming Analytics using Deep Learning.
Read More

Model Serving: Stream Processing vs. RPC / REST with Java, gRPC, Apache Kafka, TensorFlow

Machine Learning / Deep Learning models can be used in different ways to do predictions. Natively in the application or hosted in a remote model server. Then you combine stream processing with RPC / Request-Response paradigm. This blog post shows examples of stream processing vs. RPC model serving using Java, Apache Kafka, Kafka Streams, gRPC and TensorFlow Serving.
Read More

KSQL Deep Dive – The Open Source Streaming SQL Engine for Apache Kafka

KSQL is the open source, Apache 2.0 licensed streaming SQL engine on top of Apache Kafka. This post shows a deep dive (slides + video recording) including its relation to Kafka Connect and Kafka Streams, concepts, architecture and deployment options.
Read More