Kafka Streams edit  

A stream processing technologies that's tightly integrated to Apache Kafka, consuming and publishing events from and to Kafka topics (and potentially writing output to external systems). Based on an event-at-a-time model (i.e. not micro batch), with support for stateful processing, windowing, aggregations, joining and re-processing data. Supports a low level DSL API, as well as a high level API that provides both stream and table abstractions (where tables present the latest record for each key). Executes as a stand-alone process, with support for parallel processing across threads within a single instance and across multiple instances, with the ability to dynamically scale the number of instances. Introduced in Kafka 0.10.

Technology Information

Type	Sub-Project
Parent Project	Apache Kafka
Last Updated	January 2017

Related Technologies

Is packaged by

MapR Expansion Pack

Links

• http://kafka.apache.org/documentation/streams - documentation
• http://docs.confluent.io/current/streams/index.html - Confluent documentation
• https://www.confluent.io/product/kafka-streams/ - Confluent information page
• https://www.confluent.io/blog/introducing-kafka-streams-stream-processing-made-simple/ - introduction blog post

Blog Posts

• Core Hadoop Technologies (pt3) 2017-01-20 Technologies Apache Avro Parquet Kafka Pig Oozie Kafka Connect Kafka Streams Peter