Kafka Connect edit  

Framework for building scalable and reliable integrations between Kafka and other technologies, either for importing or exporting data. Part of the core Apache Kafka open source technology, connectors are available for a wide range of systems, including Hadoop, relational, NoSQL and analytical databases, search technologies and message queues amongst others, with an API for developing custom connectors. Supports lightweight transformations, and runs separately to Kafka, in either a stand-alone or distributed cluster mode, with a REST API for managing connectors. Introduced in Kafka 0.9, previously known as Copycat

Technology Information

Type	Sub-Project
Parent Project	Apache Kafka
Last Updated	January 2017

Related Technologies

Is packaged by

MapR Expansion Pack

Links

• http://kafka.apache.org/documentation/#connect - documentation
• http://docs.confluent.io/current/connect/index.html - Confluent documentation
• https://www.confluent.io/product/connectors/ - Confluent information, including list of available connectors
• https://www.confluent.io/blog/how-to-build-a-scalable-etl-pipeline-with-kafka-connect/ - introduction blog post

Blog Posts

• Core Hadoop Technologies (pt3) 2017-01-20 Technologies Apache Avro Parquet Kafka Pig Oozie Kafka Connect Kafka Streams Peter