Apache Beam edit 
Unified batch and streaming programming model to define portable data processing pipelines and execute these using a range of different engines. Originating from the Google Dataflow model, focuses on unifying both styles of processing by treating static data sets as streams (which happen to have a beginning and an end), while achieving data correctness and the ability to handle late-arriving data through a set of abstractions and concepts that give users control over estimated quality of arrived data (completeness), duration to wait for results (latency) and how much speculative/redundant computation to do (cost). Allows business logic, data characteristics and trade-off strategies to be defined via different programming languages through pluggable language SDKs (with out of the box support for Java and Python). Supports a range of pluggable runtime platforms through pipeline runners, with support for a direct runner (for development and testing pipelines in a non-distributed environment), Apache Apex, Flink, Spark, and (under development) Gearpump runners, and a Google Cloud Dataflow runner. Also supports a growing set of connectors that allow pipelines to read and write data to various data storage systems (IOs). An Apache project, opened sourced by Google in January 2016, graduated in January 2017, with a first stable release (2.0) in May 2017. Written in Java and Python and under active development with a large number of contributors including Google, data Artisans, Talend and PayPal. Technology Information
Other Names Beam Vendors The Apache Software Foundation Type Commercial Open Source Last Updated August 2019 - 2.14 Release History
version release date release links release comment 2.1 2017-08-23 release notes 2.2 2017-12-02 release notes 2.3 2018-02-19 blog post; release notes 2.4 2018-03-20 release notes 2.5 2018-06-26 blog post; release notes 2.6 2018-08-08 blog post; release notes 2.7 2018-10-02 blog post; release notes 2.8 2018-10-31 blog post; release notes 2.9 2018-12-19 blog post; release notes 2.10 2019-02-01 blog post; release notes 2.11 2019-03-05 blog post; release notes 2.12 2019-04-25 blog post; release notes 2.13 2019-05-22 blog post; release notes 2.14 2019-08-07 blog post Links
News
Blog Posts