Phillip Henry created METRON-2157: ------------------------------------- Summary: To better abstract the streaming infrastructure, use Apache Beam. Key: METRON-2157 URL: https://issues.apache.org/jira/browse/METRON-2157 Project: Metron Issue Type: Improvement Reporter: Phillip Henry
Apache Beam is "[a]n advanced unified programming model" that can "Implement batch and streaming data processing jobs that run on any execution engine" (according to their [docs|[https://beam.apache.org/]). If Metron were to use such an abstraction, there could be greater portability between different offerings of streaming infrastructure (Spark, Flink etc). -- This message was sent by Atlassian JIRA (v7.6.3#76005)