[ https://issues.apache.org/jira/browse/BEAM-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amit Sela reassigned BEAM-1562: ------------------------------- Assignee: Amit Sela > Use a "poison pill" to stop streaming tests as they finish. > ----------------------------------------------------------- > > Key: BEAM-1562 > URL: https://issues.apache.org/jira/browse/BEAM-1562 > Project: Beam > Issue Type: Improvement > Components: runner-spark > Reporter: Amit Sela > Assignee: Amit Sela > > Streaming tests use a timeout that has to take a large enough buffer to avoid > slow runtimes stopping before test completes. > We can introduce a "poison pill" based on an {{EndOfStream}} element that > would be counted in a Metrics/Aggregator to know all data was processed. > This requires the Spark runner to stop blocking the execution of a streaming > pipeline until it's complete - which is something relevant to > {{PipelineResult}} (re)design that is being discussed in BEAM-849 -- This message was sent by Atlassian JIRA (v6.3.15#6346)