In my experience almost all of the time cycles are bad and cause a lot of debugging problems. Most of the time you can implement what you want by using a windowed join or group by instead. - Bobby
On Tuesday, November 29, 2016, 11:06:44 AM CST, María García Herrero <[email protected]> wrote:Hi Shen, No. Beam pipelines are DAGs: http://beam.incubator.apache.org/documentation/sdks/javadoc/0.3.0-incubating/org/apache/beam/sdk/Pipeline.html Best, María On Tue, Nov 29, 2016 at 7:44 AM, Shen LI <[email protected]> wrote: > Hi, > > Can I use Beam to create a pipeline with cycles? For example, to implement > the Yahoo! Streaming benchmark( > https://yahooeng.tumblr.com/post/135321837876/benchmarking-streaming- > computation-engines-at), > can a ParDo transform consume a downstream output as a side input? > > Thanks, > > Shen >
