Hey, So we started digging through the IterativeDataSet and it seems like you are using the BlockingBackChannel as this special feedback edge. Does it work as a synchronization barrier would in BSP? If so it is probably not suitable for processing continuous dataflows is it?
Gyula On Tue, Jul 8, 2014 at 4:33 PM, Stephan Ewen <[email protected]> wrote: > Cyclic graphs are a problem for both the scheduler and the > currently-under-works recovery logic. > > General cyclic graphs are a bit of a design problem. > > I think what we need in the future is something like a special feedback > edge that closes the cycle and that is synchronized (in batches / > generations) to make it transparent to the recovery and scheduling logic. > > Stephan >
