If this becomes a strong requirement, then we can look into relaxing the
constraints (and then have some features not supported on cyclic flows).
I just wanted to get a discussion started about the different angles of
approach, and what may be the simplest way to do this...
On Thu, Jan 22, 2015 a
Thanks for the quick answers!
It is possible to use iterations, we could detect circles while building the
samoa topology and convert them into iterations. It is perhaps the proper way
to go. I just thought whether we could hack around it but we better avoid
messing with cyclic dependences.
Pa
Hi Paris!
The Streaming API allows you to define iterations, where parts of the
stream are fed back. Do those work for you?
In general, cyclic flows are a tricky thing, as the topological order of
operators is needed for scheduling (may not be important for continuous
streams) but also for a clea
Hello,
While implementing the SAMOA adapter for Flink-Streaming we stumbled upon the
need to allow loops (or circular dependencies) in the job graph. Many
incremental machine learning tasks define loops already and there is no
trivial way of getting around it. In the streaming job graph builde