Hi Slim, I totally agree with you that we should start working on supporting tools like these.
StreamFlow is really nice tool, I also like it a lot. I think it would be not too hard to integrate it with Flink as there are several projects that have already used Flink streaming in a compositional way. (SAMOA, or the Storm compatibility layer). So I guess this is just a matter of someone picking it up at one point, but I am really looking forward to it , and will support anyone doing it :) As for SPQR and the dynamic pipelines, I don't think we have this on the short term roadmap, but it would indeed be a nice feature. I don't see any system limitations that would keep us from implementing this either once we start working on dynamic modifications to the execution graph (such as for automatic scaling) Cheers, Gyula Slim Baltagi <[email protected]> ezt írta (időpont: 2015. júl. 30., Cs, 5:50): > Hi > > As Flink streaming API is being stabilized, it is worth investigating > tooling around it to make developer's life easier and also turning Flink > streaming a more attractive stream processing platform. > I would like to suggest a couple tools which are worth integrating with > Flink streaming: > > 1. 'StreamFlow™ is a stream processing tool designed to help build and > monitor processing workflows. The ultimate goal of StreamFlow is to make > working with stream processing frameworks such as Apache Storm easier, > faster, and with "enterprise" like management functionality. > > StreamFlow also provides a mechanism for non-developers such as data > scientists, analysts, or operational users to rapidly build scalable data > flows and analytics.' > > Reference:https://github.com/lmco/streamflow The topology builder looks > really slick! > > Any chance of seeing StreamFlow a GUI for building Flink streaming data > flows? > > 2. SPQR pronounced Spooker is a framework for building *dynamic * data > stream processing pipelines: a feature that is neither available in Apache > Storm nor in Spark Streaming. > https://github.com/ottogroup/SPQR > > It might be worth investigating SPQR, integrating it with Flink and make it > production ready. > > What are your thoughts? > > Thanks > > Slim Baltagi > > > > -- > View this message in context: > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/On-some-GUI-tools-for-building-Flink-Streaming-data-flows-tp7233.html > Sent from the Apache Flink Mailing List archive. mailing list archive at > Nabble.com. >
