I initially requested SAMZA-18 some months ago and am still interested. Out of curiosity, what would such an interface look like? Is this something the core team could sketch out?
Travis On Mon, Mar 10, 2014 at 2:26 PM, Jakob Homan <[email protected]> wrote: > Hey Dave- > Thanks for taking a look at Samza. No one in the community is currently > working on this at the moment, to our knowledge. SAMZA-18 ( > https://issues.apache.org/jira/browse/SAMZA-18) has the beginnings of a > discussion about creating a single C library to help provide multilanguage > support in Samza (which I believe would be accessible to Go as well). > There's currently no JIRA for Hadoop-style streaming, but one could > certainly be created and it would be something we'd be interested in. > Thanks, > Jakob > > > > On Mon, Mar 10, 2014 at 12:19 PM, Dave Revell <[email protected]> wrote: > > > Hi all, > > > > We're considering using Samza for our high-throughput stream processing > > workload, but we don't want to rewrite all of our existing Go code. We're > > considering writing something analogous to Hadoop Streaming, where the > > Samza consumer would start an external process and communicate with it by > > passing protobufs via stdin/stdout. We like Samza's fault tolerance, > state > > management, and load balancing features and don't want to rewrite them. > > > > This possibility is mentioned in the documentation ( > > > > > http://samza.incubator.apache.org/learn/documentation/0.7.0/comparisons/storm.html > > , > > search for "stdin") as something that might exist some day. My > > questions > > are: > > > > 1. Is anyone working on this, or planning to? I couldn't find any related > > JIRAs. > > 2. Any advice for implementing this? Are there any challenges that might > > not be obvious? > > 3. Should we try to merge this upstream? > > > > Thanks a bunch, > > Dave > > >
