Re: Network Spark Streaming from multiple remote hosts

2016-02-23 Thread Kevin Mellott
Hi Vinti, That example is (in my opinion) more of a tutorial and not necessarily the way you'd want to set it up for a "real world" application. I'd recommend using something like Apache Kafka, which will allow the various hosts to publish messages to a queue. Your Spark Streaming application is

Network Spark Streaming from multiple remote hosts

2016-02-23 Thread Vinti Maheshwari
Hi All I wrote program for Spark Streaming in Scala. In my program, i passed 'remote-host' and 'remote port' under socketTextStream. And in the remote machine, i have one perl script who is calling system command: echo 'data_str' | nc <> In that way, my spark program is able to get data,