Re: Read data from SparkStreaming from Java socket.

[Akhil Das]

I have created a Serversocket program which you can find over here
https://gist.github.com/akhld/4286df9ab0677a555087 It simply listens to the
given port and when the client connects, it will send the contents of the
given file. I'm attaching the executable jar also, you can run the jar as:

java -jar SocketBenchmark.jar student 12345 io

​Here student is the file which will be sent to the client whoever connects
on 12345, i have it tested and is working with SparkStreaming
(socketTextStream).​


Thanks
Best Regards

On Fri, Dec 12, 2014 at 6:25 PM, Guillermo Ortiz <konstt2...@gmail.com>
wrote:
>
> Hi,
>
> I'm a newbie with Spark,, I'm just trying to use SparkStreaming and
> filter some data sent with a Java Socket but it's not working... it
> works when I use ncat
>
> Why is it not working??
>
> My sparkcode is just this:
>     val sparkConf = new
> SparkConf().setMaster("local[2]").setAppName("Test")
>     val ssc = new StreamingContext(sparkConf, Seconds(5))
>     val lines = ssc.socketTextStream("localhost", 9999)
>     val errorLines = lines.filter(_.contains("hello"))
>     errorLines.print()
>
> I created a client socket which sends data to that port, but it could
> connect any address, I guess that Spark doesn't work like a
> serverSocket... what's the way to send data from a socket with Java to
> be able to read from socketTextStream??
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>

SocketBenchmark.jar
Description: application/java-archive

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org