Re: Streaming. Cannot get socketTextStream to receive anything.

Hi TD You are right, I did not include "\n" to delimit the string flushed. That's the reason. Is there a way for me to define the delimiter? Like SOH or ETX instead of "\n" Regards kytay -- View this message in context: http://apache-spark-user-list.1001560.n3.na

Re: Streaming. Cannot get socketTextStream to receive anything.

Hi Tobias I have been using "local[4]" to test. My problem is likely caused by the tcp host server that I am trying the emulate. I was trying to emulate the tcp host to send out messages. (although I am not sure at the moment :D) First way I tried was to use a tcp tool called, Hercules. Second w

Re: Streaming. Cannot get socketTextStream to receive anything.

Hi Akhil Das Thanks. I tried the codes. and it works. There's a problem with my socket codes that is not flushing the content out, and for the test tool, Hercules, I have to close the socket connection to "flush" the content out. I am going to troubleshoot why nc works, and the codes and test t

Re: Streaming. Cannot get socketTextStream to receive anything.

I think I should be seeing any line of text that I have typed in the nc command. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Streaming-Cannot-get-socketTextStream-to-receive-anything-tp9382p9410.html Sent from the Apache Spark User List mailing list arch

Re: Streaming. Cannot get socketTextStream to receive anything.

Hi Akhil Das I have tried the nc -lk command too. I was hoping the "System.out.println("Print text:" + arg0);" is printed when a stream is processed when lines.flatMap(...) is called. But from my test with "nc -lk ", nothing is printed on the console at all. == To test out whether t

Streaming. Cannot get socketTextStream to receive anything.

Hi I am learning spark streaming, and is trying out the JavaNetworkCount example. #1 - This is the code I wrote JavaStreamingContext sctx = new JavaStreamingContext("local", appName, new Duration(5000)); JavaReceiverInputDStream lines = sctx.socketTextStream("127.0.0.1", ); JavaDStr

Re: Getting Persistent Connection using socketStream?

Hi TD Thanks. I have problem understanding the codes in github, Object SocketReceiver.byteToLines(...) private[streaming] obje

Getting Persistent Connection using socketStream?

Hi I am trying out a simple piece of code by writing my own JavaNetworkCount app to test out Spark Streaming So here is the 2 set of the codes. // #1 JavaReceiverInputDStream lines = sctx.socketTextStream("127.0.0.1", ); // #2 JavaReceiverInputDStream lines = sctx.socketStream(