Why doesn't it work?? I guess that it's the same with "\n".
2014-12-13 12:56 GMT+01:00 Guillermo Ortiz <konstt2...@gmail.com>:
> I got it, thanks,, a silly question,, why if I do:
> out.write("hello " + System.currentTimeMillis() + "\n"); it doesn't
> detect anything and if I do
> out.println("hello " + System.currentTimeMillis()); it works??
>
> I'm doing with spark
> val errorLines = lines.filter(_.contains("hello"))
>
>
> 2014-12-13 8:12 GMT+01:00 Tathagata Das <tathagata.das1...@gmail.com>:
>> Yes, socketTextStream starts a TCP client that tries to connect to a
>> TCP server (localhost:9999 in your case). If there is a server running
>> on that port that can send data to connected TCP connections, then you
>> will receive data in the stream.
>>
>> Did you check out the quick example in the streaming programming guide?
>> http://spark.apache.org/docs/latest/streaming-programming-guide.html
>> That has instructions to start a netcat server on port 9999 and send
>> data to spark streaming through that.
>>
>> TD
>>
>> On Fri, Dec 12, 2014 at 9:54 PM, Akhil Das <ak...@sigmoidanalytics.com>
>> wrote:
>>> socketTextStream is Socket client which will read from a TCP ServerSocket.
>>>
>>> Thanks
>>> Best Regards
>>>
>>> On Fri, Dec 12, 2014 at 7:21 PM, Guillermo Ortiz <konstt2...@gmail.com>
>>> wrote:
>>>>
>>>> I dont' understand what spark streaming socketTextStream is waiting...
>>>> is it like a server so you just have to send data from a client?? or
>>>> what's it excepting?
>>>>
>>>> 2014-12-12 14:19 GMT+01:00 Akhil Das <ak...@sigmoidanalytics.com>:
>>>> > I have created a Serversocket program which you can find over here
>>>> > https://gist.github.com/akhld/4286df9ab0677a555087 It simply listens to
>>>> > the
>>>> > given port and when the client connects, it will send the contents of
>>>> > the
>>>> > given file. I'm attaching the executable jar also, you can run the jar
>>>> > as:
>>>> >
>>>> > java -jar SocketBenchmark.jar student 12345 io
>>>> >
>>>> > Here student is the file which will be sent to the client whoever
>>>> > connects
>>>> > on 12345, i have it tested and is working with SparkStreaming
>>>> > (socketTextStream).
>>>> >
>>>> >
>>>> > Thanks
>>>> > Best Regards
>>>> >
>>>> > On Fri, Dec 12, 2014 at 6:25 PM, Guillermo Ortiz <konstt2...@gmail.com>
>>>> > wrote:
>>>> >>
>>>> >> Hi,
>>>> >>
>>>> >> I'm a newbie with Spark,, I'm just trying to use SparkStreaming and
>>>> >> filter some data sent with a Java Socket but it's not working... it
>>>> >> works when I use ncat
>>>> >>
>>>> >> Why is it not working??
>>>> >>
>>>> >> My sparkcode is just this:
>>>> >> val sparkConf = new
>>>> >> SparkConf().setMaster("local[2]").setAppName("Test")
>>>> >> val ssc = new StreamingContext(sparkConf, Seconds(5))
>>>> >> val lines = ssc.socketTextStream("localhost", 9999)
>>>> >> val errorLines = lines.filter(_.contains("hello"))
>>>> >> errorLines.print()
>>>> >>
>>>> >> I created a client socket which sends data to that port, but it could
>>>> >> connect any address, I guess that Spark doesn't work like a
>>>> >> serverSocket... what's the way to send data from a socket with Java to
>>>> >> be able to read from socketTextStream??
>>>> >>
>>>> >> ---------------------------------------------------------------------
>>>> >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>>>> >> For additional commands, e-mail: user-h...@spark.apache.org
>>>> >>
>>>> >
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
