Re: Re: spark streaming printing no output

2015-04-16 Thread jay vyas
rom another console.) >>> >>> -- >>> bit1...@163.com >>> >>> >>> *From:* Shushant Arora >>> *Date:* 2015-04-15 17:11 >>> *To:* Akhil Das >>> *CC:* user@spark.apache.org >>> *Subject:* Re

Re: Re: spark streaming printing no output

2015-04-15 Thread Shushant Arora
gt;> typed on this port from another console.) >> >> -- >> bit1...@163.com >> >> >> *From:* Shushant Arora >> *Date:* 2015-04-15 17:11 >> *To:* Akhil Das >> *CC:* user@spark.apache.org >> *Subject:* Re: spark streaming printing no output >&g

Re: Re: spark streaming printing no output

2015-04-15 Thread Shushant Arora
user@spark.apache.org > *Subject:* Re: spark streaming printing no output > When I launched spark-shell using, spark-shell ---master local[2]. > Same behaviour, no output on console but only timestamps. > > When I did, lines.saveAsTextFiles("hdfslocation",suffix); > I ge

Re: Re: spark streaming printing no output

2015-04-15 Thread bit1...@163.com
Looks the message is consumed by the another console?( can see messages typed on this port from another console.) bit1...@163.com From: Shushant Arora Date: 2015-04-15 17:11 To: Akhil Das CC: user@spark.apache.org Subject: Re: spark streaming printing no output When I launched spark-shell

Re: spark streaming printing no output

2015-04-15 Thread Shushant Arora
When I launched spark-shell using, spark-shell ---master local[2]. Same behaviour, no output on console but only timestamps. When I did, lines.saveAsTextFiles("hdfslocation",suffix); I get empty files of 0 bytes on hdfs On Wed, Apr 15, 2015 at 12:46 PM, Akhil Das wrote: > Just make sure you hav

Re: spark streaming printing no output

2015-04-15 Thread Akhil Das
Just make sure you have atleast 2 cores available for processing. You can try launching it in local[2] and make sure its working fine. Thanks Best Regards On Tue, Apr 14, 2015 at 11:41 PM, Shushant Arora wrote: > Hi > > I am running a spark streaming application but on console nothing is > gett

Re: spark streaming printing no output

2015-04-15 Thread Shixiong Zhu
So the time niterval is much less than 1000 ms as you set in the code? That's weird. Could you check the whole outputs to confirm that the content won't be flushed by logs? Best Regards, Shixiong(Ryan) Zhu 2015-04-15 15:04 GMT+08:00 Shushant Arora : > Yes only Time: 142905487 ms strings get

Re: spark streaming printing no output

2015-04-15 Thread Shushant Arora
Yes only Time: 142905487 ms strings gets printed on console. No output is getting printed. And timeinterval between two strings of form ( time:ms)is very less than Streaming Duration set in program. On Wed, Apr 15, 2015 at 5:11 AM, Shixiong Zhu wrote: > Could you see something like this

Re: spark streaming printing no output

2015-04-14 Thread Shixiong Zhu
Could you see something like this in the console? --- Time: 142905487 ms --- Best Regards, Shixiong(Ryan) Zhu 2015-04-15 2:11 GMT+08:00 Shushant Arora : > Hi > > I am running a spark streaming application but o

spark streaming printing no output

2015-04-14 Thread Shushant Arora
Hi I am running a spark streaming application but on console nothing is getting printed. I am doing 1.bin/spark-shell --master clusterMgrUrl 2.import org.apache.spark.streaming.StreamingContext import org.apache.spark.streaming.StreamingContext._ import org.apache.spark.streaming.dstream.DStream