Explain About Logs NetworkWordcount.scala

2014-02-20 Thread Eduardo Costa Alfaia
Hi Guys, Could anyone help me understanding the logs below? Why the result in the second log is 0? Thanks Guys 14/02/20 19:06:00 INFO JobScheduler: Finished job streaming job 1392919557000 ms.0 from job set of time 1392919557000 ms 14/02/20 19:06:00 INFO JobScheduler: Total delay: 3.185 s

Re: Explain About Logs NetworkWordcount.scala

2014-02-20 Thread Mayur Rustagi
is fresh data being put into the source folder... Mayur Rustagi Ph: +919632149971 h https://twitter.com/mayur_rustagittp://www.sigmoidanalytics.com https://twitter.com/mayur_rustagi On Thu, Feb 20, 2014 at 10:46 AM, Eduardo Costa Alfaia e.costaalf...@unibs.it wrote: Hi Guys, Could anyone

Re: Explain About Logs NetworkWordcount.scala

2014-02-20 Thread Tathagata Das
It could be that the worker receiving the data was undergoing GC and so could actually receive any data. Can you check the web ui for the application to see GC times of the corresponding stages? TD On Thu, Feb 20, 2014 at 12:03 PM, Mayur Rustagi mayur.rust...@gmail.comwrote: is fresh data