Re: Spark worker threads waiting

at your network traffic during that period to see performance. Regards Mayur Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi https://twitter.com/mayur_rustagi On Fri, Mar 21, 2014 at 8:33 AM, sparrow [hidden email]http://user/SendEmail.jtp?type=nodenode

Re: Spark worker threads waiting

Mayur Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi https://twitter.com/mayur_rustagi On Thu, Mar 20, 2014 at 9:55 AM, sparrow [hidden email]http://user/SendEmail.jtp?type=nodenode=2962i=0 wrote: This is what the web UI looks like: [image: Inline

Re: Spark worker threads waiting

This is what the web UI looks like: [image: Inline image 1] I also tail all the worker logs and theese are the last entries before the waiting begins: 14/03/20 13:29:10 INFO BlockFetcherIterator$BasicBlockFetcherIterator: maxBytesInFlight: 50331648, minRequest: 10066329 14/03/20 13:29:10 INFO