Re: apache spark errors

2016-03-24 Thread Max Schmidt
d.take(top)) { jedis …} > > > > May this resulted in a memory leak? > > > > *Van:*Ted Yu [mailto:yuzhih...@gmail.com] > *Verzonden:* donderdag 24 maart 2016 15:15 > *Aan:* Michel Hubert > *CC:* user@spark.apache.org > *Onderwerp:* Re

Re: apache spark errors

2016-03-24 Thread Ted Yu
> } > > > > May this resulted in a memory leak? > > > > *Van:* Ted Yu [mailto:yuzhih...@gmail.com] > *Verzonden:* donderdag 24 maart 2016 15:15 > > *Aan:* Michel Hubert > *CC:* user@spark.apache.org > *Onderwerp:* Re: apache spark errors > > > >

RE: apache spark errors

2016-03-24 Thread Michel Hubert
ert CC: user@spark.apache.org Onderwerp: Re: apache spark errors Do you have history server enabled ? Posting your code snippet would help us understand your use case (and reproduce the leak). Thanks On Thu, Mar 24, 2016 at 6:40 AM, Michel Hubert mailto:mich...@pha

Re: apache spark errors

2016-03-24 Thread Ted Yu
2.8.0 > jar > compile > > > > > > > > How can I look at those tasks? > > > > *Van:* Ted Yu [mailto:yuzhih...@gmail.com] > *Verzonden:* donderdag 24 maart 2016 14:33 > *Aan:* Michel Hubert > *CC:* user@spark.apache.org > *

RE: apache spark errors

2016-03-24 Thread Michel Hubert
Yu [mailto:yuzhih...@gmail.com] Verzonden: donderdag 24 maart 2016 14:33 Aan: Michel Hubert CC: user@spark.apache.org Onderwerp: Re: apache spark errors Which release of Spark are you using ? Have you looked the tasks whose Ids were printed to see if there was more clue ? Thanks On Thu, Mar 24

Re: apache spark errors

2016-03-24 Thread Ted Yu
Which release of Spark are you using ? Have you looked the tasks whose Ids were printed to see if there was more clue ? Thanks On Thu, Mar 24, 2016 at 6:12 AM, Michel Hubert wrote: > HI, > > > > I constantly get these errors: > > > > 0[Executor task launch worker-15] ERROR > org.apache.spa

apache spark errors

2016-03-24 Thread Michel Hubert
HI, I constantly get these errors: 0[Executor task launch worker-15] ERROR org.apache.spark.executor.Executor - Managed memory leak detected; size = 6564500 bytes, TID = 38969 310002 [Executor task launch worker-12] ERROR org.apache.spark.executor.Executor - Managed memory leak detected;