Re: TaskCommitDenied (Driver denied task commit)

2016-01-22 Thread Arun Luthra
t;>> >>>>> On Thu, Jan 21, 2016 at 2:46 PM Holden Karau <hol...@pigscanfly.ca> >>>>> wrote: >>>>> >>>>>> Before we dig too far into this, the thing which most quickly jumps >>>>>> out to me is groupByKey which

Re: TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Arun Luthra
WARN MemoryStore: Persisting block broadcast_4 to disk instead. [Stage 1:>(2260 + 7) / 2262]16/01/21 21:57:24 WARN TaskSetManager: Lost task 1440.1 in stage 1.0 (TID 4530, --): TaskCommitDenied (Driver denied task commit) for job: 1, partit

Re: TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Josh Rosen
ARN MemoryStore: Not enough space to cache broadcast_4 >> in memory! (computed 60.2 MB so far) >> >> 16/01/21 21:52:52 WARN MemoryStore: Persisting block broadcast_4 to disk >> instead. >> >> [Stage 1:================>(2

Re: TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Holden Karau
ive-hadoop >>>> library for your platform... using builtin-java classes where applicable >>>> >>>> 16/01/21 21:52:14 WARN MetricsSystem: Using default name DAGScheduler >>>> for source because spark.app.id is not set. >>>> >>>> spark.yarn.driver.memoryOverhead is s

TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Arun Luthra
Example warning: 16/01/21 21:57:57 WARN TaskSetManager: Lost task 2168.0 in stage 1.0 (TID 4436, XXX): TaskCommitDenied (Driver denied task commit) for job: 1, partition: 2168, attempt: 4436 Is there a solution for this? Increase driver memory? I'm using just 1G driver memory but ideally I

Re: TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Arun Luthra
t; 16/01/21 21:52:16 WARN DomainSocketFactory: The short-circuit local >>> reads feature cannot be used because libhadoop cannot be loaded. >>> >>> 16/01/21 21:52:52 WARN MemoryStore: Not enough space to cache >>> broadcast_4 in memory! (computed 60.2 MB s

Re: TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Holden Karau
> 4436, XXX): TaskCommitDenied (Driver denied task commit) for job: 1, > partition: 2168, attempt: 4436 > > > Is there a solution for this? Increase driver memory? I'm using just 1G > driver memory but ideally I won't have to increase it. > > The RDD being processed has 2262 parti

Re: TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Holden Karau
e 1:>(2260 + 7) / > 2262]16/01/21 21:57:24 WARN TaskSetManager: Lost task 1440.1 in stage 1.0 > (TID 4530, --): TaskCommitDenied (Driver denied task commit) for job: 1, > partition: 1440, attempt: 4530 > > [Stage 1:===

Re: TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Arun Luthra
gt;> >>>> On Thu, Jan 21, 2016 at 2:40 PM, Arun Luthra <arun.lut...@gmail.com> >>>> wrote: >>>> >>>>> >>>>> >>>>> 16/01/21 21:52:11 WARN NativeCodeLoader: Unable to load native-hadoop >>>>> li

Re: TaskCommitDenied (Driver denied task commit)

2016-01-21 Thread Arun Luthra
t;>> see if the pipeline works up until that stage. Also 1G of driver memory is >>>>> also a bit small for something with 90 executors... >>>>> >>>>> On Thu, Jan 21, 2016 at 2:40 PM, Arun Luthra <arun.lut...@gmail.com> >>>>>