Example warning: 16/01/21 21:57:57 WARN TaskSetManager: Lost task 2168.0 in stage 1.0 (TID 4436, XXXXXXX): TaskCommitDenied (Driver denied task commit) for job: 1, partition: 2168, attempt: 4436
Is there a solution for this? Increase driver memory? I'm using just 1G driver memory but ideally I won't have to increase it. The RDD being processed has 2262 partitions. Arun
