Re: Executor memory requirement for reduceByKey

[Raghavendra Pandey]

Even though it does not sound intuitive,  reduce by key expects all values
for a particular key for a partition to be loaded into memory. So once you
increase the partitions you can run the jobs.