subject:"Union of RDDs Hung"

Re: Union of RDDs Hung

2017-12-12 Thread Gerard Maas

Can you show us the code? On Tue, Dec 12, 2017 at 9:02 AM, Vikash Pareek wrote: > Hi All, > > I am unioning 2 rdds(each of them having 2 records) but this union it is > getting hang. > I found a solution to this that is caching both the rdds before performing > union

Union of RDDs Hung

2017-12-12 Thread Vikash Pareek

Hi All, I am unioning 2 rdds(each of them having 2 records) but this union it is getting hang. I found a solution to this that is caching both the rdds before performing union but I could not figure out the root cause of hanging the job. Is somebody knows why this happens with union? Spark