Re: Fwd: Sample Spark Program Error

2014-12-31 Thread RK
If you look at your program output closely, you can see the following output.  Lines with a: 24, Lines with b: 15 The exception seems to be happening with Spark cleanup after executing your code. Try adding sc.stop() at the end of your program to see if the exception goes away. On

Re: Fwd: Sample Spark Program Error

2014-12-31 Thread Naveen Madhire
Yes. The exception is gone now after adding stop() at the end. Can you please tell me what this stop() does at the end. Does it disable the spark context. On Wed, Dec 31, 2014 at 10:09 AM, RK prk...@yahoo.com wrote: If you look at your program output closely, you can see the following output.

RE: Fwd: Sample Spark Program Error

2014-12-31 Thread Kapil Malik
on it or on any RDD created via this context. Regards, Kapil From: Naveen Madhire [mailto:vmadh...@umail.iu.edu] Sent: 31 December 2014 22:08 To: RK Cc: user@spark.apache.org Subject: Re: Fwd: Sample Spark Program Error Yes. The exception is gone now after adding stop() at the end. Can you please tell me