Somewhat biased of course, but you can also use spark-testing-base from spark-packages.org as a basis for your unittests.
On Fri, Jul 10, 2015 at 12:03 PM, Daniel Siegmann < daniel.siegm...@teamaol.com> wrote: > On Fri, Jul 10, 2015 at 1:41 PM, Naveen Madhire <vmadh...@umail.iu.edu> > wrote: > >> I want to write junit test cases in scala for testing spark application. >> Is there any guide or link which I can refer. >> > > https://spark.apache.org/docs/latest/programming-guide.html#unit-testing > > Typically I create test data using SparkContext.parallelize and then call > RDD.collect to get the results to assert. > -- Cell : 425-233-8271 Twitter: https://twitter.com/holdenkarau Linked In: https://www.linkedin.com/in/holdenkarau
