I can +1 Holden's spark-testing-base package. Burak
On Fri, Jul 10, 2015 at 12:23 PM, Holden Karau <hol...@pigscanfly.ca> wrote: > Somewhat biased of course, but you can also use spark-testing-base from > spark-packages.org as a basis for your unittests. > > On Fri, Jul 10, 2015 at 12:03 PM, Daniel Siegmann < > daniel.siegm...@teamaol.com> wrote: > >> On Fri, Jul 10, 2015 at 1:41 PM, Naveen Madhire <vmadh...@umail.iu.edu> >> wrote: >> >>> I want to write junit test cases in scala for testing spark application. >>> Is there any guide or link which I can refer. >>> >> >> https://spark.apache.org/docs/latest/programming-guide.html#unit-testing >> >> Typically I create test data using SparkContext.parallelize and then >> call RDD.collect to get the results to assert. >> > > > > -- > Cell : 425-233-8271 > Twitter: https://twitter.com/holdenkarau > Linked In: https://www.linkedin.com/in/holdenkarau >
