Please check out the following for some good resources: https://github.com/holdenk/spark-testing-base
https://spark-summit.org/east-2016/events/beyond-collect-and-parallelize-for-tests/ On 3/2/16, 12:54 PM, "SRK" <swethakasire...@gmail.com> wrote: >Hi, > >What is a good unit testing framework for Spark batch/streaming jobs? I have >core spark, spark sql with dataframes and streaming api getting used. Any >good framework to cover unit tests for these APIs? > >Thanks! > > > >-- >View this message in context: >http://apache-spark-user-list.1001560.n3.nabble.com/Unit-testing-framework-for-Spark-Jobs-tp26380.html >Sent from the Apache Spark User List mailing list archive at Nabble.com. > >--------------------------------------------------------------------- >To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org