Hi all, We want to integrate Spark in our Java application using the Spark Java Api and run then on the Yarn clusters.
If i want to run Spark on Yarn, which dependencies are must for including ? I looked at Spark POM <http://central.maven.org/maven2/org/apache/spark/spark-core_2.10/1.3.1/spark-core_2.10-1.3.1.pom> which lists that Spark requires 50+ 3rd party dependencies. Is there minimum set of Spark dependencies which are necessary for Spark Java API (for Spark client run on Yarn cluster) ? Thanks in advance.
