Spark Java API and minimum set of 3rd party dependencies

Hi all, We want to integrate Spark in our Java application using the Spark Java Api and run then on the Yarn clusters. If i want to run Spark on Yarn, which dependencies are must for including ? I looked at Spark POM

Re: Spark Java API and minimum set of 3rd party dependencies

You don't add dependencies to your app -- you mark Spark as 'provided' in the build and you rely on the deployed Spark environment to provide it. On Fri, Jun 12, 2015 at 7:14 PM, Elkhan Dadashov wrote: > Hi all, > > We want to integrate Spark in our Java application using the Spark Java Api > and

Re: Spark Java API and minimum set of 3rd party dependencies

Thanks for prompt response, Sean. The issue is that we are restricted on dependencies we can include in our project. There are 2 issues while including dependencies: 1) there are several dependencies which we and Spark has, but the versions are conflicting. 2) there are dependencies Spark has, a