You will have to point to your spark-assembly.jar since spark has a lot of dependencies. You can read the answers discussed over here to have a better understanding http://stackoverflow.com/questions/3589562/why-maven-what-are-the-benefits
Thanks Best Regards On Wed, Dec 23, 2015 at 4:27 PM, Eran Witkon <eranwit...@gmail.com> wrote: > Thanks, all of these examples shows how to link to spark source and build > it as part of my project. why should I do that? why not point directly to > my spark.jar? > Am I missing something? > Eran > > On Wed, Dec 23, 2015 at 9:59 AM Akhil Das <ak...@sigmoidanalytics.com> > wrote: > >> 1. Install sbt plugin on IntelliJ >> 2. Create a new project/Import an sbt project like Dean suggested >> 3. Happy Debugging. >> >> You can also refer to this article for more information >> https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-IntelliJ >> >> Thanks >> Best Regards >> >> On Mon, Dec 21, 2015 at 10:51 PM, Eran Witkon <eranwit...@gmail.com> >> wrote: >> >>> Any pointers how to use InteliJ for spark development? >>> Any way to use scala worksheet run like spark- shell? >>> >> >>
