Thanks, so based on that article, should I use sbt or maven? Or either? Eran On Wed, 23 Dec 2015 at 13:05 Akhil Das <ak...@sigmoidanalytics.com> wrote:
> You will have to point to your spark-assembly.jar since spark has a lot of > dependencies. You can read the answers discussed over here to have a better > understanding > http://stackoverflow.com/questions/3589562/why-maven-what-are-the-benefits > > Thanks > Best Regards > > On Wed, Dec 23, 2015 at 4:27 PM, Eran Witkon <eranwit...@gmail.com> wrote: > >> Thanks, all of these examples shows how to link to spark source and build >> it as part of my project. why should I do that? why not point directly to >> my spark.jar? >> Am I missing something? >> Eran >> >> On Wed, Dec 23, 2015 at 9:59 AM Akhil Das <ak...@sigmoidanalytics.com> >> wrote: >> >>> 1. Install sbt plugin on IntelliJ >>> 2. Create a new project/Import an sbt project like Dean suggested >>> 3. Happy Debugging. >>> >>> You can also refer to this article for more information >>> https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-IntelliJ >>> >>> Thanks >>> Best Regards >>> >>> On Mon, Dec 21, 2015 at 10:51 PM, Eran Witkon <eranwit...@gmail.com> >>> wrote: >>> >>>> Any pointers how to use InteliJ for spark development? >>>> Any way to use scala worksheet run like spark- shell? >>>> >>> >>> >
