Spark Job server allows you to submit your apps to any kind of deployment (Standalone, Cluster). I think that it could be suitable for your use case. Check the following Github repo: https://github.com/spark-jobserver/spark-jobserver
Ardo On Sun, Nov 29, 2015 at 6:42 PM, Նարեկ Գալստեան <ngalsty...@gmail.com> wrote: > A question regarding the topic, > > I am using Intellij to write spark applications and then have to ship the > source code to my cluster on the cloud to compile and test > > is there a way to automatise the process using Intellij? > > Narek Galstyan > > Նարեկ Գալստյան > > On 29 November 2015 at 20:51, Ndjido Ardo BAR <ndj...@gmail.com> wrote: > >> Masf, the following link sets the basics to start debugging your spark >> apps in local mode: >> >> >> https://medium.com/large-scale-data-processing/how-to-kick-start-spark-development-on-intellij-idea-in-4-steps-c7c8f5c2fe63#.675s86940 >> >> Ardo >> >> On Sun, Nov 29, 2015 at 5:34 PM, Masf <masfwo...@gmail.com> wrote: >> >>> Hi Ardo >>> >>> >>> Some tutorial to debug with Intellij? >>> >>> Thanks >>> >>> Regards. >>> Miguel. >>> >>> >>> On Sun, Nov 29, 2015 at 5:32 PM, Ndjido Ardo BAR <ndj...@gmail.com> >>> wrote: >>> >>>> hi, >>>> >>>> IntelliJ is just great for that! >>>> >>>> cheers, >>>> Ardo. >>>> >>>> On Sun, Nov 29, 2015 at 5:18 PM, Masf <masfwo...@gmail.com> wrote: >>>> >>>>> Hi >>>>> >>>>> Is it possible to debug spark locally with IntelliJ or another IDE? >>>>> >>>>> Thanks >>>>> >>>>> -- >>>>> Regards. >>>>> Miguel Ángel >>>>> >>>> >>>> >>> >>> >>> -- >>> >>> >>> Saludos. >>> Miguel Ángel >>> >> >> >
