Re: IDE suitable for Spark

2020-04-07 Thread yeikel valdes
Zeppelin is not an IDE but a notebook.  It is helpful to experiment but it is missing a lot of the features that we expect from an IDE. Thanks for sharing though.  On Tue, 07 Apr 2020 04:45:33 -0400 zahidr1...@gmail.com wrote When I first logged on I asked if there was a suitable

Re: IDE suitable for Spark

2020-04-07 Thread Stephen Boesch
I have been using Idea for both scala/spark and pyspark projects since 2013. It required fair amount of fiddling that first year but has been stable since early 2015. For pyspark projects only Pycharm naturally also works v well. Am Di., 7. Apr. 2020 um 09:10 Uhr schrieb yeikel valdes : > > Ze

Re:  IDE suitable for Spark

2020-04-07 Thread Dennis Suhari
We are using Pycharm resp. R Studio with Spark libraries to submit Spark Jobs. Von meinem iPhone gesendet > Am 07.04.2020 um 18:10 schrieb yeikel valdes : > >  > > Zeppelin is not an IDE but a notebook. It is helpful to experiment but it is > missing a lot of the features that we expect fro

Re: IDE suitable for Spark

2020-04-07 Thread Luiz Camargo
I have used IntelliJ Spark/Scala with the sbt tool On Tue, Apr 7, 2020 at 1:18 PM Dennis Suhari wrote: > We are using Pycharm resp. R Studio with Spark libraries to submit Spark > Jobs. > > Von meinem iPhone gesendet > > Am 07.04.2020 um 18:10 schrieb yeikel valdes : > >  > > Zeppelin is not an

Re: IDE suitable for Spark

2020-04-07 Thread Pat Ferrel
Subject:  Re: IDE suitable for Spark I have used IntelliJ Spark/Scala with the sbt tool On Tue, Apr 7, 2020 at 1:18 PM Dennis Suhari wrote: We are using Pycharm resp. R Studio with Spark libraries to submit Spark Jobs.  Von meinem iPhone gesendet Am 07.04.2020 um 18:10 schrieb yeikel valdes

Re: IDE suitable for Spark

2020-04-07 Thread Nikaash Puri
Ferrel Sent: Tuesday, April 7, 2020 10:58:39 PM To: Luiz Camargo ; Dennis Suhari Cc: zahidr1...@gmail.com ; user@spark.apache.org ; yeikel valdes Subject: Re: IDE suitable for Spark IntelliJ Scala works well when debugging master=local. Has anyone used it for remote/cluster debugging? I’ve heard

Re: IDE suitable for Spark : Monitoring & Debugging Spark Jobs

2020-04-07 Thread Som Lima
t; for remote/cluster debugging? I’ve heard it is possible... > > > From: Luiz Camargo > Reply: Luiz Camargo > Date: April 7, 2020 at 10:26:35 AM > To: Dennis Suhari > > Cc: yeikel valdes , > zahidr1...@gmail.com , > user@spark.apache.org > Subject: Re: IDE suitab