> With IntelliJ you are OK with Spark & Scala. also intelliJ as a nice python plugin that turns it into pycharm.
On Thu Sep 30, 2021 at 1:57 PM CEST, Jeff Zhang wrote: > IIRC, you want an IDE for pyspark on yarn ? > > Mich Talebzadeh <mich.talebza...@gmail.com> 于2021年9月30日周四 > 下午7:00写道： > > > Hi, > > > > This may look like a redundant question but it comes about because of the > > advent of Cloud workstation usage like Amazon workspaces and others. > > > > With IntelliJ you are OK with Spark & Scala. With PyCharm you are fine > > with PySpark and the virtual environment. Mind you as far as I know PyCharm > > only executes spark-submit in local mode. For yarn, one needs to open a > > terminal and submit from there. > > > > However, in Amazon workstation, you get Visual Studio Code > > <https://code.visualstudio.com/> (VSC, an MS product) and openoffice > > installed. With VSC, you get stuff for working with json files but I am not > > sure with a plugin for Python etc, will it be as good as PyCharm? Has > > anyone used VSC in anger for Spark and if so what is the experience? > > > > Thanks > > > > > > > > view my Linkedin profile > > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > > > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > > loss, damage or destruction of data or any other property which may arise > > from relying on this email's technical content is explicitly disclaimed. > > The author will in no case be liable for any monetary damages arising from > > such loss, damage or destruction. > > > > > > > > > -- > Best Regards > > Jeff Zhang --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
