IIRC, you want an IDE for pyspark on yarn ? Mich Talebzadeh <mich.talebza...@gmail.com> 于2021年9月30日周四 下午7:00写道：
> Hi, > > This may look like a redundant question but it comes about because of the > advent of Cloud workstation usage like Amazon workspaces and others. > > With IntelliJ you are OK with Spark & Scala. With PyCharm you are fine > with PySpark and the virtual environment. Mind you as far as I know PyCharm > only executes spark-submit in local mode. For yarn, one needs to open a > terminal and submit from there. > > However, in Amazon workstation, you get Visual Studio Code > <https://code.visualstudio.com/> (VSC, an MS product) and openoffice > installed. With VSC, you get stuff for working with json files but I am not > sure with a plugin for Python etc, will it be as good as PyCharm? Has > anyone used VSC in anger for Spark and if so what is the experience? > > Thanks > > > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > -- Best Regards Jeff Zhang
