You can read this documentation to get started with the setup https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-IntelliJ
There was a pyspark setup discussion on SO over here http://stackoverflow.com/questions/33478218/write-and-run-pyspark-in-intellij-idea On Mon, Jun 20, 2016 at 7:23 PM, Amit Rana <amitranavs...@gmail.com> wrote: > Hi all, > > I am interested in figuring out how pyspark works at core/internal level. > And would like to understand the code flow as well. > For that I need to run a simple example in debug mode so that I can > trace the data flow for pyspark. > Can anyone please guide me on how do I set up my development environment > for the same in intellij IDEA in Windows 7. > > Thanks, > Amit Rana > -- Cheers!
