Hi, I'm engaged in learning how query execution flow occurs in Spark SQL. In order to understand the query execution flow, I'm attempting to run an example in debug mode with intellij IDEA. It would be great if anyone can help me with debug configurations.
Thanks & Regards Nishadi On Tue, Jun 21, 2016 at 4:49 PM, Akhil Das <ak...@hacked.work> wrote: > You can read this documentation to get started with the setup > https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools# > UsefulDeveloperTools-IntelliJ > > There was a pyspark setup discussion on SO over here > http://stackoverflow.com/questions/33478218/write-and- > run-pyspark-in-intellij-idea > > On Mon, Jun 20, 2016 at 7:23 PM, Amit Rana <amitranavs...@gmail.com> > wrote: > >> Hi all, >> >> I am interested in figuring out how pyspark works at core/internal >> level. And would like to understand the code flow as well. >> For that I need to run a simple example in debug mode so that I can >> trace the data flow for pyspark. >> Can anyone please guide me on how do I set up my development environment >> for the same in intellij IDEA in Windows 7. >> >> Thanks, >> Amit Rana >> > > > > -- > Cheers! > >
