Hi guys, I am trying to get a better understanding of the DAG generation for a job in Spark.
Ideally, what I want is to run some SQL query and extract the generated DAG by Spark. By DAG I mean the stages and dependencies among stages, and the number of tasks in every stage. Could you guys point me to the code where is that happening ? Thank you, Robert
