Hello there,
I am trying to write to log-line a dataframe/dataset queryExecution and/or
its logical plan. The current code...
def explain(extended: Boolean): Unit = {
val explain = ExplainCommand(queryExecution.logical, extended = extended)
sparkSession.sessionState.executePlan(explain).executedPlan.executeCollect().foreach
{
// scalastyle:off println
r => println(r.getString(0))
// scalastyle:on println
}
}
sessionState is not accessible if I were to write my own explain(log:
LoggingAdapter).
Please advice,
Muthu
