This worked. Thanks for the tip Michael.
Thanks,
Muthu
On Thu, Feb 16, 2017 at 12:41 PM, Michael Armbrust
wrote:
> The toString method of Dataset.queryExecution includes the various plans.
> I usually just log that directly.
>
> On Thu, Feb 16, 2017 at 8:26 AM, Muthu Jayakumar
> wrote:
>
>> He
The toString method of Dataset.queryExecution includes the various plans.
I usually just log that directly.
On Thu, Feb 16, 2017 at 8:26 AM, Muthu Jayakumar wrote:
> Hello there,
>
> I am trying to write to log-line a dataframe/dataset queryExecution and/or
> its logical plan. The current code..
Hello there,
I am trying to write to log-line a dataframe/dataset queryExecution and/or
its logical plan. The current code...
def explain(extended: Boolean): Unit = {
val explain = ExplainCommand(queryExecution.logical, extended = extended)
sparkSession.sessionState.executePlan(explain).exec