[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16934 Thanks! Merging to master and 2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16934 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72962/ Test PASSed. ---

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16934 **[Test build #72962 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72962/testReport)** for PR 16934 at commit

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72957/ Test PASSed. ---

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16934 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16934 **[Test build #72957 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72957/testReport)** for PR 16934 at commit

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16934 **[Test build #72962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72962/testReport)** for PR 16934 at commit

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16934 @zsxwing Left one comment for tests and a question. It would be great if you could also post a snippet of the plans after this fix. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16934 **[Test build #72957 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72957/testReport)** for PR 16934 at commit

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16934 Good question. Make me realize my fix was wrong. We cannot use `logicalPlan` here because it's not the runtime batch plan. The purpose of adding StreamingQuery.explain is to allow the user to see

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16934 This solution is okay. I'm just not sure why we use `lastExecution.logicalPlan` instead of `logicalPlan` directly. In that case, we wouldn't need the `streaming = true` option for `ExplainCommand`

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16934 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72909/ Test PASSed. ---

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16934 **[Test build #72909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72909/testReport)** for PR 16934 at commit

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16934 **[Test build #72909 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72909/testReport)** for PR 16934 at commit