[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
GitHub user yjshen reopened a pull request: https://github.com/apache/spark/pull/8742 [SPARK-10539][SQL]Fix set optimization by eliminate empty project list push down Push down empty project list through `Intersect` or `Except` would make all the rows in both child to empty row, which makes set operation `intersect` or `except` meaningless. JIRA: https://issues.apache.org/jira/browse/SPARK-10539 You can merge this pull request into a Git repository by running: $ git pull https://github.com/yjshen/spark fix_set_optimization Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8742.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8742 commit 040b60a980627f5d5c6cb21a61ba0758dea8cf29 Author: Yijie Shen Date: 2015-09-14T09:05:38Z fix set optimization by eliminate empty project push down commit ce6ed80f1d3b7138664010a415a8501ea68dcd28 Author: Yijie Shen Date: 2015-09-14T16:30:38Z Project should not be pushed down through Intersect or Except --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140135612 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140135561 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user yjshen commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140075395 I need to investigate more about set operator to make sure I'm doing the right thing. Close it for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user yjshen closed the pull request at: https://github.com/apache/spark/pull/8742 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140043216 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140043217 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42419/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140043089 [Test build #42419 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42419/console) for PR 8742 at commit [`040b60a`](https://github.com/apache/spark/commit/040b60a980627f5d5c6cb21a61ba0758dea8cf29). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140012512 [Test build #42419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42419/consoleFull) for PR 8742 at commit [`040b60a`](https://github.com/apache/spark/commit/040b60a980627f5d5c6cb21a61ba0758dea8cf29). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140009449 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8742#issuecomment-140009422 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10539][SQL]Fix set optimization by elim...
GitHub user yjshen opened a pull request: https://github.com/apache/spark/pull/8742 [SPARK-10539][SQL]Fix set optimization by eliminate empty project list push down Push down empty project list through `Intersect` or `Except` would make all the rows in both child to empty row, which makes set operation `intersect` or `except` meaningless. JIRA: https://issues.apache.org/jira/browse/SPARK-10539 You can merge this pull request into a Git repository by running: $ git pull https://github.com/yjshen/spark fix_set_optimization Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8742.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8742 commit 040b60a980627f5d5c6cb21a61ba0758dea8cf29 Author: Yijie Shen Date: 2015-09-14T09:05:38Z fix set optimization by eliminate empty project push down --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
