[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-21 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-199444598 @sameeragarwal That is just an example that exposes this issue. I think `Cast` is just one of multiple compound cases. If we can avoid pushing down any filters that

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-21 Thread sameeragarwal
Github user sameeragarwal commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-199423757 @gatorsmile isn't the issue that you pointed out in the PR description just an artifact of union not propagating constraints correctly when it encounters a `Cast`

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197495711 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197502966 **[Test build #53329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53329/consoleFull)** for PR 11765 at commit [`da6238e`](https://g

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197503850 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-198534808 @gatorsmile Should we fix this in InferFiltersFromConstraints itself? --- If your project is set up for it, you can reply to this email and have your reply appear on Git

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197495421 **[Test build #53328 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53328/consoleFull)** for PR 11765 at commit [`6a0fd8a`](https://g

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197503845 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197514258 cc @marmbrus @sameeragarwal @cloud-fan @nongli --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197451969 **[Test build #53329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53329/consoleFull)** for PR 11765 at commit [`da6238e`](https://gi

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-197495717 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13936] [SQL] Avoid Predicate Pushdown U...

2016-03-18 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/11765#issuecomment-198591713 @davies, changing `InferFiltersFromConstraints` is unable to fix all the issues. `InferFiltersFromConstraints` is to infer the filter conditions based on the Constra