[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11594 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194643076 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194643078 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52785/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194642867 **[Test build #52785 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52785/consoleFull)** for PR 11594 at commit [`d316a07`](https://github.com/apache/spark/commit/d316a0722bf44bef92393a3bcf5478f85ac13497). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194588427 **[Test build #52785 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52785/consoleFull)** for PR 11594 at commit [`d316a07`](https://github.com/apache/spark/commit/d316a0722bf44bef92393a3bcf5478f85ac13497). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194205962 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194205968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52731/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194205646 **[Test build #52731 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52731/consoleFull)** for PR 11594 at commit [`84bac4d`](https://github.com/apache/spark/commit/84bac4d7309121c0fd699ea2b06aa05b775a4d81). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194204457 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52729/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194204451 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194203447 **[Test build #52729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52729/consoleFull)** for PR 11594 at commit [`635eae2`](https://github.com/apache/spark/commit/635eae217f293af248a68cafca7ba6187c2a1886). * This patch passes all tests. * This patch **does not merge cleanly**. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194180436 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52730/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194180432 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194180035 **[Test build #52730 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52730/consoleFull)** for PR 11594 at commit [`54c3f49`](https://github.com/apache/spark/commit/54c3f49f6f558b77d8bd805269ed1ca8b8be3fad). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194142858 **[Test build #52731 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52731/consoleFull)** for PR 11594 at commit [`84bac4d`](https://github.com/apache/spark/commit/84bac4d7309121c0fd699ea2b06aa05b775a4d81). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194141605 **[Test build #52730 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52730/consoleFull)** for PR 11594 at commit [`54c3f49`](https://github.com/apache/spark/commit/54c3f49f6f558b77d8bd805269ed1ca8b8be3fad). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194140033 **[Test build #52729 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52729/consoleFull)** for PR 11594 at commit [`635eae2`](https://github.com/apache/spark/commit/635eae217f293af248a68cafca7ba6187c2a1886). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user nongli commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194107548 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194093407 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/52714/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194093404 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194093080 **[Test build #52714 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52714/consoleFull)** for PR 11594 at commit [`21a9250`](https://github.com/apache/spark/commit/21a9250e1266f3badbcc4b95bf2e7d276c22c5df). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11594#issuecomment-194064172 **[Test build #52714 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52714/consoleFull)** for PR 11594 at commit [`21a9250`](https://github.com/apache/spark/commit/21a9250e1266f3badbcc4b95bf2e7d276c22c5df). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-13759][SQL] Add IsNotNull constraints f...
GitHub user sameeragarwal opened a pull request: https://github.com/apache/spark/pull/11594 [SPARK-13759][SQL] Add IsNotNull constraints for expressions with an inequality ## What changes were proposed in this pull request? This PR adds support for adding `IsNotNull` constraints from expressions with an `!==`. More specifically, if an operator has a condition on `a !== b`, we know that both `a` and `b` in the operator output can no longer be null. ## How was this patch tested? 1. Modified a test in `ConstraintPropagationSuite` to test for expressions with an inequality. 2. Added a test in `NullFilteringSuite` for making sure an Inner join with a "non-equal" condition appropriately filters out null from their input. cc @nongli You can merge this pull request into a Git repository by running: $ git pull https://github.com/sameeragarwal/spark isnotequal-constraints Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/11594.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #11594 commit 21a9250e1266f3badbcc4b95bf2e7d276c22c5df Author: Sameer Agarwal Date: 2016-03-09T01:45:20Z Add IsNotNull constraints for !== --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
