[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21623 @cloud-fan . AFAIK, ORC doesn't support custom filter yet. I'll follow up that stuff in ORC. --- - To unsubscribe,

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21623 thanks, merging to master! @dongjoon-hyun is there something similar in ORC? --- - To unsubscribe, e-mail:

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21623 Benchmark result: ``` ###[ Pushdown benchmark for StringStartsWith ]### Java HotSpot(TM) 64-Bit Server VM 1.8.0_151-b12 on Mac OS X

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92474/ Test PASSed. ---

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92474 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92474/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92463/ Test PASSed. ---

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92463 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92463/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/586/

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92474 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92474/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/576/

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92463 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92463/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21623 Jenkins, retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92454/ Test FAILed. ---

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92454 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92454/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92449/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92449/ Test FAILed. ---

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92454/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/566/

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92449/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/561/

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-27 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/21623 Overall, I think this is close. The tests need to cover the row group stats case and we should update how configuration is passed to the filters. Thanks for working on this, @wangyum! ---

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92362/ Test PASSed. ---

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92362 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92362/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92362 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92362/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/498/

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92342/ Test PASSed. ---

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92342 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92342/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/483/

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92342 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92342/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-25 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21623 cc @gszadovszky @nandorKollar --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-25 Thread attilapiros
Github user attilapiros commented on the issue: https://github.com/apache/spark/pull/21623 Just a question regarding `sources.StringStartsWith("_1", null))`: if you have a nullable string column and some of the values are null will this operator (parameterized with null) matches

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92258/ Test PASSed. ---

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92258 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92258/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21623 cc @rdblue --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21623 **[Test build #92258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92258/testReport)** for PR 21623 at commit

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21623: [SPARK-24638][SQL] StringStartsWith support push down

2018-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/438/