[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-07-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20915 Ah, I am happy too that it's added back. Was just simply wondering if I can fix the fix version in SPARK-12850 JIRA. Nothing more then this. Thank you @cloud-fan. ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-07-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20915 IIUC the bucket pruning was accidentally removed during refactoring, I'm happy to see it's added back. The migration must keep all the existing features. I think we have enough tests to

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-07-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20915 @cloud-fan, how does it relate to SPARK-23803, SPARK-12850 and SPARK-23507? Was about to take an action to the JIRAs but felt better making sure ahead. SPARK-12850 was merged in 2.0.0

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20915 thanks, merging to master! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91500/ Test PASSed. ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #91500 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91500/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91501/ Test FAILed. ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #91501 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91501/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #91501 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91501/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread sabanas
Github user sabanas commented on the issue: https://github.com/apache/spark/pull/20915 @cloud-fan thanks for the feedback, I fixed accordingly. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #91500 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91500/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91492/ Test PASSed. ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #91492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91492/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #91492 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91492/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-04 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20915 @sabanas @pwoody Sorry for the late reply. We are migrating Parquet, ORC and the other data sources using Data Source API V2. Thus, we are trying to address all these issues in the new code.

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-06-04 Thread sabanas
Github user sabanas commented on the issue: https://github.com/apache/spark/pull/20915 ping @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-05-09 Thread sabanas
Github user sabanas commented on the issue: https://github.com/apache/spark/pull/20915 @gatorsmile we would really want to start using this feature in our production stack. could you or anyone else give your feedback on this PR? Thanks! ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-05-03 Thread pwoody
Github user pwoody commented on the issue: https://github.com/apache/spark/pull/20915 Ping @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-04-25 Thread pwoody
Github user pwoody commented on the issue: https://github.com/apache/spark/pull/20915 @gatorsmile any chance you could take a look at this? Let me know if there is someone more appropriate to review, thanks! --- -

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-04-16 Thread pwoody
Github user pwoody commented on the issue: https://github.com/apache/spark/pull/20915 @gatorsmile would appreciate your feedback on this PR. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-04-03 Thread sabanas
Github user sabanas commented on the issue: https://github.com/apache/spark/pull/20915 @gatorsmile can we please proceed with the review? thanks. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88753/ Test PASSed. ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88753 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88753/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88753/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88706/ Test PASSed. ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88706 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88706/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88706/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88698/ Test PASSed. ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88698/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88698/testReport)** for PR 20915 at commit

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20915 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-28 Thread sabanas
Github user sabanas commented on the issue: https://github.com/apache/spark/pull/20915 org.apache.spark.sql.execution.streaming.sources.RateSourceSuite.overflow test failed. it passes on my local dev env and there are several other PRs failing the same test. possible CI issues?