[GitHub] [spark] SparkQA commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

2020-01-16 Thread GitBox
SparkQA commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-575031299 **[Test build #116809 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-574968086 **[Test build #116809 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575031784 Merged build finished. Test FAILed. This is an aut

[GitHub] [spark] SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031737 **[Test build #116820 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116820/testReport

[GitHub] [spark] SparkQA commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-16 Thread GitBox
SparkQA commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575031734 **[Test build #116824 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116824/testReport)** f

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031777 **[Test build #116819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] SparkQA commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-16 Thread GitBox
SparkQA commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575031733 **[Test build #116823 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116823/testReport)

[GitHub] [spark] AmplabJenkins commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575031799 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] SparkQA commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-16 Thread GitBox
SparkQA commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575031740 **[Test build #116822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575031788 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031739 **[Test build #116816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] SparkQA commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
SparkQA commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575031736 **[Test build #116817 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575031809 Merged build f

[GitHub] [spark] SparkQA commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of th

2020-01-16 Thread GitBox
SparkQA commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575031741 **[Test build #11682

[GitHub] [spark] SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
SparkQA commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031742 **[Test build #116815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116815/testReport

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031787 **[Test build #116808 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] AmplabJenkins commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575031789 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575031814 Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031896 Merged build finished. Test FAILed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031903 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-575031944 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031959 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-575031958 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575031988 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031930 Merged build finished. Test FAILed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031936 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031938 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575031983 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575032018 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574964534 **[Test build #116808 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] SparkQA removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-574980899 **[Test build #116815 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116815/tes

[GitHub] [spark] AmplabJenkins removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575032018 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031903 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031959 Test FAILed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] SparkQA removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575020489 **[Test build #116823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116823/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575031809 Merged

[GitHub] [spark] yaooqinn commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
yaooqinn commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575032118 retest this please

[GitHub] [spark] SparkQA removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575025592 **[Test build #116824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116824/testRepor

[GitHub] [spark] SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574988557 **[Test build #116816 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] beliefer commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of t

2020-01-16 Thread GitBox
beliefer commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575032037 retest this please

[GitHub] [spark] SparkQA removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574990452 **[Test build #116817 has started](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575032004 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031896 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031936 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-575031958 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575031789 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031998 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574998541 **[Test build #116819 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575031814 Test F

[GitHub] [spark] SparkQA removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575000581 **[Test build #116820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116820/tes

[GitHub] [spark] AmplabJenkins commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575032024 Test FAILed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the u

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575027955 **[Test buil

[GitHub] [spark] AmplabJenkins removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-575031944 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031930 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575031998 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575031784 Merged build finished. Test FAILed. This i

[GitHub] [spark] SparkQA removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-16 Thread GitBox
SparkQA removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575004668 **[Test build #116822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575031983 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575031788 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575031988 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575032350 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575032339 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27229: [SPARK-29708][SQL][BRANCH-2.4] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/27229#issuecomment-575032024 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #25827: [SPARK-29128][SQL] Split predicate code in OR expressions URL: https://github.com/apache/spark/pull/25827#issuecomment-575031799 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575032004 Test FAILed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27096: [SPARK-28148][SQL] Repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-575031938 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575032339 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
SparkQA commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575033195 **[Test build #116826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-575032350 Test FAILed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] SparkQA commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-16 Thread GitBox
SparkQA commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-575033487 **[Test build #116828 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116828/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of th

2020-01-16 Thread GitBox
SparkQA commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575033417 **[Test build #11682

[GitHub] [spark] AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575034151 Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575034142 Merged build f

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575034169 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575034169 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-575034234 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-575034240 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575034151 Test P

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575034179 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-575034179 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-575034142 Merged

[GitHub] [spark] AmplabJenkins removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-575034234 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-575034240 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] HeartSaVioR commented on issue #27209: [SPARK-29450][SS][2.4] Measure the number of output rows for streaming aggregation with append mode

2020-01-16 Thread GitBox
HeartSaVioR commented on issue #27209: [SPARK-29450][SS][2.4] Measure the number of output rows for streaming aggregation with append mode URL: https://github.com/apache/spark/pull/27209#issuecomment-575037845 Thanks for reviewing and merging! --

[GitHub] [spark] fuwhu opened a new pull request #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore

2020-01-16 Thread GitBox
fuwhu opened a new pull request #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore URL: https://github.com/apache/spark/pull/27232 ### What changes were proposed in this pull request? HiveTableScanExec does not prune par

[GitHub] [spark] cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-16 Thread GitBox
cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#discussion_r367283434 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strateg

[GitHub] [spark] cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-16 Thread GitBox
cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#discussion_r367283434 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strateg

[GitHub] [spark] fuwhu commented on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account

2020-01-16 Thread GitBox
fuwhu commented on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account URL: https://github.com/apache/spark/pull/27213#issuecomment-575039254 retest this please. ---

[GitHub] [spark] SparkQA commented on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account

2020-01-16 Thread GitBox
SparkQA commented on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account URL: https://github.com/apache/spark/pull/27213#issuecomment-575039685 **[Test build #116830 has started](https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] SparkQA commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore

2020-01-16 Thread GitBox
SparkQA commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore URL: https://github.com/apache/spark/pull/27232#issuecomment-575039686 **[Test build #116829 has started](https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] AmplabJenkins removed a comment on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account URL: https://github.com/apache/spark/pull/27213#issuecomment-575040294 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account URL: https://github.com/apache/spark/pull/27213#issuecomment-575040294 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account URL: https://github.com/apache/spark/pull/27213#issuecomment-575040299 Test PASSed. Refer to this link for build results (access ri

[GitHub] [spark] AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore URL: https://github.com/apache/spark/pull/27232#issuecomment-575040258 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore URL: https://github.com/apache/spark/pull/27232#issuecomment-575040258 Test PASSed. Refer to this link for build results (acces

[GitHub] [spark] AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore

2020-01-16 Thread GitBox
AmplabJenkins commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore URL: https://github.com/apache/spark/pull/27232#issuecomment-575040242 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore URL: https://github.com/apache/spark/pull/27232#issuecomment-575040242 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account

2020-01-16 Thread GitBox
AmplabJenkins removed a comment on issue #27213: [SPARK-30516][SQL] statistic estimation of FileScan should take partitionFilters and partition number into account URL: https://github.com/apache/spark/pull/27213#issuecomment-575040299 Test PASSed. Refer to this link for build results (a

[GitHub] [spark] davidvrba commented on issue #27231: [SPARK-28478] [SQL] Remove redundant null checks

2020-01-16 Thread GitBox
davidvrba commented on issue #27231: [SPARK-28478] [SQL] Remove redundant null checks URL: https://github.com/apache/spark/pull/27231#issuecomment-575041738 @cloud-fan kindly asking for review. Thanks for the help. This is an

[GitHub] [spark] SparkQA commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-16 Thread GitBox
SparkQA commented on issue #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#issuecomment-575042574 **[Test build #116832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116832/testReport)*

  1   2   3   4   5   6   7   8   9   10   >