[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574961106 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574961114 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574961114 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] JkSelf opened a new pull request #27226: Disable OptimizeSkewedJoin rule when introducing additional shuffle

JkSelf opened a new pull request #27226: Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226 ### What changes were proposed in this pull request? `OptimizeSkewedJoin `rule change the `outputPartitioning `after insert

[GitHub] [spark] JkSelf commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

JkSelf commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962046 @cloud-fan @hvanhovell @maryannxue Please help review if you have available time. Thanks for you

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962489 **[Test build #116807 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962739 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962749 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962781 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962778 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962770 **[Test build #116807 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962778 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962749 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962739 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

SparkQA removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962489 **[Test build #116807 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574962781 Test FAILed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#discussion_r367213570 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

[GitHub] [spark] cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#discussion_r367213628 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

[GitHub] [spark] AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows

AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-574963605 Merged

[GitHub] [spark] SparkQA commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of th

SparkQA commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-574963520 **[Test build #11680

[GitHub] [spark] AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use

AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-574963615 Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the u

SparkQA removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-574943784 **[Test buil

[GitHub] [spark] AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use

AmplabJenkins commented on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-574963605 Merged build f

[GitHub] [spark] AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows

AmplabJenkins removed a comment on issue #27058: [SPARK-30395][SQL] When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause URL: https://github.com/apache/spark/pull/27058#issuecomment-574963615 Test F

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574964534 **[Test build #116808 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574964868 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574964868 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574964859 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574964859 Merged build finished. Test PASSed. --

[GitHub] [spark] cloud-fan commented on issue #27211: [SPARK-30325][CORE][2.4] markPartitionCompleted cause task status inconsistent

cloud-fan commented on issue #27211: [SPARK-30325][CORE][2.4] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/27211#issuecomment-574966160 thanks, merging to master! This is an

[GitHub] [spark] cloud-fan closed pull request #27211: [SPARK-30325][CORE][2.4] markPartitionCompleted cause task status inconsistent

cloud-fan closed pull request #27211: [SPARK-30325][CORE][2.4] markPartitionCompleted cause task status inconsistent URL: https://github.com/apache/spark/pull/27211 This is an automated message from the Apache Git Service. T

[GitHub] [spark] SparkQA commented on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame

SparkQA commented on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame URL: https://github.com/apache/spark/pull/27225#issuecomment-574966319 **[Test build #116805 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequ

[GitHub] [spark] HyukjinKwon commented on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame

HyukjinKwon commented on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame URL: https://github.com/apache/spark/pull/27225#issuecomment-574966456 I'm 100% sure this fix is correct. I am going to merge this. Thanks, @zero323 for pointi

[GitHub] [spark] SparkQA removed a comment on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame

SparkQA removed a comment on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame URL: https://github.com/apache/spark/pull/27225#issuecomment-574960833 **[Test build #116805 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] AmplabJenkins commented on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame

AmplabJenkins commented on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame URL: https://github.com/apache/spark/pull/27225#issuecomment-574966581 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame

AmplabJenkins commented on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame URL: https://github.com/apache/spark/pull/27225#issuecomment-574966587 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

AmplabJenkins commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-574966715 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame

AmplabJenkins removed a comment on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame URL: https://github.com/apache/spark/pull/27225#issuecomment-574966581 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

AmplabJenkins commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-574966714 Merged build finished. Test PASSed.

[GitHub] [spark] huaxingao commented on issue #26247: [SPARK-29566][ML] Imputer should support single-column input/output

huaxingao commented on issue #26247: [SPARK-29566][ML] Imputer should support single-column input/output URL: https://github.com/apache/spark/pull/26247#issuecomment-574966750 @zero323 That is the one I missed. I noticed that a couple of days ago, but thinking of fixing it along with all t

[GitHub] [spark] AmplabJenkins removed a comment on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame

AmplabJenkins removed a comment on issue #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame URL: https://github.com/apache/spark/pull/27225#issuecomment-574966587 Test PASSed. Refer to this link for build results (access rights to CI serv

[GitHub] [spark] AmplabJenkins removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

AmplabJenkins removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-574966714 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

AmplabJenkins removed a comment on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-574966715 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] Ngone51 commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

Ngone51 commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-574967015 @cloud-fan @MaxGekk @HyukjinKwon updated, thanks.

[GitHub] [spark] HyukjinKwon closed pull request #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame

HyukjinKwon closed pull request #27225: [SPARK-30434][FOLLOW-UP][PYTHON][SQL] Make the parameter list consistent in createDataFrame URL: https://github.com/apache/spark/pull/27225 This is an automated message from the Apache

[GitHub] [spark] viirya commented on a change in pull request #27224: [SPARK-30523][SQL] - Collapse nested aggregates

viirya commented on a change in pull request #27224: [SPARK-30523][SQL] - Collapse nested aggregates URL: https://github.com/apache/spark/pull/27224#discussion_r367217459 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ##

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping

dongjoon-hyun commented on a change in pull request #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#discussion_r367217633 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sq

[GitHub] [spark] AmplabJenkins commented on issue #23988: [SPARK-26509][SQL] Parquet DELTA_BYTE_ARRAY is not supported in Spark 2.x's Vectorized Reader

AmplabJenkins commented on issue #23988: [SPARK-26509][SQL] Parquet DELTA_BYTE_ARRAY is not supported in Spark 2.x's Vectorized Reader URL: https://github.com/apache/spark/pull/23988#issuecomment-574968030 Can one of the admins verify this patch? ---

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping

dongjoon-hyun commented on a change in pull request #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#discussion_r367217633 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sq

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping

dongjoon-hyun commented on a change in pull request #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#discussion_r367217804 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sq

[GitHub] [spark] SparkQA commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource

SparkQA commented on issue #27199: [SPARK-30508][SQL] Add DataFrameReader.executeCommand API for external datasource URL: https://github.com/apache/spark/pull/27199#issuecomment-574968086 **[Test build #116809 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] AmplabJenkins removed a comment on issue #23988: [SPARK-26509][SQL] Parquet DELTA_BYTE_ARRAY is not supported in Spark 2.x's Vectorized Reader

AmplabJenkins removed a comment on issue #23988: [SPARK-26509][SQL] Parquet DELTA_BYTE_ARRAY is not supported in Spark 2.x's Vectorized Reader URL: https://github.com/apache/spark/pull/23988#issuecomment-548189298 Can one of the admins verify this patch? ---

[GitHub] [spark] dongjoon-hyun commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping

dongjoon-hyun commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-574968455 BTW, @gatorsmile . If you have any concern on 2.4.5 RC1, could you vote on the mailing l

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r367218671 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] yaooqinn commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

yaooqinn commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r367219758 ## File path: sql/catalyst/src/main/scala/org/apache/spar

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r367220187 ## File path: sql/catalyst/src/main/scala/org/apache/spa

[GitHub] [spark] cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

cloud-fan commented on a change in pull request #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#discussion_r367220655 ## File path: sql/core/src/test/scala/org/apache/spark/s

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574971171 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574971178 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574971178 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

AmplabJenkins removed a comment on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574971171 Merged build finished. Test PASSed. --

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping

dongjoon-hyun commented on a change in pull request #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#discussion_r367217633 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sq

[GitHub] [spark] SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

SparkQA commented on issue #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#issuecomment-574972361 **[Test build #116810 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] dongjoon-hyun closed pull request #27210: [SPARK-30312][SQL][FOLLOWUP] Rename conf by adding `.enabled`

dongjoon-hyun closed pull request #27210: [SPARK-30312][SQL][FOLLOWUP] Rename conf by adding `.enabled` URL: https://github.com/apache/spark/pull/27210 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

HyukjinKwon commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-574972929 Merged to master. This is an automated message from t

[GitHub] [spark] HyukjinKwon closed pull request #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

HyukjinKwon closed pull request #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973 This is an automated message from the Apache Git Service. To respond to th

[GitHub] [spark] dongjoon-hyun commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

dongjoon-hyun commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574974049 Hi, @maropu . Could you make a backporting PR for RC2? Thanks!

[GitHub] [spark] dongjoon-hyun closed pull request #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

dongjoon-hyun closed pull request #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177 This is an automated message from the Apache Git Serv

[GitHub] [spark] dongjoon-hyun commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

dongjoon-hyun commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574975233 @mengCareers . You are added to the Apache Spark contributor group and SPARK-30491 is assigned to

[GitHub] [spark] dongjoon-hyun commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

dongjoon-hyun commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574975589 Since RC1 vote is cancelled with several feedbacks, I'll merge this for next RC. Thank you a

[GitHub] [spark] dongjoon-hyun closed pull request #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

dongjoon-hyun closed pull request #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178 This is an automated message from the Apache Git

[GitHub] [spark] jaltekruse commented on a change in pull request #27224: [SPARK-30523][SQL] - Collapse nested aggregates

jaltekruse commented on a change in pull request #27224: [SPARK-30523][SQL] - Collapse nested aggregates URL: https://github.com/apache/spark/pull/27224#discussion_r367225360 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala

[GitHub] [spark] HyukjinKwon commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

HyukjinKwon commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-574976931 retest this please ---

[GitHub] [spark] srowen opened a new pull request #27227: [SPARK-29290][CORE] Update to chill 0.9.5

srowen opened a new pull request #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227 ### What changes were proposed in this pull request? Update Twitter Chill to 0.9.5. ### Why are the changes needed? Primarily, Scala 2.13 s

[GitHub] [spark] dongjoon-hyun commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

dongjoon-hyun commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-574976840 Hi, @xCASx and all. For RC2 preparation, I revert this commit from `branch-2.4` and verifi

[GitHub] [spark] SparkQA commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

SparkQA commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574977039 **[Test build #116811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116811/testReport)** for PR 27227 at com

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

dongjoon-hyun edited a comment on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-574976840 Hi, @xCASx and all. For RC2 preparation, I revert this commit from `branch-2.4` and

[GitHub] [spark] PavithraRamachandran commented on issue #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command

PavithraRamachandran commented on issue #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command URL: https://github.com/apache/spark/pull/26759#issuecomment-574977223 i shall complete today This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574977363 Build finished. Test PASSed. This is an automated message from the Apac

[GitHub] [spark] AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574977363 Build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574977368 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574977368 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//jo

[GitHub] [spark] maropu commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated

maropu commented on issue #26961: [SPARK-29708][SQL] Correct aggregated values when grouping sets are duplicated URL: https://github.com/apache/spark/pull/26961#issuecomment-574977574 Yea, I saw the thread in the mail and sure! --

[GitHub] [spark] HyukjinKwon commented on issue #27221: [SPARK-30521][SQL][TESTS] Eliminate deprecation warnings for ExpressionInfo

HyukjinKwon commented on issue #27221: [SPARK-30521][SQL][TESTS] Eliminate deprecation warnings for ExpressionInfo URL: https://github.com/apache/spark/pull/27221#issuecomment-574977723 Merged to master. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-574977963 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

AmplabJenkins commented on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-574977966 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-574977963 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types

AmplabJenkins removed a comment on issue #27165: [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types URL: https://github.com/apache/spark/pull/27165#issuecomment-574977966 Test PASSed. Refer to this link for build results (access righ

[GitHub] [spark] HyukjinKwon closed pull request #27221: [SPARK-30521][SQL][TESTS] Eliminate deprecation warnings for ExpressionInfo

HyukjinKwon closed pull request #27221: [SPARK-30521][SQL][TESTS] Eliminate deprecation warnings for ExpressionInfo URL: https://github.com/apache/spark/pull/27221 This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574979168 Merged build finished. Test PASSed. This is an automated message from t

[GitHub] [spark] AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

AmplabJenkins commented on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574979179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//jo

[GitHub] [spark] AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574979168 Merged build finished. Test PASSed. This is an automated messag

[GitHub] [spark] AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5

AmplabJenkins removed a comment on issue #27227: [SPARK-29290][CORE] Update to chill 0.9.5 URL: https://github.com/apache/spark/pull/27227#issuecomment-574979179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#discussion_r367227838 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

[GitHub] [spark] cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#discussion_r367228040 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

[GitHub] [spark] huaxingao opened a new pull request #27228: [SPARK-29565][FOLLOWUP] add setInputCol/setOutputCol in OHEModel

huaxingao opened a new pull request #27228: [SPARK-29565][FOLLOWUP] add setInputCol/setOutputCol in OHEModel URL: https://github.com/apache/spark/pull/27228 ### What changes were proposed in this pull request? add setInputCol/setOutputCol in OHEModel ### Why are the changes ne

[GitHub] [spark] cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#discussion_r367228359 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

[GitHub] [spark] cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#discussion_r367228616 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

[GitHub] [spark] cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#discussion_r367228710 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

[GitHub] [spark] cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle

cloud-fan commented on a change in pull request #27226: [SPARK-30524] [SQL] Disable OptimizeSkewedJoin rule when introducing additional shuffle URL: https://github.com/apache/spark/pull/27226#discussion_r367228788 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution

<    4   5   6   7   8   9   10   11   >