[GitHub] [spark] dongjoon-hyun closed pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

dongjoon-hyun closed pull request #31670: URL: https://github.com/apache/spark/pull/31670 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

dongjoon-hyun commented on pull request #31670: URL: https://github.com/apache/spark/pull/31670#issuecomment-787032295 Thank you, @maropu . Merged to master. This is an automated message from the Apache Git Service. To respon

[GitHub] [spark] wangyum commented on a change in pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

wangyum commented on a change in pull request #31673: URL: https://github.com/apache/spark/pull/31673#discussion_r584085172 ## File path: pom.xml ## @@ -1235,6 +1235,10 @@ javax.annotation javax.annotation-api + +com.g

[GitHub] [spark] maropu closed pull request #31468: [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 partition

maropu closed pull request #31468: URL: https://github.com/apache/spark/pull/31468 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] maropu commented on pull request #31468: [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 partition

maropu commented on pull request #31468: URL: https://github.com/apache/spark/pull/31468#issuecomment-787031497 Thanks! Merged to master. This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [spark] wangyum commented on a change in pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

wangyum commented on a change in pull request #31673: URL: https://github.com/apache/spark/pull/31673#discussion_r584084925 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ## @@ -492,17 +493,21 @@ abstract class AvroSuite df.write.fo

[GitHub] [spark] SparkQA commented on pull request #31671: [SPARK-34558][SQL] warehouse path should be qualified ahead of populating and use

SparkQA commented on pull request #31671: URL: https://github.com/apache/spark/pull/31671#issuecomment-787030941 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40114/ -

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

dongjoon-hyun commented on a change in pull request #31673: URL: https://github.com/apache/spark/pull/31673#discussion_r584083511 ## File path: pom.xml ## @@ -1235,6 +1235,10 @@ javax.annotation javax.annotation-api + +

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

dongjoon-hyun commented on a change in pull request #31673: URL: https://github.com/apache/spark/pull/31673#discussion_r584083511 ## File path: pom.xml ## @@ -1235,6 +1235,10 @@ javax.annotation javax.annotation-api + +

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31642: [SPARK-33212][FOLLOWUP][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

AmplabJenkins removed a comment on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-787030191 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40113/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

dongjoon-hyun commented on a change in pull request #31673: URL: https://github.com/apache/spark/pull/31673#discussion_r584083552 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ## @@ -492,17 +493,21 @@ abstract class AvroSuite df.wr

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

AmplabJenkins removed a comment on pull request #31670: URL: https://github.com/apache/spark/pull/31670#issuecomment-787030192 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40115/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

AmplabJenkins removed a comment on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-787030190 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40112/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

dongjoon-hyun commented on a change in pull request #31673: URL: https://github.com/apache/spark/pull/31673#discussion_r584083511 ## File path: pom.xml ## @@ -1235,6 +1235,10 @@ javax.annotation javax.annotation-api + +

[GitHub] [spark] AmplabJenkins commented on pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

AmplabJenkins commented on pull request #31670: URL: https://github.com/apache/spark/pull/31670#issuecomment-787030192 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40115/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

AmplabJenkins commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-787030190 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40112/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31642: [SPARK-33212][FOLLOWUP][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

AmplabJenkins commented on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-787030191 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40113/ -

[GitHub] [spark] wangyum commented on a change in pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

wangyum commented on a change in pull request #31673: URL: https://github.com/apache/spark/pull/31673#discussion_r584083357 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ## @@ -492,17 +493,21 @@ abstract class AvroSuite df.write.fo

[GitHub] [spark] dongjoon-hyun commented on pull request #31662: [SPARK-34553][INFRA] Rename GITHUB_API_TOKEN to GITHUB_OAUTH_KEY in translate-contributors.py

dongjoon-hyun commented on pull request #31662: URL: https://github.com/apache/spark/pull/31662#issuecomment-787030062 +1, LGTM. This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] wangyum commented on a change in pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

wangyum commented on a change in pull request #31673: URL: https://github.com/apache/spark/pull/31673#discussion_r584083357 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ## @@ -492,17 +493,21 @@ abstract class AvroSuite df.write.fo

[GitHub] [spark] dongjoon-hyun commented on pull request #31665: [MINOR] Add more known translations of contributors

dongjoon-hyun commented on pull request #31665: URL: https://github.com/apache/spark/pull/31665#issuecomment-787029872 +1, LGTM. Thank you, @HyukjinKwon . This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] dongjoon-hyun commented on pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

dongjoon-hyun commented on pull request #31670: URL: https://github.com/apache/spark/pull/31670#issuecomment-787029666 Could you review this when you have some time, @maropu ? This is an automated message from the Apache Git

[GitHub] [spark] wangyum opened a new pull request #31673: [SPARK-34479][SQL] Add zstandard codec to Avro compression codec list

wangyum opened a new pull request #31673: URL: https://github.com/apache/spark/pull/31673 ### What changes were proposed in this pull request? Avro add zstandard codec since AVRO-2195. This pr add zstandard codec to Avro compression codec list. ### Why are the changes needed?

[GitHub] [spark] dongjoon-hyun commented on pull request #31672: [SPARK-34543][SQL][3.0] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

dongjoon-hyun commented on pull request #31672: URL: https://github.com/apache/spark/pull/31672#issuecomment-787029615 Thank you, @MaxGekk . This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

dongjoon-hyun commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-787029604 Thank you, @MaxGekk . This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

SparkQA commented on pull request #31670: URL: https://github.com/apache/spark/pull/31670#issuecomment-787029590 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40115/ ---

[GitHub] [spark] kevincmchen commented on a change in pull request #31560: [SPARK-34432][SQL][TESTS] Add JavaSimpleWritableDataSource

kevincmchen commented on a change in pull request #31560: URL: https://github.com/apache/spark/pull/31560#discussion_r583674224 ## File path: sql/core/src/test/java/test/org/apache/spark/sql/connector/JavaSimpleWritableDataSource.java ## @@ -0,0 +1,370 @@ +/* + * Licensed to t

[GitHub] [spark] kevincmchen commented on a change in pull request #31560: [SPARK-34432][SQL][TESTS] Add JavaSimpleWritableDataSource

kevincmchen commented on a change in pull request #31560: URL: https://github.com/apache/spark/pull/31560#discussion_r583674224 ## File path: sql/core/src/test/java/test/org/apache/spark/sql/connector/JavaSimpleWritableDataSource.java ## @@ -0,0 +1,370 @@ +/* + * Licensed to t

[GitHub] [spark] SparkQA commented on pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

SparkQA commented on pull request #31670: URL: https://github.com/apache/spark/pull/31670#issuecomment-787020480 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40115/ -

[GitHub] [spark] MaxGekk commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

MaxGekk commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-787019068 Here is the backport to `branch-3.0`: https://github.com/apache/spark/pull/31672 This is an automated message f

[GitHub] [spark] MaxGekk opened a new pull request #31672: [SPARK-34543][SQL][3.0] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

MaxGekk opened a new pull request #31672: URL: https://github.com/apache/spark/pull/31672 ### What changes were proposed in this pull request? Preprocess the partition spec passed to the V1 `ALTER TABLE .. SET LOCATION` implementation `AlterTableSetLocationCommand`, and normalize the pas

[GitHub] [spark] SparkQA commented on pull request #31642: [SPARK-33212][FOLLOWUP][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

SparkQA commented on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-787017537 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40113/ ---

[GitHub] [spark] SparkQA commented on pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

SparkQA commented on pull request #31670: URL: https://github.com/apache/spark/pull/31670#issuecomment-787017283 **[Test build #135534 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135534/testReport)** for PR 31670 at commit [`beddb2b`](https://github.com

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] [SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name h

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r584049545 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,9 +395,9 @@ final class DataFrameNaFunctions pri

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] [SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name h

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r584049545 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,9 +395,9 @@ final class DataFrameNaFunctions pri

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] [SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name h

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r584049545 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,9 +395,9 @@ final class DataFrameNaFunctions pri

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] [SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name h

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r584049545 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,9 +395,9 @@ final class DataFrameNaFunctions pri

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] [SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name h

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r584049545 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,9 +395,9 @@ final class DataFrameNaFunctions pri

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] [SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name h

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r584049545 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,9 +395,9 @@ final class DataFrameNaFunctions pri

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31669: [SPARK-34556][SQL]Checking duplicate static partition columns should respect case sensitive conf

AmplabJenkins removed a comment on pull request #31669: URL: https://github.com/apache/spark/pull/31669#issuecomment-787015630 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135526/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31669: [SPARK-34556][SQL]Checking duplicate static partition columns should respect case sensitive conf

AmplabJenkins commented on pull request #31669: URL: https://github.com/apache/spark/pull/31669#issuecomment-787015630 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135526/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31669: [SPARK-34556][SQL]Checking duplicate static partition columns should respect case sensitive conf

SparkQA removed a comment on pull request #31669: URL: https://github.com/apache/spark/pull/31669#issuecomment-786983626 **[Test build #135526 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135526/testReport)** for PR 31669 at commit [`f841f74`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31669: [SPARK-34556][SQL]Checking duplicate static partition columns should respect case sensitive conf

SparkQA commented on pull request #31669: URL: https://github.com/apache/spark/pull/31669#issuecomment-787015511 **[Test build #135526 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135526/testReport)** for PR 31669 at commit [`f841f74`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31671: [SPARK-34558][SQL] warehouse path should be qualified ahead of populating and use

SparkQA commented on pull request #31671: URL: https://github.com/apache/spark/pull/31671#issuecomment-787015457 **[Test build #135533 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135533/testReport)** for PR 31671 at commit [`bd26d8f`](https://github.com

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] [SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name h

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r584049545 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,9 +395,9 @@ final class DataFrameNaFunctions pri

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] [SQL] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name h

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r584049545 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,9 +395,9 @@ final class DataFrameNaFunctions pri

[GitHub] [spark] SparkQA commented on pull request #31642: [SPARK-33212][FOLLOWUP][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

SparkQA commented on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-787015036 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40113/ -

[GitHub] [spark] yaooqinn opened a new pull request #31671: [SPARK-34558][SQL] warehouse path should be qualified ahead of populating and use

yaooqinn opened a new pull request #31671: URL: https://github.com/apache/spark/pull/31671 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### Ho

[GitHub] [spark] dongjoon-hyun commented on pull request #31667: [SPARK-32703][SQL] Replace deprecated API calls from SpecificParquetRecordReaderBase

dongjoon-hyun commented on pull request #31667: URL: https://github.com/apache/spark/pull/31667#issuecomment-787013547 Thank you, @maropu . This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

dongjoon-hyun commented on pull request #31670: URL: https://github.com/apache/spark/pull/31670#issuecomment-787013457 cc @wangyum This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [spark] dongjoon-hyun opened a new pull request #31670: [SPARK-34557][BUILD] Exclude Avro's transitive zstd-jni dependency

dongjoon-hyun opened a new pull request #31670: URL: https://github.com/apache/spark/pull/31670 ### What changes were proposed in this pull request? This PR aims to exclude `Apache Avro`'s transitive zstd-jni dependency. ### Why are the changes needed? This explicitly pr

[GitHub] [spark] SparkQA commented on pull request #31642: [SPARK-33212][FOLLOWUP][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

SparkQA commented on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-787012019 **[Test build #135532 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135532/testReport)** for PR 31642 at commit [`c31e06d`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

AmplabJenkins commented on pull request #31598: URL: https://github.com/apache/spark/pull/31598#issuecomment-787011403 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135529/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

SparkQA removed a comment on pull request #31598: URL: https://github.com/apache/spark/pull/31598#issuecomment-786996892 **[Test build #135529 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135529/testReport)** for PR 31598 at commit [`1f1e2ed`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

SparkQA commented on pull request #31598: URL: https://github.com/apache/spark/pull/31598#issuecomment-787011218 **[Test build #135529 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135529/testReport)** for PR 31598 at commit [`1f1e2ed`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

SparkQA commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-787010014 **[Test build #135531 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135531/testReport)** for PR 31666 at commit [`e1719d3`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-787009802 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40111/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31667: [SPARK-32703][SQL] Replace deprecated API calls from SpecificParquetRecordReaderBase

AmplabJenkins removed a comment on pull request #31667: URL: https://github.com/apache/spark/pull/31667#issuecomment-787009801 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135524/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

AmplabJenkins removed a comment on pull request #31598: URL: https://github.com/apache/spark/pull/31598#issuecomment-787009803 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40110/

[GitHub] [spark] AmplabJenkins commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-787009802 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40111/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

AmplabJenkins commented on pull request #31598: URL: https://github.com/apache/spark/pull/31598#issuecomment-787009803 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40110/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31667: [SPARK-32703][SQL] Replace deprecated API calls from SpecificParquetRecordReaderBase

AmplabJenkins commented on pull request #31667: URL: https://github.com/apache/spark/pull/31667#issuecomment-787009801 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135524/ -

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-787008733 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40111/ ---

[GitHub] [spark] SparkQA removed a comment on pull request #31667: [SPARK-32703][SQL] Replace deprecated API calls from SpecificParquetRecordReaderBase

SparkQA removed a comment on pull request #31667: URL: https://github.com/apache/spark/pull/31667#issuecomment-786971100 **[Test build #135524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135524/testReport)** for PR 31667 at commit [`9b3bb11`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31667: [SPARK-32703][SQL] Replace deprecated API calls from SpecificParquetRecordReaderBase

SparkQA commented on pull request #31667: URL: https://github.com/apache/spark/pull/31667#issuecomment-787008337 **[Test build #135524 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135524/testReport)** for PR 31667 at commit [`9b3bb11`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-787007693 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40111/ -

[GitHub] [spark] SparkQA commented on pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

SparkQA commented on pull request #31598: URL: https://github.com/apache/spark/pull/31598#issuecomment-787005938 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40110/ ---

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-787005890 **[Test build #135530 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135530/testReport)** for PR 30421 at commit [`093b062`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31642: [SPARK-33212][FOLLOWUP][test-maven][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

AmplabJenkins removed a comment on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-787003431 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135525/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

AmplabJenkins removed a comment on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-787003430 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135528/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

AmplabJenkins commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-787003430 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135528/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31642: [SPARK-33212][FOLLOWUP][test-maven][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

AmplabJenkins commented on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-787003431 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135525/ -

[GitHub] [spark] SparkQA commented on pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

SparkQA commented on pull request #31598: URL: https://github.com/apache/spark/pull/31598#issuecomment-787003244 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40110/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

SparkQA removed a comment on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-786983486 **[Test build #135528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135528/testReport)** for PR 31649 at commit [`e7b14c8`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

SparkQA commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-787003070 **[Test build #135528 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135528/testReport)** for PR 31649 at commit [`e7b14c8`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #31642: [SPARK-33212][FOLLOWUP][test-maven][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

SparkQA removed a comment on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-786971184 **[Test build #135525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135525/testReport)** for PR 31642 at commit [`e2d32aa`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31642: [SPARK-33212][FOLLOWUP][test-maven][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

SparkQA commented on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-787002690 **[Test build #135525 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135525/testReport)** for PR 31642 at commit [`e2d32aa`](https://github.co

[GitHub] [spark] AngersZhuuuu edited a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AngersZh edited a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-78672 Hmmm， seems DSV2 have many different behaviors. 1. can't use interval as table schema? 2. if partition column is date, if we pass a partition value as `Spark SQL

[GitHub] [spark] AngersZhuuuu commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AngersZh commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-78672 Hmmm， seems DSV2 have many different behaviors. 1. can't use interval as table schema? 2. if partition column is date, if we pass a partition value as `Spark SQL`, DSV

[GitHub] [spark] yaooqinn commented on pull request #31624: [SPARK-34392][SQL] Support ZoneOffset +h:mm in DateTimeUtils. getZoneId

yaooqinn commented on pull request #31624: URL: https://github.com/apache/spark/pull/31624#issuecomment-786997772 +1 for 3.1 and 3.0 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

AmplabJenkins removed a comment on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-786997421 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135527/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

SparkQA removed a comment on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-786983806 **[Test build #135527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135527/testReport)** for PR 31666 at commit [`80beda8`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

AmplabJenkins commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-786997421 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135527/ -

[GitHub] [spark] SparkQA commented on pull request #31666: [SPARK-34527][SQL] Resolve duplicated common columns from USING/NATURAL JOIN

SparkQA commented on pull request #31666: URL: https://github.com/apache/spark/pull/31666#issuecomment-786997380 **[Test build #135527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135527/testReport)** for PR 31666 at commit [`80beda8`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

SparkQA commented on pull request #31598: URL: https://github.com/apache/spark/pull/31598#issuecomment-786996892 **[Test build #135529 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135529/testReport)** for PR 31598 at commit [`1f1e2ed`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31468: [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 partition

AmplabJenkins removed a comment on pull request #31468: URL: https://github.com/apache/spark/pull/31468#issuecomment-786996767 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135523/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31468: [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 partition

AmplabJenkins commented on pull request #31468: URL: https://github.com/apache/spark/pull/31468#issuecomment-786996767 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135523/ -

[GitHub] [spark] Ngone51 commented on a change in pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

Ngone51 commented on a change in pull request #31643: URL: https://github.com/apache/spark/pull/31643#discussion_r584030032 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java ## @@ -117,17 +117,23 @@ private FetchShuf

[GitHub] [spark] Ngone51 commented on a change in pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

Ngone51 commented on a change in pull request #31643: URL: https://github.com/apache/spark/pull/31643#discussion_r584030032 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java ## @@ -117,17 +117,23 @@ private FetchShuf

[GitHub] [spark] SparkQA commented on pull request #31468: [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 partition

SparkQA commented on pull request #31468: URL: https://github.com/apache/spark/pull/31468#issuecomment-786994403 **[Test build #135523 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135523/testReport)** for PR 31468 at commit [`75c4d92`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #31468: [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 partition

SparkQA removed a comment on pull request #31468: URL: https://github.com/apache/spark/pull/31468#issuecomment-786939347 **[Test build #135523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135523/testReport)** for PR 31468 at commit [`75c4d92`](https://gi

[GitHub] [spark] otterc commented on a change in pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

otterc commented on a change in pull request #31643: URL: https://github.com/apache/spark/pull/31643#discussion_r584028482 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java ## @@ -117,17 +117,23 @@ private FetchShuff

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

AngersZh commented on a change in pull request #31598: URL: https://github.com/apache/spark/pull/31598#discussion_r584027706 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@ -2690,7 +2690,10 @@ object SparkContext extends Logging { setAct

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31598: [SPARK-34478][SQL] When build SparkSession, we should check config keys

AngersZh commented on a change in pull request #31598: URL: https://github.com/apache/spark/pull/31598#discussion_r584027678 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@ -2690,7 +2690,10 @@ object SparkContext extends Logging { setAct

[GitHub] [spark] Ngone51 commented on a change in pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

Ngone51 commented on a change in pull request #31643: URL: https://github.com/apache/spark/pull/31643#discussion_r584025854 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java ## @@ -117,17 +117,23 @@ private FetchShuf

[GitHub] [spark] Ngone51 commented on a change in pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

Ngone51 commented on a change in pull request #31643: URL: https://github.com/apache/spark/pull/31643#discussion_r584025854 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java ## @@ -117,17 +117,23 @@ private FetchShuf

[GitHub] [spark] Ngone51 commented on a change in pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

Ngone51 commented on a change in pull request #31643: URL: https://github.com/apache/spark/pull/31643#discussion_r584025854 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java ## @@ -117,17 +117,23 @@ private FetchShuf

[GitHub] [spark] otterc commented on a change in pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

otterc commented on a change in pull request #31643: URL: https://github.com/apache/spark/pull/31643#discussion_r584024039 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java ## @@ -117,17 +117,23 @@ private FetchShuff

[GitHub] [spark] Ngone51 commented on a change in pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

Ngone51 commented on a change in pull request #31643: URL: https://github.com/apache/spark/pull/31643#discussion_r584023425 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/OneForOneBlockFetcher.java ## @@ -117,17 +117,23 @@ private FetchShuf

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31668: [SPARK-34555][SQL] Resolve metadata output from DataFrame

AmplabJenkins removed a comment on pull request #31668: URL: https://github.com/apache/spark/pull/31668#issuecomment-786989065 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135522/ -

  1   2   3   4   5   6   >