[GitHub] [spark] SparkQA commented on pull request #31475: [SPARK-34360][SQL] Support truncation of v2 tables

SparkQA commented on pull request #31475: URL: https://github.com/apache/spark/pull/31475#issuecomment-777256476 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39694/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31494: [SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES for v2 command

AmplabJenkins removed a comment on pull request #31494: URL: https://github.com/apache/spark/pull/31494#issuecomment-777251620 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39692/

[GitHub] [spark] AmplabJenkins commented on pull request #31494: [SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES for v2 command

AmplabJenkins commented on pull request #31494: URL: https://github.com/apache/spark/pull/31494#issuecomment-777251620 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39692/

[GitHub] [spark] SparkQA commented on pull request #31475: [SPARK-34360][SQL] Support truncation of v2 tables

SparkQA commented on pull request #31475: URL: https://github.com/apache/spark/pull/31475#issuecomment-777246209 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39694/

[GitHub] [spark] SparkQA commented on pull request #31494: [SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES for v2 command

SparkQA commented on pull request #31494: URL: https://github.com/apache/spark/pull/31494#issuecomment-777242881 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39692/

[GitHub] [spark] SparkQA commented on pull request #31475: [SPARK-34360][SQL] Support truncation of v2 tables

SparkQA commented on pull request #31475: URL: https://github.com/apache/spark/pull/31475#issuecomment-777235749 **[Test build #135112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135112/testReport)** for PR 31475 at commit

[GitHub] [spark] viirya closed pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

viirya closed pull request #31547: URL: https://github.com/apache/spark/pull/31547 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] viirya commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

viirya commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777233739 Thanks! Merging to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] mzhang-code commented on a change in pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

mzhang-code commented on a change in pull request #28957: URL: https://github.com/apache/spark/pull/28957#discussion_r574274413 ## File path: docs/rdd-programming-guide.md ## @@ -276,7 +276,7 @@ $ PYSPARK_DRIVER_PYTHON=jupyter PYSPARK_DRIVER_PYTHON_OPTS=notebook ./bin/pyspar

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

AmplabJenkins removed a comment on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777230555 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135108/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

AmplabJenkins removed a comment on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777230556 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39693/

[GitHub] [spark] AmplabJenkins commented on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

AmplabJenkins commented on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777230556 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39693/

[GitHub] [spark] AmplabJenkins commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

AmplabJenkins commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777230555 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135108/

[GitHub] [spark] SparkQA removed a comment on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

SparkQA removed a comment on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777155746 **[Test build #135108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135108/testReport)** for PR 31547 at commit

[GitHub] [spark] SparkQA commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

SparkQA commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777221910 **[Test build #135108 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135108/testReport)** for PR 31547 at commit

[GitHub] [spark] SparkQA commented on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

SparkQA commented on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777219947 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39693/

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574257299 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574257299 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31548: [SPARK-34127][SQL] Support table valued command

AmplabJenkins removed a comment on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-777211878 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39691/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

AmplabJenkins removed a comment on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777211879 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135111/

[GitHub] [spark] SparkQA commented on pull request #31494: [SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES for v2 command

SparkQA commented on pull request #31494: URL: https://github.com/apache/spark/pull/31494#issuecomment-777211931 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39692/

[GitHub] [spark] AmplabJenkins commented on pull request #31548: [SPARK-34127][SQL] Support table valued command

AmplabJenkins commented on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-777211878 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39691/

[GitHub] [spark] AmplabJenkins commented on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

AmplabJenkins commented on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777211879 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135111/

[GitHub] [spark] SparkQA commented on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

SparkQA commented on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777210937 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39693/

[GitHub] [spark] imback82 commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having a dot

imback82 commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574257803 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class DataFrameNaFunctionsSuite

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574257299 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574257299 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574257299 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574255693 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,22 +395,24 @@ final class DataFrameNaFunctions

[GitHub] [spark] SparkQA removed a comment on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

SparkQA removed a comment on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777199969 **[Test build #135111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135111/testReport)** for PR 31483 at commit

[GitHub] [spark] SparkQA commented on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

SparkQA commented on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777206133 **[Test build #135111 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135111/testReport)** for PR 31483 at commit

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574248882 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class

[GitHub] [spark] Eric-Lemmon commented on a change in pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

Eric-Lemmon commented on a change in pull request #31483: URL: https://github.com/apache/spark/pull/31483#discussion_r574249787 ## File path: python/docs/source/reference/pyspark.sql.rst ## @@ -72,6 +72,11 @@ See also :class:`SparkSession`. SparkSession.udf

[GitHub] [spark] SparkQA commented on pull request #31494: [SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES for v2 command

SparkQA commented on pull request #31494: URL: https://github.com/apache/spark/pull/31494#issuecomment-777200079 **[Test build #135110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135110/testReport)** for PR 31494 at commit

[GitHub] [spark] SparkQA commented on pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

SparkQA commented on pull request #31483: URL: https://github.com/apache/spark/pull/31483#issuecomment-777199969 **[Test build #135111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135111/testReport)** for PR 31483 at commit

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574248882 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class

[GitHub] [spark] amandeep-sharma commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having

amandeep-sharma commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574247925 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,22 +395,24 @@ final class DataFrameNaFunctions

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31548: [SPARK-34127][SQL] Support table valued command

AmplabJenkins removed a comment on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-777196280 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135109/

[GitHub] [spark] AmplabJenkins commented on pull request #31548: [SPARK-34127][SQL] Support table valued command

AmplabJenkins commented on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-777196280 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135109/

[GitHub] [spark] SparkQA removed a comment on pull request #31548: [SPARK-34127][SQL] Support table valued command

SparkQA removed a comment on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-777186016 **[Test build #135109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135109/testReport)** for PR 31548 at commit

[GitHub] [spark] SparkQA commented on pull request #31548: [SPARK-34127][SQL] Support table valued command

SparkQA commented on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-777189983 **[Test build #135109 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135109/testReport)** for PR 31548 at commit

[GitHub] [spark] imback82 commented on a change in pull request #31494: [SPARK-34380][SQL] Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES for v2 command

imback82 commented on a change in pull request #31494: URL: https://github.com/apache/spark/pull/31494#discussion_r574240206 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTableTests.scala ## @@ -1141,6 +1141,36 @@ trait AlterTableTests extends

[GitHub] [spark] SparkQA commented on pull request #31548: [SPARK-34127][SQL] Support table valued command

SparkQA commented on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-777186016 **[Test build #135109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135109/testReport)** for PR 31548 at commit

[GitHub] [spark] imback82 commented on pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having a dot

imback82 commented on pull request #31545: URL: https://github.com/apache/spark/pull/31545#issuecomment-777185887 cc @cloud-fan @viirya This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] imback82 commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having a dot

imback82 commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574236037 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameNaFunctionsSuite.scala ## @@ -460,4 +460,12 @@ class DataFrameNaFunctionsSuite

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

AmplabJenkins removed a comment on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777182580 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

AmplabJenkins commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777182580 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

SparkQA removed a comment on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777117008 **[Test build #135106 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135106/testReport)** for PR 31547 at commit

[GitHub] [spark] SparkQA commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

SparkQA commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777182008 **[Test build #135106 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135106/testReport)** for PR 31547 at commit

[GitHub] [spark] srowen commented on a change in pull request #31545: [SPARK-34417] org.apache.spark.sql.DataFrameNaFunctions.fillMap(values: Seq[(String, Any)]) fails for column name having a dot

srowen commented on a change in pull request #31545: URL: https://github.com/apache/spark/pull/31545#discussion_r574226018 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala ## @@ -395,22 +395,24 @@ final class DataFrameNaFunctions

[GitHub] [spark] beliefer opened a new pull request #31548: [SPARK-34127][SQL] Support table valued command

beliefer opened a new pull request #31548: URL: https://github.com/apache/spark/pull/31548 ### What changes were proposed in this pull request? Some command used to display some metadata, such as: SHOW TABLES, SHOW TBLPROPERTIES and so no. If the output rows much than screen height,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

AmplabJenkins removed a comment on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777167836 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39689/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

AmplabJenkins removed a comment on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777167835 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39688/

[GitHub] [spark] AmplabJenkins commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

AmplabJenkins commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777167836 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39689/

[GitHub] [spark] AmplabJenkins commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

AmplabJenkins commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777167835 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39688/

[GitHub] [spark] HeartSaVioR edited a comment on pull request #31427: [SPARK-34209][SQL] Delegate table name validation to the session catalog

HeartSaVioR edited a comment on pull request #31427: URL: https://github.com/apache/spark/pull/31427#issuecomment-777141815 Please don't get me wrong. This PR doesn't take any approval from anyone including contributors before merging. I'm also pretty sure most committees folks wait

[GitHub] [spark] HyukjinKwon commented on pull request #31541: Revert "[SPARK-34209][SQL] Delegate table name validation to the session catalog"

HyukjinKwon commented on pull request #31541: URL: https://github.com/apache/spark/pull/31541#issuecomment-777162155 @rdblue and @holdenk If you are against this revert, please file a JIRA and address other people' feedback / opinions with a high priority. Please be diligent on addressing

[GitHub] [spark] SparkQA commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

SparkQA commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777162112 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39688/

[GitHub] [spark] HyukjinKwon closed pull request #31537: [SPARK-34408][PYTHON] Refactor spark.udf.register to share the same path to generate UDF instance

HyukjinKwon closed pull request #31537: URL: https://github.com/apache/spark/pull/31537 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #31537: [SPARK-34408][PYTHON] Refactor spark.udf.register to share the same path to generate UDF instance

HyukjinKwon commented on pull request #31537: URL: https://github.com/apache/spark/pull/31537#issuecomment-777159268 Thanks @ueshin. Merged to master. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon edited a comment on pull request #31541: Revert "[SPARK-34209][SQL] Delegate table name validation to the session catalog"

HyukjinKwon edited a comment on pull request #31541: URL: https://github.com/apache/spark/pull/31541#issuecomment-777155208 @rdblue, sure, I can change the PR description if that looks an issue to you. This is not merged yet so I can change. Can you please answer my question first though?

[GitHub] [spark] SparkQA commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

SparkQA commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777155746 **[Test build #135108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135108/testReport)** for PR 31547 at commit

[GitHub] [spark] SparkQA commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

SparkQA commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777155373 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39689/

[GitHub] [spark] HyukjinKwon commented on pull request #31541: Revert "[SPARK-34209][SQL] Delegate table name validation to the session catalog"

HyukjinKwon commented on pull request #31541: URL: https://github.com/apache/spark/pull/31541#issuecomment-777155208 @rdblue, sure, I can change the PR description if that looks an issue to you. This is not merged yet so I can change. Can you please answer my question first though?

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

AmplabJenkins removed a comment on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-777151356 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135104/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

AmplabJenkins removed a comment on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777151355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135107/

[GitHub] [spark] AmplabJenkins commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

AmplabJenkins commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777151355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135107/

[GitHub] [spark] AmplabJenkins commented on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

AmplabJenkins commented on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-777151356 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135104/

[GitHub] [spark] beliefer commented on pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

beliefer commented on pull request #31316: URL: https://github.com/apache/spark/pull/31316#issuecomment-777147151 ping @cloud-fan This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

SparkQA commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777146801 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39689/

[GitHub] [spark] viirya commented on a change in pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

viirya commented on a change in pull request #31547: URL: https://github.com/apache/spark/pull/31547#discussion_r574195363 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkPlanSuite.scala ## @@ -97,4 +98,13 @@ class SparkPlanSuite extends QueryTest

[GitHub] [spark] SparkQA removed a comment on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

SparkQA removed a comment on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777134675 **[Test build #135107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135107/testReport)** for PR 31349 at commit

[GitHub] [spark] SparkQA commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

SparkQA commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777146366 **[Test build #135107 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135107/testReport)** for PR 31349 at commit

[GitHub] [spark] viirya closed pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

viirya closed pull request #31546: URL: https://github.com/apache/spark/pull/31546 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] viirya commented on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

viirya commented on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-777145283 Thanks. Merging to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR edited a comment on pull request #31427: [SPARK-34209][SQL] Delegate table name validation to the session catalog

HeartSaVioR edited a comment on pull request #31427: URL: https://github.com/apache/spark/pull/31427#issuecomment-777141815 Please don't get me wrong. This PR doesn't take any approval from anyone including contributors before merging. I'm also pretty sure most committees folks wait

[GitHub] [spark] HeartSaVioR commented on pull request #31427: [SPARK-34209][SQL] Delegate table name validation to the session catalog

HeartSaVioR commented on pull request #31427: URL: https://github.com/apache/spark/pull/31427#issuecomment-777141815 Please don't get me wrong. This PR doesn't take any approval from anyone including contributors before merging. I'm also pretty sure most committees folks wait committer's

[GitHub] [spark] SparkQA removed a comment on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

SparkQA removed a comment on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-777009474 **[Test build #135104 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135104/testReport)** for PR 31546 at commit

[GitHub] [spark] SparkQA commented on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

SparkQA commented on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-777141419 **[Test build #135104 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135104/testReport)** for PR 31546 at commit

[GitHub] [spark] github-actions[bot] commented on pull request #30167: [SPARK-33240][SQL][3.0] Fail fast when fails to instantiate configured v2 session catalog

github-actions[bot] commented on pull request #30167: URL: https://github.com/apache/spark/pull/30167#issuecomment-777137909 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] SparkQA commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

SparkQA commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777134675 **[Test build #135107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135107/testReport)** for PR 31349 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.disti

AmplabJenkins removed a comment on pull request #31404: URL: https://github.com/apache/spark/pull/31404#issuecomment-777132747 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135105/

[GitHub] [spark] AmplabJenkins commented on pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

AmplabJenkins commented on pull request #31404: URL: https://github.com/apache/spark/pull/31404#issuecomment-777132747 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135105/

[GitHub] [spark] SparkQA commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

SparkQA commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777132745 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39688/

[GitHub] [spark] maropu commented on a change in pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

maropu commented on a change in pull request #31547: URL: https://github.com/apache/spark/pull/31547#discussion_r574176706 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkPlanSuite.scala ## @@ -97,4 +98,13 @@ class SparkPlanSuite extends QueryTest

[GitHub] [spark] maropu commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

maropu commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-777124731 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

SparkQA removed a comment on pull request #31404: URL: https://github.com/apache/spark/pull/31404#issuecomment-777050475 **[Test build #135105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135105/testReport)** for PR 31404 at commit

[GitHub] [spark] SparkQA commented on pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

SparkQA commented on pull request #31404: URL: https://github.com/apache/spark/pull/31404#issuecomment-777118280 **[Test build #135105 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135105/testReport)** for PR 31404 at commit

[GitHub] [spark] sunchao commented on a change in pull request #29542: [SPARK-32703][SQL] Replace deprecated API calls from SpecificParquetRecordReaderBase

sunchao commented on a change in pull request #29542: URL: https://github.com/apache/spark/pull/29542#discussion_r574167026 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/SpecificParquetRecordReaderBase.java ## @@ -199,12 +151,21 @@

[GitHub] [spark] SparkQA commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

SparkQA commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777117008 **[Test build #135106 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135106/testReport)** for PR 31547 at commit

[GitHub] [spark] sunchao commented on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

sunchao commented on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-77712 @dongjoon-hyun @viirya could you take a look? this is a trivial change. This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.disti

AmplabJenkins removed a comment on pull request #31404: URL: https://github.com/apache/spark/pull/31404#issuecomment-777106007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39687/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

AmplabJenkins removed a comment on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-777106009 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39686/

[GitHub] [spark] AmplabJenkins commented on pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

AmplabJenkins commented on pull request #31404: URL: https://github.com/apache/spark/pull/31404#issuecomment-777106007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39687/

[GitHub] [spark] AmplabJenkins commented on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

AmplabJenkins commented on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-777106009 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39686/

[GitHub] [spark] gerashegalov commented on pull request #31540: [SPARK-20977][CORE] Use a non-final field for the state of CollectionAccumulator

gerashegalov commented on pull request #31540: URL: https://github.com/apache/spark/pull/31540#issuecomment-777098664 Thanks for taking a look @mridulm correct, this patch does not address the problem in general, it just mitigates it for `CollectionAccumulator` and its subclass

[GitHub] [spark] SparkQA commented on pull request #31546: [SPARK-34419][SQL] Move PartitionTransforms.scala to scala directory

SparkQA commented on pull request #31546: URL: https://github.com/apache/spark/pull/31546#issuecomment-777096751 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39686/

[GitHub] [spark] viirya commented on pull request #31547: [SPARK-34420][SQL] Throw exception if non-streaming Deduplicate is not replaced by aggregate

viirya commented on pull request #31547: URL: https://github.com/apache/spark/pull/31547#issuecomment-777085292 cc @maropu @cloud-fan This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] viirya commented on pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

viirya commented on pull request #31404: URL: https://github.com/apache/spark/pull/31404#issuecomment-777085027 Can you also fill missing sections in the PR description? This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct'

SparkQA commented on pull request #31404: URL: https://github.com/apache/spark/pull/31404#issuecomment-777084990 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39687/

  1   2   3   >