[GitHub] [spark] AmplabJenkins commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

AmplabJenkins commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886611367 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46144/ --

[GitHub] [spark] SparkQA commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886605823 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46144/ -- This is an automated message from the

[GitHub] [spark] MaxGekk opened a new pull request #33518: [SPARK-34619][SQL][DOCS] Describe ANSI interval types at the `Data types` page of the SQL reference

MaxGekk opened a new pull request #33518: URL: https://github.com/apache/spark/pull/33518 ### What changes were proposed in this pull request? In the PR, I propose to update the page https://spark.apache.org/docs/latest/sql-ref-datatypes.html and add information about the year-month

[GitHub] [spark] cloud-fan commented on pull request #33489: [SPARK-36269][SQL] Fix only set data columns to Hive column names config

cloud-fan commented on pull request #33489: URL: https://github.com/apache/spark/pull/33489#issuecomment-886591544 thanks, merging to master/3.2/3.1/3.0! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [spark] cloud-fan closed pull request #33489: [SPARK-36269][SQL] Fix only set data columns to Hive column names config

cloud-fan closed pull request #33489: URL: https://github.com/apache/spark/pull/33489 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886590033 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46143/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886588641 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46145/ -- This is an automated message from the

[GitHub] [spark] cloud-fan commented on a change in pull request #33382: [SPARK-36137][SQL] HiveShim should fallback to getAllPartitionsOf even if directSQL is enabled in remote HMS

cloud-fan commented on a change in pull request #33382: URL: https://github.com/apache/spark/pull/33382#discussion_r676488898 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ## @@ -876,29 +876,24 @@ private[client] class Shim_v0_13

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

AmplabJenkins removed a comment on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886578997 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141619/

[GitHub] [spark] AmplabJenkins commented on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

AmplabJenkins commented on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886578997 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141619/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

SparkQA removed a comment on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886446409 **[Test build #141619 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141619/testReport)** for PR 33488 at commit

[GitHub] [spark] SparkQA commented on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

SparkQA commented on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886578418 **[Test build #141619 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141619/testReport)** for PR 33488 at commit

[GitHub] [spark] linhongliu-db commented on a change in pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

linhongliu-db commented on a change in pull request #33490: URL: https://github.com/apache/spark/pull/33490#discussion_r676294216 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala ## @@ -289,6 +290,11 @@ class

[GitHub] [spark] linhongliu-db commented on a change in pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

linhongliu-db commented on a change in pull request #33490: URL: https://github.com/apache/spark/pull/33490#discussion_r676294216 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala ## @@ -289,6 +290,11 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

AmplabJenkins removed a comment on pull request #33490: URL: https://github.com/apache/spark/pull/33490#issuecomment-886573082 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46146/

[GitHub] [spark] SparkQA commented on pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

SparkQA commented on pull request #33490: URL: https://github.com/apache/spark/pull/33490#issuecomment-886573046 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46146/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

AmplabJenkins commented on pull request #33490: URL: https://github.com/apache/spark/pull/33490#issuecomment-886573082 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46146/ --

[GitHub] [spark] SparkQA commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886571502 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46144/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

AmplabJenkins removed a comment on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886569731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33516: [SPARK-34249][DOCS] Add documentation for ANSI implicit cast rules

AmplabJenkins removed a comment on pull request #33516: URL: https://github.com/apache/spark/pull/33516#issuecomment-886569734 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46138/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

AmplabJenkins removed a comment on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886569730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33516: [SPARK-34249][DOCS] Add documentation for ANSI implicit cast rules

AmplabJenkins commented on pull request #33516: URL: https://github.com/apache/spark/pull/33516#issuecomment-886569734 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46138/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

AmplabJenkins commented on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886569730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

AmplabJenkins commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886569732 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] SparkQA commented on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

SparkQA commented on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886567563 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46141/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886566782 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46143/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886564545 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46145/ -- This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #33404: [SPARK-36194][SQL] Remove the aggregation from left semi/anti join if the same aggregation has already been done on left side

cloud-fan commented on a change in pull request #33404: URL: https://github.com/apache/spark/pull/33404#discussion_r676469338 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/DistinctAttributesVisitor.scala ## @@ -0,0 +1,87 @@ +/* + *

[GitHub] [spark] cloud-fan commented on pull request #33310: [SPARK-36105][SQL] OptimizeLocalShuffleReader support reading data of multiple mappers in one task

cloud-fan commented on pull request #33310: URL: https://github.com/apache/spark/pull/33310#issuecomment-886555280 thanks, merging to master/3.2 (since AQE is turned on by default in 3.2) -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] cloud-fan closed pull request #33310: [SPARK-36105][SQL] OptimizeLocalShuffleReader support reading data of multiple mappers in one task

cloud-fan closed pull request #33310: URL: https://github.com/apache/spark/pull/33310 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #33516: [SPARK-34249][DOCS] Add documentation for ANSI implicit cast rules

SparkQA commented on pull request #33516: URL: https://github.com/apache/spark/pull/33516#issuecomment-886553418 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46138/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

SparkQA commented on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886552558 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46140/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886546510 **[Test build #141629 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141629/testReport)** for PR 33364 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA removed a comment on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886533682 **[Test build #141629 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141629/testReport)** for PR 33364 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA removed a comment on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886530969 **[Test build #141627 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141627/testReport)** for PR 33364 at commit

[GitHub] [spark] SparkQA commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886543634 **[Test build #141627 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141627/testReport)** for PR 33364 at commit

[GitHub] [spark] SparkQA commented on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

SparkQA commented on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886542614 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46141/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

AmplabJenkins removed a comment on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886539801 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46139/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33340: [SPARK-36266][SHUFFLE] Rename classes in shuffle RPC used for block push operations

AmplabJenkins removed a comment on pull request #33340: URL: https://github.com/apache/spark/pull/33340#issuecomment-886540204 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141618/

[GitHub] [spark] AmplabJenkins commented on pull request #33340: [SPARK-36266][SHUFFLE] Rename classes in shuffle RPC used for block push operations

AmplabJenkins commented on pull request #33340: URL: https://github.com/apache/spark/pull/33340#issuecomment-886540204 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141618/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33340: [SPARK-36266][SHUFFLE] Rename classes in shuffle RPC used for block push operations

SparkQA removed a comment on pull request #33340: URL: https://github.com/apache/spark/pull/33340#issuecomment-886444248 **[Test build #141618 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141618/testReport)** for PR 33340 at commit

[GitHub] [spark] SparkQA commented on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

SparkQA commented on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886539764 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46139/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

AmplabJenkins commented on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886539801 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46139/ --

[GitHub] [spark] SparkQA commented on pull request #33340: [SPARK-36266][SHUFFLE] Rename classes in shuffle RPC used for block push operations

SparkQA commented on pull request #33340: URL: https://github.com/apache/spark/pull/33340#issuecomment-886539498 **[Test build #141618 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141618/testReport)** for PR 33340 at commit

[GitHub] [spark] SparkQA commented on pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

SparkQA commented on pull request #33490: URL: https://github.com/apache/spark/pull/33490#issuecomment-886536073 **[Test build #141630 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141630/testReport)** for PR 33490 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33517: [SPARK-36287] adding TimestampNTZType

AmplabJenkins removed a comment on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886534367 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141628/

[GitHub] [spark] SparkQA removed a comment on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA removed a comment on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886533481 **[Test build #141628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141628/testReport)** for PR 33517 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

AmplabJenkins commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886534367 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141628/ -- This

[GitHub] [spark] SparkQA commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886534332 **[Test build #141628 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141628/testReport)** for PR 33517 at commit

[GitHub] [spark] SparkQA commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886533682 **[Test build #141629 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141629/testReport)** for PR 33364 at commit

[GitHub] [spark] SparkQA commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886533481 **[Test build #141628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141628/testReport)** for PR 33517 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

cloud-fan commented on a change in pull request #33200: URL: https://github.com/apache/spark/pull/33200#discussion_r676435402 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -3574,16 +3568,67 @@ class Analyzer(override val

[GitHub] [spark] SparkQA commented on pull request #33364: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

SparkQA commented on pull request #33364: URL: https://github.com/apache/spark/pull/33364#issuecomment-886530969 **[Test build #141627 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141627/testReport)** for PR 33364 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33517: [SPARK-36287] adding TimestampNTZType

AmplabJenkins removed a comment on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886529486 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46142/

[GitHub] [spark] AmplabJenkins commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

AmplabJenkins commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886529486 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46142/ --

[GitHub] [spark] SparkQA commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886529455 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46142/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

AmplabJenkins removed a comment on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886528600 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46134/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33340: [SPARK-36266][SHUFFLE] Rename classes in shuffle RPC used for block push operations

AmplabJenkins removed a comment on pull request #33340: URL: https://github.com/apache/spark/pull/33340#issuecomment-886528599 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46136/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

AmplabJenkins removed a comment on pull request #33490: URL: https://github.com/apache/spark/pull/33490#issuecomment-886528602 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46133/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

AmplabJenkins removed a comment on pull request #32332: URL: https://github.com/apache/spark/pull/32332#issuecomment-886528598 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141624/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33484: [SPARK-36263][SQL][PYTHON] Add Dataframe.observation to PySpark

AmplabJenkins removed a comment on pull request #33484: URL: https://github.com/apache/spark/pull/33484#issuecomment-886528605 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141615/

[GitHub] [spark] AmplabJenkins commented on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

AmplabJenkins commented on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886528600 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46134/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

AmplabJenkins commented on pull request #33490: URL: https://github.com/apache/spark/pull/33490#issuecomment-886528602 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46133/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

AmplabJenkins commented on pull request #32332: URL: https://github.com/apache/spark/pull/32332#issuecomment-886528598 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141624/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33484: [SPARK-36263][SQL][PYTHON] Add Dataframe.observation to PySpark

AmplabJenkins commented on pull request #33484: URL: https://github.com/apache/spark/pull/33484#issuecomment-886528605 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141615/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33340: [SPARK-36266][SHUFFLE] Rename classes in shuffle RPC used for block push operations

AmplabJenkins commented on pull request #33340: URL: https://github.com/apache/spark/pull/33340#issuecomment-886528599 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46136/ --

[GitHub] [spark] SparkQA removed a comment on pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

SparkQA removed a comment on pull request #32332: URL: https://github.com/apache/spark/pull/32332#issuecomment-886486023 **[Test build #141624 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141624/testReport)** for PR 32332 at commit

[GitHub] [spark] SparkQA commented on pull request #33516: [SPARK-34249][DOCS] Add documentation for ANSI implicit cast rules

SparkQA commented on pull request #33516: URL: https://github.com/apache/spark/pull/33516#issuecomment-886516942 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46138/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

SparkQA commented on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886515707 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46140/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33340: [SPARK-36266][SHUFFLE] Rename classes in shuffle RPC used for block push operations

SparkQA commented on pull request #33340: URL: https://github.com/apache/spark/pull/33340#issuecomment-886514074 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46136/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

SparkQA commented on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886513648 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46139/ -- This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

cloud-fan commented on a change in pull request #33200: URL: https://github.com/apache/spark/pull/33200#discussion_r676414064 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -3574,16 +3568,67 @@ class Analyzer(override val

[GitHub] [spark] cloud-fan commented on a change in pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

cloud-fan commented on a change in pull request #33200: URL: https://github.com/apache/spark/pull/33200#discussion_r676413397 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -1099,21 +1066,84 @@ case class

[GitHub] [spark] SparkQA commented on pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

SparkQA commented on pull request #32332: URL: https://github.com/apache/spark/pull/32332#issuecomment-886507746 **[Test build #141624 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141624/testReport)** for PR 32332 at commit

[GitHub] [spark] beliefer edited a comment on pull request #33413: [SPARK-36175][SQL] Support TimestampNTZ in Avro data source

beliefer edited a comment on pull request #33413: URL: https://github.com/apache/spark/pull/33413#issuecomment-886479766 @gengliangwang Spark3.1 will reading `TimestampNTZ` as `Long`.

[GitHub] [spark] SparkQA commented on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

SparkQA commented on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886498471 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46134/ -- This is an automated message from the

[GitHub] [spark] darcy-shen edited a comment on pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

darcy-shen edited a comment on pull request #32332: URL: https://github.com/apache/spark/pull/32332#issuecomment-886497761 Sorry for the late response. Review comments are replied now. And also, I improved the performance by removing the extra identity function (`prepare`) call. --

[GitHub] [spark] darcy-shen commented on pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

darcy-shen commented on pull request #32332: URL: https://github.com/apache/spark/pull/32332#issuecomment-886497761 Sorry for the late response. Review comments are replied now. And also, I improved the performance by removing the extra identity function call. -- This is an automated

[GitHub] [spark] SparkQA removed a comment on pull request #33484: [SPARK-36263][SQL][PYTHON] Add Dataframe.observation to PySpark

SparkQA removed a comment on pull request #33484: URL: https://github.com/apache/spark/pull/33484#issuecomment-886416314 **[Test build #141615 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141615/testReport)** for PR 33484 at commit

[GitHub] [spark] Ngone51 commented on a change in pull request #33451: [SPARK-36206][CORE] Support shuffle data corruption diagnosis via shuffle checksum

Ngone51 commented on a change in pull request #33451: URL: https://github.com/apache/spark/pull/33451#discussion_r676402046 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/checksum/ShuffleCorruptionDiagnosisHelper.java ## @@ -0,0 +1,142 @@

[GitHub] [spark] SparkQA commented on pull request #33490: [SPARK-36286][SQL] Block some invalid datetime string

SparkQA commented on pull request #33490: URL: https://github.com/apache/spark/pull/33490#issuecomment-886496984 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46133/ -- This is an automated message from the

[GitHub] [spark] darcy-shen commented on a change in pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

darcy-shen commented on a change in pull request #32332: URL: https://github.com/apache/spark/pull/32332#discussion_r676401500 ## File path: python/pyspark/sql/session.py ## @@ -478,13 +478,22 @@ def _inferSchema(self, rdd, samplingRatio=None, names=None): schema

[GitHub] [spark] SparkQA commented on pull request #33484: [SPARK-36263][SQL][PYTHON] Add Dataframe.observation to PySpark

SparkQA commented on pull request #33484: URL: https://github.com/apache/spark/pull/33484#issuecomment-886496530 **[Test build #141615 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141615/testReport)** for PR 33484 at commit

[GitHub] [spark] darcy-shen commented on a change in pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

darcy-shen commented on a change in pull request #32332: URL: https://github.com/apache/spark/pull/32332#discussion_r676400183 ## File path: python/pyspark/sql/session.py ## @@ -695,9 +704,10 @@ def prepare(obj): prepare = lambda obj: obj Review comment: >

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33517: [SPARK-36287] adding TimestampNTZType

AmplabJenkins removed a comment on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886494793 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141626/

[GitHub] [spark] SparkQA removed a comment on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA removed a comment on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886493738 **[Test build #141626 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141626/testReport)** for PR 33517 at commit

[GitHub] [spark] darcy-shen commented on a change in pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

darcy-shen commented on a change in pull request #32332: URL: https://github.com/apache/spark/pull/32332#discussion_r676400183 ## File path: python/pyspark/sql/session.py ## @@ -695,9 +704,10 @@ def prepare(obj): prepare = lambda obj: obj Review comment: >

[GitHub] [spark] AmplabJenkins commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

AmplabJenkins commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886494793 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141626/ -- This

[GitHub] [spark] SparkQA commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886494773 **[Test build #141626 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141626/testReport)** for PR 33517 at commit

[GitHub] [spark] Ngone51 commented on a change in pull request #33451: [SPARK-36206][CORE] Support shuffle data corruption diagnosis via shuffle checksum

Ngone51 commented on a change in pull request #33451: URL: https://github.com/apache/spark/pull/33451#discussion_r676399803 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java ## @@ -374,6 +376,32 @@ public int

[GitHub] [spark] SparkQA commented on pull request #33517: [SPARK-36287] adding TimestampNTZType

SparkQA commented on pull request #33517: URL: https://github.com/apache/spark/pull/33517#issuecomment-886493738 **[Test build #141626 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141626/testReport)** for PR 33517 at commit

[GitHub] [spark] viirya commented on a change in pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

viirya commented on a change in pull request #33352: URL: https://github.com/apache/spark/pull/33352#discussion_r676397731 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/SupportsPushDownAggregates.java ## @@ -0,0 +1,56 @@ +/* + * Licensed to the

[GitHub] [spark] SparkQA removed a comment on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

SparkQA removed a comment on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886490821 **[Test build #141625 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141625/testReport)** for PR 33482 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

AmplabJenkins removed a comment on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886491959 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141625/

[GitHub] [spark] AmplabJenkins commented on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

AmplabJenkins commented on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886491959 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141625/ -- This

[GitHub] [spark] SparkQA commented on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

SparkQA commented on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886491927 **[Test build #141625 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141625/testReport)** for PR 33482 at commit

[GitHub] [spark] SparkQA commented on pull request #33482: [SPARK-36259] Expose localtimestamp in pyspark.sql.functions

SparkQA commented on pull request #33482: URL: https://github.com/apache/spark/pull/33482#issuecomment-886490821 **[Test build #141625 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141625/testReport)** for PR 33482 at commit

[GitHub] [spark] dominikgehl opened a new pull request #33517: [SPARK-36287] adding TimestampNTZType

dominikgehl opened a new pull request #33517: URL: https://github.com/apache/spark/pull/33517 ### What changes were proposed in this pull request? new TimestampNTZType in pyspark ### Why are the changes needed? getting up to date with scala types ### Does

[GitHub] [spark] Ngone51 commented on a change in pull request #33451: [SPARK-36206][CORE] Support shuffle data corruption diagnosis via shuffle checksum

Ngone51 commented on a change in pull request #33451: URL: https://github.com/apache/spark/pull/33451#discussion_r676395446 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/checksum/ShuffleCorruptionDiagnosisHelper.java ## @@ -0,0 +1,142 @@

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33488: [SPARK-36241][SQL] Support creating tables with void column

AmplabJenkins removed a comment on pull request #33488: URL: https://github.com/apache/spark/pull/33488#issuecomment-886489451 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46137/

<    3   4   5   6   7   8   9   >