[GitHub] [spark] HyukjinKwon commented on a change in pull request #33212: [SPARK-35912][SQL] Fix nullability of `spark.read.json`

HyukjinKwon commented on a change in pull request #33212: URL: https://github.com/apache/spark/pull/33212#discussion_r664431573 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala ## @@ -2924,6 +2924,50 @@ abstract class

[GitHub] [spark] SparkQA commented on pull request #33187: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

SparkQA commented on pull request #33187: URL: https://github.com/apache/spark/pull/33187#issuecomment-874643532 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45208/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33212: [SPARK-35912][SQL] Fix nullability of `spark.read.json`

HyukjinKwon commented on a change in pull request #33212: URL: https://github.com/apache/spark/pull/33212#discussion_r664430269 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala ## @@ -404,6 +407,19 @@ class JacksonParser(

[GitHub] [spark] SparkQA commented on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

SparkQA commented on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874642518 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45206/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

SparkQA commented on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874642421 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45207/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33225: [SPARK-35983][SQL] Allow from_json/to_json for map types where value types are day-time intervals

AmplabJenkins removed a comment on pull request #33225: URL: https://github.com/apache/spark/pull/33225#issuecomment-874638102 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140682/

[GitHub] [spark] SparkQA removed a comment on pull request #33225: [SPARK-35983][SQL] Allow from_json/to_json for map types where value types are day-time intervals

SparkQA removed a comment on pull request #33225: URL: https://github.com/apache/spark/pull/33225#issuecomment-874483254 **[Test build #140682 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140682/testReport)** for PR 33225 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33225: [SPARK-35983][SQL] Allow from_json/to_json for map types where value types are day-time intervals

AmplabJenkins commented on pull request #33225: URL: https://github.com/apache/spark/pull/33225#issuecomment-874638102 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140682/ -- This

[GitHub] [spark] SparkQA commented on pull request #33225: [SPARK-35983][SQL] Allow from_json/to_json for map types where value types are day-time intervals

SparkQA commented on pull request #33225: URL: https://github.com/apache/spark/pull/33225#issuecomment-874636762 **[Test build #140682 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140682/testReport)** for PR 33225 at commit

[GitHub] [spark] SparkQA commented on pull request #33182: [SPARK-35984][SQL] Config to force applying shuffled hash join

SparkQA commented on pull request #33182: URL: https://github.com/apache/spark/pull/33182#issuecomment-874634979 **[Test build #140701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140701/testReport)** for PR 33182 at commit

[GitHub] [spark] SparkQA commented on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

SparkQA commented on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874630005 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45209/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33222: [SPARK-36020][SQL] Check logical link in remove redundant projects

AmplabJenkins removed a comment on pull request #33222: URL: https://github.com/apache/spark/pull/33222#issuecomment-874628218 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140687/

[GitHub] [spark] AmplabJenkins commented on pull request #33222: [SPARK-36020][SQL] Check logical link in remove redundant projects

AmplabJenkins commented on pull request #33222: URL: https://github.com/apache/spark/pull/33222#issuecomment-874628218 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140687/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

AmplabJenkins removed a comment on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-874627933 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140700/

[GitHub] [spark] SparkQA removed a comment on pull request #33222: [SPARK-36020][SQL] Check logical link in remove redundant projects

SparkQA removed a comment on pull request #33222: URL: https://github.com/apache/spark/pull/33222#issuecomment-874511164 **[Test build #140687 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140687/testReport)** for PR 33222 at commit

[GitHub] [spark] SparkQA commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

SparkQA commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-874627905 **[Test build #140700 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140700/testReport)** for PR 32401 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

SparkQA removed a comment on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-874627515 **[Test build #140700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140700/testReport)** for PR 32401 at commit

[GitHub] [spark] SparkQA commented on pull request #33222: [SPARK-36020][SQL] Check logical link in remove redundant projects

SparkQA commented on pull request #33222: URL: https://github.com/apache/spark/pull/33222#issuecomment-874627508 **[Test build #140687 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140687/testReport)** for PR 33222 at commit

[GitHub] [spark] SparkQA commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

SparkQA commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-874627515 **[Test build #140700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140700/testReport)** for PR 32401 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

AmplabJenkins commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-874627933 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140700/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33187: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

AmplabJenkins commented on pull request #33187: URL: https://github.com/apache/spark/pull/33187#issuecomment-874627231 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140685/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33187: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

AmplabJenkins removed a comment on pull request #33187: URL: https://github.com/apache/spark/pull/33187#issuecomment-874627231 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140685/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874626432 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45205/

[GitHub] [spark] SparkQA commented on pull request #33229: [SPARK-36025][SQL][TESTS] Reduce the run time of DateExpressionsSuite

SparkQA commented on pull request #33229: URL: https://github.com/apache/spark/pull/33229#issuecomment-874626885 **[Test build #140699 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140699/testReport)** for PR 33229 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33187: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

SparkQA removed a comment on pull request #33187: URL: https://github.com/apache/spark/pull/33187#issuecomment-874490690 **[Test build #140685 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140685/testReport)** for PR 33187 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874626432 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45205/ --

[GitHub] [spark] SparkQA commented on pull request #33187: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

SparkQA commented on pull request #33187: URL: https://github.com/apache/spark/pull/33187#issuecomment-874626176 **[Test build #140685 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140685/testReport)** for PR 33187 at commit

[GitHub] [spark] SparkQA commented on pull request #33187: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

SparkQA commented on pull request #33187: URL: https://github.com/apache/spark/pull/33187#issuecomment-874623325 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45208/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

SparkQA commented on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874621482 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45207/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

SparkQA commented on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874621008 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45206/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874618236 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45205/ -- This is an automated message from the

[GitHub] [spark] gengliangwang commented on a change in pull request #33229: [SPARK-36025][SQL][TESTS] Reduce the run time of DateExpressionsSuite

gengliangwang commented on a change in pull request #33229: URL: https://github.com/apache/spark/pull/33229#discussion_r664400203 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeTestUtils.scala ## @@ -54,6 +55,13 @@ object

[GitHub] [spark] cloud-fan closed pull request #33226: [SPARK-35999][SQL] Make from_csv/to_csv to handle day-time intervals properly

cloud-fan closed pull request #33226: URL: https://github.com/apache/spark/pull/33226 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] cloud-fan commented on pull request #33226: [SPARK-35999][SQL] Make from_csv/to_csv to handle day-time intervals properly

cloud-fan commented on pull request #33226: URL: https://github.com/apache/spark/pull/33226#issuecomment-874614117 thanks, merging to master/3.2! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] cloud-fan commented on a change in pull request #33175: [SPARK-35973][SQL] DataSourceV2: Support SHOW CATALOGS

cloud-fan commented on a change in pull request #33175: URL: https://github.com/apache/spark/pull/33175#discussion_r664398787 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -662,6 +662,14 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #33229: [SPARK-36025][SQL][TESTS] Reduce the run time of DateExpressionsSuite

cloud-fan commented on a change in pull request #33229: URL: https://github.com/apache/spark/pull/33229#discussion_r664397897 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeTestUtils.scala ## @@ -54,6 +55,13 @@ object DateTimeTestUtils {

[GitHub] [spark] gengliangwang opened a new pull request #33229: [SPARK-36025][SQL][TESTS] Reduce the run time of DateExpressionsSuite

gengliangwang opened a new pull request #33229: URL: https://github.com/apache/spark/pull/33229 ### What changes were proposed in this pull request? Some of the test cases in `DateExpressionsSuite` are quite slow: - `Hour`: 24s - `Minute`: 26s - `Day /

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33227: [SPARK-35972][SQL][3.1] When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

AmplabJenkins removed a comment on pull request #33227: URL: https://github.com/apache/spark/pull/33227#issuecomment-874600241 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45203/

[GitHub] [spark] AmplabJenkins commented on pull request #33227: [SPARK-35972][SQL][3.1] When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

AmplabJenkins commented on pull request #33227: URL: https://github.com/apache/spark/pull/33227#issuecomment-874600241 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45203/ --

[GitHub] [spark] SparkQA commented on pull request #33227: [SPARK-35972][SQL][3.1] When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

SparkQA commented on pull request #33227: URL: https://github.com/apache/spark/pull/33227#issuecomment-874600205 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45203/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

SparkQA commented on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874598517 **[Test build #140698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140698/testReport)** for PR 33217 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

AngersZh commented on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874596828 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874593344 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45205/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

SparkQA removed a comment on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874586653 **[Test build #140696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140696/testReport)** for PR 33217 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

AmplabJenkins removed a comment on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874590953 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140696/

[GitHub] [spark] AmplabJenkins commented on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

AmplabJenkins commented on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874590953 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140696/ -- This

[GitHub] [spark] SparkQA commented on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

SparkQA commented on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874590903 **[Test build #140696 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140696/testReport)** for PR 33217 at commit

[GitHub] [spark] Peng-Lei commented on a change in pull request #33175: [SPARK-35973][SQL] DataSourceV2: Support SHOW CATALOGS

Peng-Lei commented on a change in pull request #33175: URL: https://github.com/apache/spark/pull/33175#discussion_r664372808 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -662,6 +662,14 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #33182: [SPARK-35984][SQL] Config to force applying shuffled hash join

cloud-fan commented on a change in pull request #33182: URL: https://github.com/apache/spark/pull/33182#discussion_r66436 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -419,6 +419,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

AmplabJenkins removed a comment on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874554400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33214: [SPARK-35929][PYTHON] Support to infer nested dict as a struct when creating a DataFrame

AmplabJenkins removed a comment on pull request #33214: URL: https://github.com/apache/spark/pull/33214#issuecomment-874586141 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #33187: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

SparkQA commented on pull request #33187: URL: https://github.com/apache/spark/pull/33187#issuecomment-874586692 **[Test build #140697 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140697/testReport)** for PR 33187 at commit

[GitHub] [spark] SparkQA commented on pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

SparkQA commented on pull request #33217: URL: https://github.com/apache/spark/pull/33217#issuecomment-874586653 **[Test build #140696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140696/testReport)** for PR 33217 at commit

[GitHub] [spark] SparkQA commented on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

SparkQA commented on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874586655 **[Test build #140695 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140695/testReport)** for PR 33220 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToHiveString for keep consistent between hive/spark format in df.show

AmplabJenkins removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-874586144 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45201/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874586138 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140679/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33222: [SPARK-36020][SQL] Check logical link in remove redundant projects

AmplabJenkins removed a comment on pull request #33222: URL: https://github.com/apache/spark/pull/33222#issuecomment-874586142 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45197/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33226: [SPARK-35999][SQL] Make from_csv/to_csv to handle day-time intervals properly

AmplabJenkins removed a comment on pull request #33226: URL: https://github.com/apache/spark/pull/33226#issuecomment-874586150 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45196/

[GitHub] [spark] AmplabJenkins commented on pull request #32365: [SPARK-35228][SQL] Add expression ToHiveString for keep consistent between hive/spark format in df.show

AmplabJenkins commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-874586144 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45201/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33214: [SPARK-35929][PYTHON] Support to infer nested dict as a struct when creating a DataFrame

AmplabJenkins commented on pull request #33214: URL: https://github.com/apache/spark/pull/33214#issuecomment-874586141 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #33226: [SPARK-35999][SQL] Make from_csv/to_csv to handle day-time intervals properly

AmplabJenkins commented on pull request #33226: URL: https://github.com/apache/spark/pull/33226#issuecomment-874586150 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45196/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33222: [SPARK-36020][SQL] Check logical link in remove redundant projects

AmplabJenkins commented on pull request #33222: URL: https://github.com/apache/spark/pull/33222#issuecomment-874586142 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45197/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874586138 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140679/ -- This

[GitHub] [spark] cloud-fan commented on a change in pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

cloud-fan commented on a change in pull request #32959: URL: https://github.com/apache/spark/pull/32959#discussion_r664364274 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/AnsiCastSuiteBase.scala ## @@ -392,8 +391,6 @@ abstract class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

AngersZh commented on a change in pull request #33217: URL: https://github.com/apache/spark/pull/33217#discussion_r664361217 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuiteBase.scala ## @@ -1249,7 +1257,12 @@ abstract class

[GitHub] [spark] xuanyuanking commented on a change in pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

xuanyuanking commented on a change in pull request #33220: URL: https://github.com/apache/spark/pull/33220#discussion_r664360253 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/RocksDBSuite.scala ## @@ -337,12 +338,12 @@ class RocksDBSuite

[GitHub] [spark] HyukjinKwon commented on pull request #33228: Update README.md

HyukjinKwon commented on pull request #33228: URL: https://github.com/apache/spark/pull/33228#issuecomment-874577924 @drakelam, please read also https://spark.apache.org/contributing.html -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33228: Update README.md

HyukjinKwon commented on a change in pull request #33228: URL: https://github.com/apache/spark/pull/33228#discussion_r664358710 ## File path: README.md ## @@ -21,6 +21,8 @@ You can find the latest Spark documentation, including a programming guide, on the [project web

[GitHub] [spark] SparkQA commented on pull request #33227: [SPARK-35972][SQL][3.1] When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

SparkQA commented on pull request #33227: URL: https://github.com/apache/spark/pull/33227#issuecomment-874576364 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45203/ -- This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #33191: [SPARK-35985][SQL] push partitionFilters for empty readDataSchema

cloud-fan commented on a change in pull request #33191: URL: https://github.com/apache/spark/pull/33191#discussion_r664352501 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PruneFileSourcePartitions.scala ## @@ -120,7 +120,7 @@ private[sql]

[GitHub] [spark] SparkQA commented on pull request #33214: [SPARK-35929][PYTHON] Support to infer nested dict as a struct when creating a DataFrame

SparkQA commented on pull request #33214: URL: https://github.com/apache/spark/pull/33214#issuecomment-874572122 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45202/ -- This is an automated message from the

[GitHub] [spark] cloud-fan commented on a change in pull request #33175: [SPARK-35973][SQL] DataSourceV2: Support SHOW CATALOGS

cloud-fan commented on a change in pull request #33175: URL: https://github.com/apache/spark/pull/33175#discussion_r664350699 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogManager.scala ## @@ -128,6 +128,10 @@ class CatalogManager(

[GitHub] [spark] cloud-fan commented on a change in pull request #33175: [SPARK-35973][SQL] DataSourceV2: Support SHOW CATALOGS

cloud-fan commented on a change in pull request #33175: URL: https://github.com/apache/spark/pull/33175#discussion_r664348918 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -662,6 +662,14 @@ case class

[GitHub] [spark] SparkQA commented on pull request #33226: [SPARK-35999][SQL] Make from_csv/to_csv to handle day-time intervals properly

SparkQA commented on pull request #33226: URL: https://github.com/apache/spark/pull/33226#issuecomment-874566612 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45196/ -- This is an automated message from the

[GitHub] [spark] linhongliu-db commented on a change in pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

linhongliu-db commented on a change in pull request #32959: URL: https://github.com/apache/spark/pull/32959#discussion_r664343346 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala ## @@ -224,12 +224,12 @@ object DateTimeUtils {

[GitHub] [spark] SparkQA commented on pull request #33222: [SPARK-36020][SQL] Check logical link in remove redundant projects

SparkQA commented on pull request #33222: URL: https://github.com/apache/spark/pull/33222#issuecomment-874563604 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45197/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on pull request #33214: [SPARK-35929][PYTHON] Support to infer nested dict as a struct when creating a DataFrame

HyukjinKwon commented on pull request #33214: URL: https://github.com/apache/spark/pull/33214#issuecomment-874563263 Can you also update the PR description? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33214: [SPARK-35929][PYTHON] Schema inference of nested structs defaults to map

HyukjinKwon commented on a change in pull request #33214: URL: https://github.com/apache/spark/pull/33214#discussion_r664341267 ## File path: python/pyspark/sql/tests/test_types.py ## @@ -204,6 +204,16 @@ def test_infer_nested_schema(self): df =

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33214: [SPARK-35929][PYTHON] Schema inference of nested structs defaults to map

HyukjinKwon commented on a change in pull request #33214: URL: https://github.com/apache/spark/pull/33214#discussion_r664340686 ## File path: python/pyspark/sql/tests/test_types.py ## @@ -204,6 +204,16 @@ def test_infer_nested_schema(self): df =

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33214: [SPARK-35929][PYTHON] Schema inference of nested structs defaults to map

HyukjinKwon commented on a change in pull request #33214: URL: https://github.com/apache/spark/pull/33214#discussion_r664340198 ## File path: python/pyspark/sql/tests/test_types.py ## @@ -204,6 +204,16 @@ def test_infer_nested_schema(self): df =

[GitHub] [spark] SparkQA removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874440343 **[Test build #140679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140679/testReport)** for PR 32959 at commit

[GitHub] [spark] SparkQA commented on pull request #33214: [SPARK-35929][PYTHON] Schema inference of nested structs defaults to map

SparkQA commented on pull request #33214: URL: https://github.com/apache/spark/pull/33214#issuecomment-874561072 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45199/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33214: [SPARK-35929][PYTHON] Schema inference of nested structs defaults to map

HyukjinKwon commented on a change in pull request #33214: URL: https://github.com/apache/spark/pull/33214#discussion_r664339360 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -3327,6 +3327,12 @@ object SQLConf { .intConf

[GitHub] [spark] SparkQA commented on pull request #32365: [SPARK-35228][SQL] Add expression ToHiveString for keep consistent between hive/spark format in df.show

SparkQA commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-874560662 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45201/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874560612 **[Test build #140679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140679/testReport)** for PR 32959 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

SparkQA removed a comment on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874548430 **[Test build #140693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140693/testReport)** for PR 33220 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33228: Update README.md

AmplabJenkins commented on pull request #33228: URL: https://github.com/apache/spark/pull/33228#issuecomment-874556258 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] MaxGekk commented on a change in pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

MaxGekk commented on a change in pull request #33217: URL: https://github.com/apache/spark/pull/33217#discussion_r664334657 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuiteBase.scala ## @@ -1267,7 +1280,12 @@ abstract class

[GitHub] [spark] MaxGekk commented on a change in pull request #33217: [SPARK-36023][SPARK-35735][SPARK-35768][SQL] Refactor code about parse string to DT/YM

MaxGekk commented on a change in pull request #33217: URL: https://github.com/apache/spark/pull/33217#discussion_r664334418 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuiteBase.scala ## @@ -1249,7 +1257,12 @@ abstract class

[GitHub] [spark] SparkQA commented on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

SparkQA commented on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874555418 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45204/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

AmplabJenkins commented on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874555444 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45204/ --

[GitHub] [spark] drakelam opened a new pull request #33228: Update README.md

drakelam opened a new pull request #33228: URL: https://github.com/apache/spark/pull/33228 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How

[GitHub] [spark] AmplabJenkins commented on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

AmplabJenkins commented on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874554400 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140693/ -- This

[GitHub] [spark] SparkQA commented on pull request #33220: [WIP][SPARK-35993][TESTS] Fix flaky tests for RocksDBSuite

SparkQA commented on pull request #33220: URL: https://github.com/apache/spark/pull/33220#issuecomment-874554361 **[Test build #140693 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140693/testReport)** for PR 33220 at commit

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-874554144 **[Test build #140694 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140694/testReport)** for PR 32959 at commit

[GitHub] [spark] MaxGekk closed pull request #33225: [SPARK-35983][SQL] Allow from_json/to_json for map types where value types are day-time intervals

MaxGekk closed pull request #33225: URL: https://github.com/apache/spark/pull/33225 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] MaxGekk commented on pull request #33132: [SPARK-35926][SQL] Add support YearMonthIntervalType for width_bucket

MaxGekk commented on pull request #33132: URL: https://github.com/apache/spark/pull/33132#issuecomment-874550183 > Firstly, ... Secondly, ... Finally, ... Thank you for the explanation. Could you add the text to the section `Why are the changes needed?` in PR's description. --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToHiveString for keep consistent between hive/spark format in df.show

AmplabJenkins removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-874549078 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140690/

[GitHub] [spark] AmplabJenkins commented on pull request #32365: [SPARK-35228][SQL] Add expression ToHiveString for keep consistent between hive/spark format in df.show

AmplabJenkins commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-874549078 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140690/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToHiveString for keep consistent between hive/spark format in df.show

SparkQA removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-874511705 **[Test build #140690 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140690/testReport)** for PR 32365 at commit

<    3   4   5   6   7   8   9   10   >