[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872122488 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45014/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872054929 **[Test build #140506 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140506/testReport)** for PR 33172 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-872126870 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45018/

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872134238 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45016/ -- This is an automated message from the Apache

[GitHub] [spark] rahulsmahadev commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

rahulsmahadev commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662188462 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1243,6 +1244,214 @@ class

[GitHub] [spark] SparkQA commented on pull request #33058: [SPARK-35874][SQL] AQE Shuffle should wait for its subqueries to finish before materializing

SparkQA commented on pull request #33058: URL: https://github.com/apache/spark/pull/33058#issuecomment-872132107 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45015/ --

[GitHub] [spark] yaooqinn commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

yaooqinn commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872137865 cc @dongjoon-hyun @holdenk thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

HyukjinKwon commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662170842 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private()

[GitHub] [spark] yaooqinn commented on pull request #33169: [SPARK-35966][SQL] Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

yaooqinn commented on pull request #33169: URL: https://github.com/apache/spark/pull/33169#issuecomment-872118669 thank you all for the review, merged to master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] yaooqinn closed pull request #33169: [SPARK-35966][SQL] Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

yaooqinn closed pull request #33169: URL: https://github.com/apache/spark/pull/33169 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

AmplabJenkins removed a comment on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872126761 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45008/

[GitHub] [spark] SparkQA removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-871972433 **[Test build #140493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140493/testReport)** for PR 31517 at commit

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872127688 **[Test build #140512 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140512/testReport)** for PR 33172 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872126766 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140493/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872126760 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140506/

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872114576 **[Test build #140493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140493/testReport)** for PR 31517 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

AmplabJenkins commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872126758 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45010/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

AmplabJenkins commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872126761 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45008/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

AmplabJenkins commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872126759 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140509/ -- This

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872116510 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45009/ -- This is an automated message from the

[GitHub] [spark] cloud-fan commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

cloud-fan commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662176820 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private()

[GitHub] [spark] SparkQA commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

SparkQA commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872108330 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45010/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872112571 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45008/ -- This is an automated message from the

[GitHub] [spark] yaooqinn commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872107117 I think `minPartitionSize` is much more useful than `minPartitionNum`, which seem to make the `minPartitionNum` a bit useless and redundant -- This is an automated message

[GitHub] [spark] HyukjinKwon closed pull request #33168: [SPARK-35965][DOCS] Add doc for ORC nested column vectorized reader

HyukjinKwon closed pull request #33168: URL: https://github.com/apache/spark/pull/33168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #33168: [SPARK-35965][DOCS] Add doc for ORC nested column vectorized reader

HyukjinKwon commented on pull request #33168: URL: https://github.com/apache/spark/pull/33168#issuecomment-872104939 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA removed a comment on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

SparkQA removed a comment on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872006587 **[Test build #140501 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140501/testReport)** for PR 29326 at commit

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872103906 **[Test build #140509 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140509/testReport)** for PR 33171 at commit

[GitHub] [spark] linhongliu-db commented on a change in pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

linhongliu-db commented on a change in pull request #32959: URL: https://github.com/apache/spark/pull/32959#discussion_r662162169 ## File path: sql/core/src/test/resources/sql-tests/results/ansi/datetime.sql.out ## @@ -662,10 +661,9 @@ struct -- !query select date

[GitHub] [spark] wangyum commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

wangyum commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662161772 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662152464 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] SparkQA removed a comment on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA removed a comment on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872092626 **[Test build #140509 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140509/testReport)** for PR 33171 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662151008 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] SparkQA removed a comment on pull request #33160: [SPARK-35959][BUILD] Add a new Maven profile "no-shaded-hadoop-client" for older Hadoop 3.x versions

SparkQA removed a comment on pull request #33160: URL: https://github.com/apache/spark/pull/33160#issuecomment-871967458 **[Test build #140487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140487/testReport)** for PR 33160 at commit

[GitHub] [spark] ulysses-you commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

ulysses-you commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662133241 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662151008 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] AmplabJenkins commented on pull request #33160: [SPARK-35959][BUILD] Add a new Maven profile "no-shaded-hadoop-client" for older Hadoop 3.x versions

AmplabJenkins commented on pull request #33160: URL: https://github.com/apache/spark/pull/33160#issuecomment-872100431 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140487/ -- This

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662152677 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] AmplabJenkins commented on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

AmplabJenkins commented on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872097258 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45011/ --

[GitHub] [spark] AmplabJenkins commented on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

AmplabJenkins commented on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872097517 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140501/ -- This

[GitHub] [spark] SparkQA commented on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

SparkQA commented on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872097233 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45011/ --

[GitHub] [spark] SparkQA commented on pull request #33160: [SPARK-35959][BUILD] Add a new Maven profile "no-shaded-hadoop-client" for older Hadoop 3.x versions

SparkQA commented on pull request #33160: URL: https://github.com/apache/spark/pull/33160#issuecomment-872098850 **[Test build #140487 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140487/testReport)** for PR 33160 at commit

[GitHub] [spark] SparkQA commented on pull request #29326: [WIP][SPARK-32502][BUILD] Upgrade Guava to 27.0-jre

SparkQA commented on pull request #29326: URL: https://github.com/apache/spark/pull/29326#issuecomment-872096470 **[Test build #140501 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140501/testReport)** for PR 29326 at commit

[GitHub] [spark] cloud-fan closed pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

cloud-fan closed pull request #32831: URL: https://github.com/apache/spark/pull/32831 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] cloud-fan commented on a change in pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

cloud-fan commented on a change in pull request #32831: URL: https://github.com/apache/spark/pull/32831#discussion_r662147091 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala ## @@ -910,4 +911,27 @@ abstract class SQLViewSuite extends

[GitHub] [spark] cloud-fan commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

cloud-fan commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872095667 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872094255 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45009/ -- This is an automated message from the Apache

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140639 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662142804 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872092880 **[Test build #140511 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140511/testReport)** for PR 32933 at commit

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140767 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

AmplabJenkins removed a comment on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872057201 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140504/

[GitHub] [spark] SparkQA commented on pull request #32959: [WIP][SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-872092804 **[Test build #140510 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140510/testReport)** for PR 32959 at commit

[GitHub] [spark] SparkQA commented on pull request #33174: [SPARK-35721][PYTHON] Path level discover for python unittests

SparkQA commented on pull request #33174: URL: https://github.com/apache/spark/pull/33174#issuecomment-872092588 **[Test build #140507 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140507/testReport)** for PR 33174 at commit

[GitHub] [spark] SparkQA commented on pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

SparkQA commented on pull request #33173: URL: https://github.com/apache/spark/pull/33173#issuecomment-872092686 **[Test build #140508 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140508/testReport)** for PR 33173 at commit

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872092626 **[Test build #140509 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140509/testReport)** for PR 33171 at commit

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662141208 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140767 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662140639 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShufflePartitionsUtil.scala ## @@ -61,7 +63,9 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872091219 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45004/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

AmplabJenkins removed a comment on pull request #33167: URL: https://github.com/apache/spark/pull/33167#issuecomment-872091207 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45005/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

AmplabJenkins removed a comment on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872091209 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140500/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

AmplabJenkins removed a comment on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872091206 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45003/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

AmplabJenkins removed a comment on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-872091208 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45006/

[GitHub] [spark] AmplabJenkins commented on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

AmplabJenkins commented on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-872091208 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45006/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

AmplabJenkins commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872091209 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140500/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

AmplabJenkins commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872091206 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45003/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872091219 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45004/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

AmplabJenkins commented on pull request #33167: URL: https://github.com/apache/spark/pull/33167#issuecomment-872091207 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45005/ --

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662138631 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,18 +525,34 @@ object SQLConf { .booleanConf

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872088374 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45008/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

SparkQA commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872087929 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45010/ -- This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

cloud-fan commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662135636 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private()

[GitHub] [spark] SparkQA commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

SparkQA commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872086013 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45003/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

SparkQA commented on pull request #33167: URL: https://github.com/apache/spark/pull/33167#issuecomment-872084304 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45005/ -- This is an automated message from the

[GitHub] [spark] cloud-fan commented on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

cloud-fan commented on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-872083858 @allisonwang-db can you fix the code conflicts? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [spark] cloud-fan closed pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

cloud-fan closed pull request #32787: URL: https://github.com/apache/spark/pull/32787 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] cloud-fan commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

cloud-fan commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872080973 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] xuanyuanking commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

xuanyuanking commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872080944 Thanks again for the help of @HeartSaVioR and @viirya. The test failure is not related to the changes. Let me retrigger. -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

SparkQA commented on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-872079262 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45006/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872077840 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45004/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

SparkQA removed a comment on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872005990 **[Test build #140500 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140500/testReport)** for PR 32831 at commit

[GitHub] [spark] SparkQA commented on pull request #32831: [SPARK-35685][SQL] Prompt recreating the view when there is an incompatible schema issue

SparkQA commented on pull request #32831: URL: https://github.com/apache/spark/pull/32831#issuecomment-872074778 **[Test build #140500 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140500/testReport)** for PR 32831 at commit

[GitHub] [spark] Yikun edited a comment on pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

Yikun edited a comment on pull request #32867: URL: https://github.com/apache/spark/pull/32867#issuecomment-872072514 The root reason of failed to discover is that the deps of PySpark modules is not installed, so we get the wrong list when we do discover. I re-propose it in

[GitHub] [spark] MaxGekk commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

MaxGekk commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662122830 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private()

[GitHub] [spark] Yikun commented on pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

Yikun commented on pull request #32867: URL: https://github.com/apache/spark/pull/32867#issuecomment-872072514 The root reason of failed to discover is that the deps of PySpark modules is not installed, so we get the wrong list when we do discover. I re-propose it in

[GitHub] [spark] Yikun opened a new pull request #33174: [SPARK-35721][PYTHON] Path level discover for python unittests

Yikun opened a new pull request #33174: URL: https://github.com/apache/spark/pull/33174 ### What changes were proposed in this pull request? Add path level discover for python unittests.

[GitHub] [spark] cloud-fan commented on a change in pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

cloud-fan commented on a change in pull request #33173: URL: https://github.com/apache/spark/pull/33173#discussion_r662115165 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/TimestampNTZType.scala ## @@ -48,7 +48,7 @@ class TimestampNTZType private()

[GitHub] [spark] nirousseau commented on pull request #33157: [WIP][SPARK-35954] Upgrade Apache Curator Dependency to 4.2.0

nirousseau commented on pull request #33157: URL: https://github.com/apache/spark/pull/33157#issuecomment-872065433 as expected, it breaks tests, I will try to setup a local dev env and fix library changes asap. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA removed a comment on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA removed a comment on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872052214 **[Test build #140504 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140504/testReport)** for PR 33171 at commit

[GitHub] [spark] gengliangwang opened a new pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

gengliangwang opened a new pull request #33173: URL: https://github.com/apache/spark/pull/33173 ### What changes were proposed in this pull request? Rename the type name string of TimestampNTZType from "timestamp without time zone" to "timestamp_ntz". ### Why are

[GitHub] [spark] LuciferYang commented on pull request #33061: [SPARK-35862][SS] Remove hardcoded time zone time format for watermark stats

LuciferYang commented on pull request #33061: URL: https://github.com/apache/spark/pull/33061#issuecomment-872060871 @toujours33 Can you re-run GA to verify this pr？ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

SparkQA commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-872057518 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45003/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

AmplabJenkins commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872057201 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140504/ -- This

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872057150 **[Test build #140504 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140504/testReport)** for PR 33171 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33157: [WIP][SPARK-35954] Upgrade Apache Curator Dependency to 4.2.0

AmplabJenkins commented on pull request #33157: URL: https://github.com/apache/spark/pull/33157#issuecomment-872055588 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] cloud-fan commented on pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

cloud-fan commented on pull request #33167: URL: https://github.com/apache/spark/pull/33167#issuecomment-872055070 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] cloud-fan closed pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

cloud-fan closed pull request #33167: URL: https://github.com/apache/spark/pull/33167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #33167: [SPARK-35963][SQL] Rename TimestampWithoutTZType to TimestampNTZType

SparkQA commented on pull request #33167: URL: https://github.com/apache/spark/pull/33167#issuecomment-872055002 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45005/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872054929 **[Test build #140506 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140506/testReport)** for PR 33172 at commit

<    3   4   5   6   7   8   9   10   >