[GitHub] [spark] SparkQA removed a comment on pull request #32832: [SPARK-35686][SQL] Not allow using auto-generated alias when creating view

SparkQA removed a comment on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-872127964 **[Test build #140513 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140513/testReport)** for PR 32832 at commit

[GitHub] [spark] SparkQA commented on pull request #32832: [SPARK-35686][SQL] Not allow using auto-generated alias when creating view

SparkQA commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-872323277 **[Test build #140513 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140513/testReport)** for PR 32832 at commit

[GitHub] [spark] SparkQA commented on pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union in AQE

SparkQA commented on pull request #32084: URL: https://github.com/apache/spark/pull/32084#issuecomment-872320654 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45032/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

AmplabJenkins commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872315783 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45033/ --

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872315750 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45033/ -- This is an automated message from the

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662362583 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,8 +525,20 @@ object SQLConf { .booleanConf

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872306543 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140522/

[GitHub] [spark] SparkQA removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872263950 **[Test build #140522 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140522/testReport)** for PR 33172 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872306543 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140522/ -- This

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872306367 **[Test build #140522 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140522/testReport)** for PR 33172 at commit

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872304821 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45035/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872304320 **[Test build #140523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140523/testReport)** for PR 33172 at commit

[GitHub] [spark] SparkQA commented on pull request #33140: [SPARK-35881][SQL] Add support for columnar execution of final query stage in AdaptiveSparkPlanExec

SparkQA commented on pull request #33140: URL: https://github.com/apache/spark/pull/33140#issuecomment-872304365 **[Test build #140524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140524/testReport)** for PR 33140 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33140: [SPARK-35881][SQL] Add support for columnar execution of final query stage in AdaptiveSparkPlanExec

AmplabJenkins removed a comment on pull request #33140: URL: https://github.com/apache/spark/pull/33140#issuecomment-871641279 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

AmplabJenkins removed a comment on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872302726 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

AmplabJenkins removed a comment on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872302727 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872302730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662348054 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] AmplabJenkins commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

AmplabJenkins commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872302727 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872302731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

AmplabJenkins commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872302729 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662348054 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872172938 **[Test build #140516 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140516/testReport)** for PR 31517 at commit

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872299627 **[Test build #140516 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140516/testReport)** for PR 31517 at commit

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872297487 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45034/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA removed a comment on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872137434 **[Test build #140514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140514/testReport)** for PR 33093 at commit

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872296623 **[Test build #140514 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140514/testReport)** for PR 33093 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA removed a comment on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872184617 **[Test build #140517 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140517/testReport)** for PR 33170 at commit

[GitHub] [spark] SparkQA commented on pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union in AQE

SparkQA commented on pull request #32084: URL: https://github.com/apache/spark/pull/32084#issuecomment-872292667 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45032/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872292615 **[Test build #140517 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140517/testReport)** for PR 33170 at commit

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872291726 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45031/ --

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872291094 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45033/ -- This is an automated message from the Apache

[GitHub] [spark] yaooqinn commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

yaooqinn commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662334188 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -525,8 +525,20 @@ object SQLConf { .booleanConf

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662328867 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala ## @@ -1813,7 +1813,7 @@ class DataFrameSuite extends QueryTest

[GitHub] [spark] cloud-fan commented on a change in pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on a change in pull request #33172: URL: https://github.com/apache/spark/pull/33172#discussion_r662328867 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala ## @@ -1813,7 +1813,7 @@ class DataFrameSuite extends QueryTest

[GitHub] [spark] Ngone51 commented on a change in pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state

Ngone51 commented on a change in pull request #33078: URL: https://github.com/apache/spark/pull/33078#discussion_r662325255 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -403,38 +394,78 @@ public

[GitHub] [spark] Ngone51 commented on a change in pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state

Ngone51 commented on a change in pull request #33078: URL: https://github.com/apache/spark/pull/33078#discussion_r662325255 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -403,38 +394,78 @@ public

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662320648 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872272768 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45029/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872271777 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45030/ -- This is an automated message from the

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662313161 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662311649 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662311649 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662310913 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662309909 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662309555 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872263950 **[Test build #140522 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140522/testReport)** for PR 33172 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33175: [WIP][SPARK-35973][SQL] DataSourceV2: Support SHOW CATALOGS

AmplabJenkins commented on pull request #33175: URL: https://github.com/apache/spark/pull/33175#issuecomment-872261958 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662304369 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FlatMapGroupsWithStateExec.scala ## @@ -199,6 +284,49 @@ case class

[GitHub] [spark] Peng-Lei opened a new pull request #33175: [WIP][SPARK-35973][SQL] DataSourceV2: Support SHOW CATALOGS

Peng-Lei opened a new pull request #33175: URL: https://github.com/apache/spark/pull/33175 ### What changes were proposed in this pull request? Datasource V2 can support multiple catalogs. Having "SHOW CATALOGS" to list the catalogs and corresponding default-namespace info will be

[GitHub] [spark] Yikun commented on a change in pull request #33174: [SPARK-35721][PYTHON] Path level discover for python unittests

Yikun commented on a change in pull request #33174: URL: https://github.com/apache/spark/pull/33174#discussion_r662283934 ## File path: python/run-tests.py ## @@ -40,6 +42,99 @@ from sparktestsupport.shellutils import which, subprocess_check_output # noqa from

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662302953 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala ## @@ -1268,12 +1269,298 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872258010 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140512/

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872258324 **[Test build #140521 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140521/testReport)** for PR 32933 at commit

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872258097 **[Test build #140520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140520/testReport)** for PR 33170 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872258010 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140512/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872127688 **[Test build #140512 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140512/testReport)** for PR 33172 at commit

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872256741 **[Test build #140512 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140512/testReport)** for PR 33172 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

AmplabJenkins removed a comment on pull request #33173: URL: https://github.com/apache/spark/pull/33173#issuecomment-872255547 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45028/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins removed a comment on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-87227 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45025/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

AmplabJenkins removed a comment on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872255548 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45022/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

AmplabJenkins removed a comment on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-87225 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45027/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

AmplabJenkins removed a comment on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872219936 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-87222 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45023/

[GitHub] [spark] AmplabJenkins commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

AmplabJenkins commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-87227 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45025/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

AmplabJenkins commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-87220 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

AmplabJenkins commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872255548 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45022/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

AmplabJenkins commented on pull request #33173: URL: https://github.com/apache/spark/pull/33173#issuecomment-872255547 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45028/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-87222 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45023/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

AmplabJenkins commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-87225 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45027/ --

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662291290 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/object.scala ## @@ -486,14 +531,24 @@ case class

[GitHub] [spark] SparkQA commented on pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

SparkQA commented on pull request #33173: URL: https://github.com/apache/spark/pull/33173#issuecomment-872247411 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45028/ --

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-872247095 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45029/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33170: [SPARK-35967][SQL] Update nullability based on column statistics

SparkQA commented on pull request #33170: URL: https://github.com/apache/spark/pull/33170#issuecomment-872246247 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45030/ -- This is an automated message from the Apache

[GitHub] [spark] Yikun commented on a change in pull request #33174: [SPARK-35721][PYTHON] Path level discover for python unittests

Yikun commented on a change in pull request #33174: URL: https://github.com/apache/spark/pull/33174#discussion_r662283934 ## File path: python/run-tests.py ## @@ -40,6 +42,99 @@ from sparktestsupport.shellutils import which, subprocess_check_output # noqa from

[GitHub] [spark] Yikun commented on a change in pull request #33174: [SPARK-35721][PYTHON] Path level discover for python unittests

Yikun commented on a change in pull request #33174: URL: https://github.com/apache/spark/pull/33174#discussion_r662283934 ## File path: python/run-tests.py ## @@ -40,6 +42,99 @@ from sparktestsupport.shellutils import which, subprocess_check_output # noqa from

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662282624 ## File path: sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala ## @@ -280,6 +280,51 @@ class KeyValueGroupedDataset[K, V]

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662282624 ## File path: sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala ## @@ -280,6 +280,51 @@ class KeyValueGroupedDataset[K, V]

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872241541 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45022/ -- This is an automated message from the

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662280740 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala ## @@ -37,6 +37,12 @@ object

[GitHub] [spark] tdas commented on a change in pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

tdas commented on a change in pull request #33093: URL: https://github.com/apache/spark/pull/33093#discussion_r662279824 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala ## @@ -232,6 +238,10 @@ object

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872236008 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45027/ -- This is an automated message from the

[GitHub] [spark] HeartSaVioR commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

HeartSaVioR commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872233560 retest this, please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-872229992 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45023/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872229796 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45024/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

SparkQA commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872229798 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45025/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA removed a comment on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872092880 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872224007 **[Test build #140498 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140498/testReport)** for PR 32933 at commit

[GitHub] [spark] cloud-fan commented on pull request #33172: [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing

cloud-fan commented on pull request #33172: URL: https://github.com/apache/spark/pull/33172#issuecomment-872219986 I think the normal case should be setting `COALESCE_PARTITIONS_MIN_PARTITION_NUM`to 1 and then tune the advisory size. This new config is really only for the default case

[GitHub] [spark] AmplabJenkins commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

AmplabJenkins commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872219936 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140511/ -- This

[GitHub] [spark] gengliangwang closed pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

gengliangwang closed pull request #33173: URL: https://github.com/apache/spark/pull/33173 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #32933: [SPARK-35785][SS] Cleanup support for RocksDB instance

SparkQA commented on pull request #32933: URL: https://github.com/apache/spark/pull/32933#issuecomment-872219142 **[Test build #140511 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140511/testReport)** for PR 32933 at commit

[GitHub] [spark] gengliangwang commented on pull request #33173: [SPARK-35971][SQL] Rename the type name of TimestampNTZType as "timestamp_ntz"

gengliangwang commented on pull request #33173: URL: https://github.com/apache/spark/pull/33173#issuecomment-872218553 Thanks for the review. Merging to master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] cloud-fan closed pull request #32832: [SPARK-35686][SQL] Not allow using auto-generated alias when creating view

cloud-fan closed pull request #32832: URL: https://github.com/apache/spark/pull/32832 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] cloud-fan commented on pull request #32832: [SPARK-35686][SQL] Not allow using auto-generated alias when creating view

cloud-fan commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-872217246 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #33171: [SPARK-35969][K8S] Make the pod prefix more readable and tallied with K8S DNS Label Names

SparkQA commented on pull request #33171: URL: https://github.com/apache/spark/pull/33171#issuecomment-872214790 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45022/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union in AQE

SparkQA commented on pull request #32084: URL: https://github.com/apache/spark/pull/32084#issuecomment-872214551 **[Test build #140519 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140519/testReport)** for PR 32084 at commit

[GitHub] [spark] srowen commented on pull request #32813: [SPARK-34591][MLLIB][WIP] Add decision tree pruning as a parameter

srowen commented on pull request #32813: URL: https://github.com/apache/spark/pull/32813#issuecomment-872214116 Should I take up this change in a separate PR, to just make the basic changes? -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #33093: [SPARK-35897][SS] Support user defined initial state with flatMapGroupsWithState in Structured Streaming

SparkQA commented on pull request #33093: URL: https://github.com/apache/spark/pull/33093#issuecomment-872212897 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45027/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32832: [SPARK-35686][SQL] Not allow using auto-generated alias when creating view

AmplabJenkins removed a comment on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-872211236 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

<    1   2   3   4   5   6   7   8   9   10   >