[GitHub] [spark] AmplabJenkins commented on pull request #30175: [SPARK-33274][SS] Fix job hang in cp mode when total cores less than total kafka partition

AmplabJenkins commented on pull request #30175: URL: https://github.com/apache/spark/pull/30175#issuecomment-768650065 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134572/

[GitHub] [spark] SparkQA commented on pull request #30175: [SPARK-33274][SS] Fix job hang in cp mode when total cores less than total kafka partition

SparkQA commented on pull request #30175: URL: https://github.com/apache/spark/pull/30175#issuecomment-768649312 **[Test build #134572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134572/testReport)** for PR 30175 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

AmplabJenkins removed a comment on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768648022 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134568/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31361: [SPARK-34262][SQL] Refresh cached data of v1 table in `ALTER TABLE .. SET LOCATION`

AmplabJenkins removed a comment on pull request #31361: URL: https://github.com/apache/spark/pull/31361#issuecomment-768648024 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39153/

[GitHub] [spark] AmplabJenkins commented on pull request #31361: [SPARK-34262][SQL] Refresh cached data of v1 table in `ALTER TABLE .. SET LOCATION`

AmplabJenkins commented on pull request #31361: URL: https://github.com/apache/spark/pull/31361#issuecomment-768648024 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39153/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

dongjoon-hyun commented on a change in pull request #31355: URL: https://github.com/apache/spark/pull/31355#discussion_r565709706 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DistributionAndOrderingUtils.scala ## @@ -32,21 +32,29 @@

[GitHub] [spark] AmplabJenkins commented on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

AmplabJenkins commented on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768648022 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134568/

[GitHub] [spark] viirya commented on a change in pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

viirya commented on a change in pull request #31355: URL: https://github.com/apache/spark/pull/31355#discussion_r565712581 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/distributions/distributions.scala ## @@ -39,21 +48,29 @@ private[sql] object

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

dongjoon-hyun commented on a change in pull request #31355: URL: https://github.com/apache/spark/pull/31355#discussion_r565709706 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DistributionAndOrderingUtils.scala ## @@ -32,21 +32,29 @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

dongjoon-hyun commented on a change in pull request #31355: URL: https://github.com/apache/spark/pull/31355#discussion_r565709706 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DistributionAndOrderingUtils.scala ## @@ -32,21 +32,29 @@

[GitHub] [spark] aokolnychyi commented on pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

aokolnychyi commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-768642659 Thanks for submitting this follow-up, @HeartSaVioR! I'll take a look tomorrow. Let me also add folks who participated in the review of the original change. cc

[GitHub] [spark] SparkQA commented on pull request #31361: [SPARK-34262][SQL] Refresh cached data of v1 table in `ALTER TABLE .. SET LOCATION`

SparkQA commented on pull request #31361: URL: https://github.com/apache/spark/pull/31361#issuecomment-768637121 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39153/

[GitHub] [spark] HyukjinKwon closed pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

HyukjinKwon closed pull request #31363: URL: https://github.com/apache/spark/pull/31363 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA removed a comment on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

SparkQA removed a comment on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768564792 **[Test build #134568 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134568/testReport)** for PR 30763 at commit

[GitHub] [spark] SparkQA commented on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

SparkQA commented on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768636340 **[Test build #134568 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134568/testReport)** for PR 30763 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

HyukjinKwon commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768636190 Merged to master, branch-3.1 and branch-3.0. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

HyukjinKwon commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768636101 Let's merge and monitor the builds. The changes look making sense. This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

HyukjinKwon commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768635234 Oh, nice. Thanks @attilapiros! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HyukjinKwon commented on pull request #31299: [SPARK-32866][K8S] Fix docker cross-build

HyukjinKwon commented on pull request #31299: URL: https://github.com/apache/spark/pull/31299#issuecomment-768631758 Thanks @holdenk for the explanation, I am good with this. This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon commented on pull request #31284: [SPARK-34167][SQL]Reading parquet with IntDecimal written as a LongDecimal blows up

HyukjinKwon commented on pull request #31284: URL: https://github.com/apache/spark/pull/31284#issuecomment-768630015 @razajafri, do you mind clarifying PR description? For exmaple, I thought you meant writing out to files or somewhere by: > Spark should read it as a long but write

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #31336: [SPARK-34233][SQL] FIX NPE for char padding in binary comparison

dongjoon-hyun edited a comment on pull request #31336: URL: https://github.com/apache/spark/pull/31336#issuecomment-768628582 Hi, this breaks `branch-3.1` UTs. Please take a look at it. ``` DSV2CharVarcharTestSuite.SPARK-34233: char/varchar with null value for partitioned columns

[GitHub] [spark] dongjoon-hyun commented on pull request #31336: [SPARK-34233][SQL] FIX NPE for char padding in binary comparison

dongjoon-hyun commented on pull request #31336: URL: https://github.com/apache/spark/pull/31336#issuecomment-768628582 Hi, this breaks `branch-3.1` UTs. Please take a look at it. This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

AmplabJenkins removed a comment on pull request #31369: URL: https://github.com/apache/spark/pull/31369#issuecomment-768624132 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39157/

[GitHub] [spark] AmplabJenkins commented on pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

AmplabJenkins commented on pull request #31369: URL: https://github.com/apache/spark/pull/31369#issuecomment-768624132 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39157/

[GitHub] [spark] SparkQA commented on pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

SparkQA commented on pull request #31369: URL: https://github.com/apache/spark/pull/31369#issuecomment-768624118 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39157/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

AmplabJenkins removed a comment on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-768622003 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39156/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

AmplabJenkins removed a comment on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768622002 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

AmplabJenkins removed a comment on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768622007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134564/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

AmplabJenkins removed a comment on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768622005 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39154/

[GitHub] [spark] AmplabJenkins commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

AmplabJenkins commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768622002 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

AmplabJenkins commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-768622003 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39156/

[GitHub] [spark] AmplabJenkins commented on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

AmplabJenkins commented on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768622007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134564/

[GitHub] [spark] AmplabJenkins commented on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

AmplabJenkins commented on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768622005 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39154/

[GitHub] [spark] SparkQA commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

SparkQA commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768620488 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39155/

[GitHub] [spark] SparkQA commented on pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

SparkQA commented on pull request #31369: URL: https://github.com/apache/spark/pull/31369#issuecomment-768620032 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39157/

[GitHub] [spark] SparkQA commented on pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

SparkQA commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-768619236 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39156/

[GitHub] [spark] razajafri commented on pull request #31284: [SPARK-34167][SQL]Reading parquet with IntDecimal written as a LongDecimal blows up

razajafri commented on pull request #31284: URL: https://github.com/apache/spark/pull/31284#issuecomment-768618314 @revans2 @tgravescs is there anything else you guys need me to look at in this? This is my first PR in Spark, where do we go from here?

[GitHub] [spark] SparkQA commented on pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

SparkQA commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-768617000 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39156/

[GitHub] [spark] SparkQA commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

SparkQA commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768616129 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39155/

[GitHub] [spark] HyukjinKwon edited a comment on pull request #31346: [SPARK-34244][SQL] Remove the Scala function version of regexp_extract_all

HyukjinKwon edited a comment on pull request #31346: URL: https://github.com/apache/spark/pull/31346#issuecomment-768602533 But I don't personally agree with that. Each language specific APIs should better focus on being the language friendly. Many of them are SQL specific and doesn't

[GitHub] [spark] SparkQA removed a comment on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

SparkQA removed a comment on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768598866 **[Test build #134570 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134570/testReport)** for PR 31363 at commit

[GitHub] [spark] SparkQA commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

SparkQA commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768611983 **[Test build #134570 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134570/testReport)** for PR 31363 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

SparkQA removed a comment on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768530024 **[Test build #134564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134564/testReport)** for PR 31249 at commit

[GitHub] [spark] SparkQA commented on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

SparkQA commented on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768606134 **[Test build #134564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134564/testReport)** for PR 31249 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #31346: [SPARK-34244][SQL] Remove the Scala function version of regexp_extract_all

HyukjinKwon commented on pull request #31346: URL: https://github.com/apache/spark/pull/31346#issuecomment-768602533 But I don't personally agree with that. Each language specific APIs should better focus on being the language friendly. Many of them are SQL specific and doesn't make much

[GitHub] [spark] SparkQA commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

SparkQA commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768598866 **[Test build #134570 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134570/testReport)** for PR 31363 at commit

[GitHub] [spark] SparkQA commented on pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

SparkQA commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-768597841 **[Test build #134571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134571/testReport)** for PR 31355 at commit

[GitHub] [spark] SparkQA commented on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

SparkQA commented on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768597848 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39154/

[GitHub] [spark] SparkQA commented on pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override individual StateStoreCustomMetric

SparkQA commented on pull request #31369: URL: https://github.com/apache/spark/pull/31369#issuecomment-768592776 **[Test build #134569 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134569/testReport)** for PR 31369 at commit

[GitHub] [spark] SparkQA commented on pull request #31361: [SPARK-34262][SQL] Refresh cached data of v1 table in `ALTER TABLE .. SET LOCATION`

SparkQA commented on pull request #31361: URL: https://github.com/apache/spark/pull/31361#issuecomment-768592440 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39153/

[GitHub] [spark] viirya opened a new pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override individual StateStoreCustomMetric

viirya opened a new pull request #31369: URL: https://github.com/apache/spark/pull/31369 ### What changes were proposed in this pull request? This patch proposes to sum up custom metric values instead of taking arbitrary one when combining `StateStoreMetrics`. ###

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

AmplabJenkins removed a comment on pull request #31368: URL: https://github.com/apache/spark/pull/31368#issuecomment-768526213 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

AmplabJenkins removed a comment on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768590619 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134563/

[GitHub] [spark] AmplabJenkins commented on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

AmplabJenkins commented on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768590619 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134563/

[GitHub] [spark] AmplabJenkins commented on pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

AmplabJenkins commented on pull request #31368: URL: https://github.com/apache/spark/pull/31368#issuecomment-768590616 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134565/

[GitHub] [spark] SparkQA removed a comment on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

SparkQA removed a comment on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768493108 **[Test build #134563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134563/testReport)** for PR 31249 at commit

[GitHub] [spark] SparkQA commented on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

SparkQA commented on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768589524 **[Test build #134563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134563/testReport)** for PR 31249 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #31346: [SPARK-34244][SQL] Remove the Scala function version of regexp_extract_all

HyukjinKwon commented on pull request #31346: URL: https://github.com/apache/spark/pull/31346#issuecomment-768584464 Yes, this looks something we should discuss in the mailing list. This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

SparkQA commented on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768583571 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39154/

[GitHub] [spark] HyukjinKwon closed pull request #31298: [SPARK-34193][CORE] TorrentBroadcast block manager decommissioning race fix

HyukjinKwon closed pull request #31298: URL: https://github.com/apache/spark/pull/31298 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA removed a comment on pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

SparkQA removed a comment on pull request #31368: URL: https://github.com/apache/spark/pull/31368#issuecomment-768532277 **[Test build #134565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134565/testReport)** for PR 31368 at commit

[GitHub] [spark] SparkQA commented on pull request #31368: [SPARK-34269][SQL] Simplify SQL view resolution

SparkQA commented on pull request #31368: URL: https://github.com/apache/spark/pull/31368#issuecomment-768581840 **[Test build #134565 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134565/testReport)** for PR 31368 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #31298: [SPARK-34193][CORE] TorrentBroadcast block manager decommissioning race fix

HyukjinKwon commented on pull request #31298: URL: https://github.com/apache/spark/pull/31298#issuecomment-768581888 I think it's fine to merge and leave it for a post review given that the RC will be cut out soon. I reviewed too and signed off. Merged to master and branch-3.1.

[GitHub] [spark] attilapiros commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

attilapiros commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768581622 jenkins retest this please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] attilapiros commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

attilapiros commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768581351 Unrelated error: ``` [info] KafkaSourceStressSuite: [info] - stress test with multiple topics and partitions *** FAILED *** (37 seconds, 259 milliseconds) [info]

[GitHub] [spark] HeartSaVioR commented on pull request #31355: [SPARK-34255][SQL] Support partitioning with static number on required distribution and ordering on V2 write

HeartSaVioR commented on pull request #31355: URL: https://github.com/apache/spark/pull/31355#issuecomment-768580667 I'd like to see our preference on dealing with "possible (but just floated ideas now) improvements" in public API. I think this use case is clear, and the change

[GitHub] [spark] SparkQA commented on pull request #30763: [SPARK-31801][API][SHUFFLE] Register map output metadata

SparkQA commented on pull request #30763: URL: https://github.com/apache/spark/pull/30763#issuecomment-768564792 **[Test build #134568 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134568/testReport)** for PR 30763 at commit

[GitHub] [spark] SparkQA commented on pull request #31361: [SPARK-34262][SQL] Refresh cached data of v1 table in `ALTER TABLE .. SET LOCATION`

SparkQA commented on pull request #31361: URL: https://github.com/apache/spark/pull/31361#issuecomment-768564572 **[Test build #134567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134567/testReport)** for PR 31361 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

AmplabJenkins removed a comment on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768563560 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39150/

[GitHub] [spark] AmplabJenkins commented on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

AmplabJenkins commented on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768563560 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39150/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31298: [SPARK-34193][CORE] TorrentBroadcast block manager decommissioning race fix

AmplabJenkins removed a comment on pull request #31298: URL: https://github.com/apache/spark/pull/31298#issuecomment-768562463 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134560/

[GitHub] [spark] AmplabJenkins commented on pull request #31298: [SPARK-34193][CORE] TorrentBroadcast block manager decommissioning race fix

AmplabJenkins commented on pull request #31298: URL: https://github.com/apache/spark/pull/31298#issuecomment-768562463 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134560/

[GitHub] [spark] SparkQA removed a comment on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

SparkQA removed a comment on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-768486043 **[Test build #134562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134562/testReport)** for PR 31349 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

AmplabJenkins removed a comment on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-768562130 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134562/

[GitHub] [spark] AmplabJenkins commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

AmplabJenkins commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-768562130 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134562/

[GitHub] [spark] SparkQA commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

SparkQA commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-768561891 **[Test build #134562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134562/testReport)** for PR 31349 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31298: [SPARK-34193][CORE] TorrentBroadcast block manager decommissioning race fix

SparkQA removed a comment on pull request #31298: URL: https://github.com/apache/spark/pull/31298#issuecomment-768460247 **[Test build #134560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134560/testReport)** for PR 31298 at commit

[GitHub] [spark] SparkQA commented on pull request #31298: [SPARK-34193][CORE] TorrentBroadcast block manager decommissioning race fix

SparkQA commented on pull request #31298: URL: https://github.com/apache/spark/pull/31298#issuecomment-768561202 **[Test build #134560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134560/testReport)** for PR 31298 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

AmplabJenkins removed a comment on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768557732 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39147/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31362: [SPARK-34263][SQL] Simplify the code for treating unicode/octal/escaped characters in string literals

AmplabJenkins removed a comment on pull request #31362: URL: https://github.com/apache/spark/pull/31362#issuecomment-768557733 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134557/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

AmplabJenkins removed a comment on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768557734 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39149/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31254: [SPARK-34165][SQL] Add count_distinct as an option to Dataset#summary

AmplabJenkins removed a comment on pull request #31254: URL: https://github.com/apache/spark/pull/31254#issuecomment-768557738 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134558/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31366: [SPARK-34267][SQL] Remove `refreshTable()` from `SessionState`

AmplabJenkins removed a comment on pull request #31366: URL: https://github.com/apache/spark/pull/31366#issuecomment-768557735 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134556/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

AmplabJenkins removed a comment on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-768557730 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39148/

[GitHub] [spark] AmplabJenkins commented on pull request #31366: [SPARK-34267][SQL] Remove `refreshTable()` from `SessionState`

AmplabJenkins commented on pull request #31366: URL: https://github.com/apache/spark/pull/31366#issuecomment-768557735 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134556/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30175: [SPARK-33274][SS] Fix job hang in cp mode when total cores less than total kafka partition

AmplabJenkins removed a comment on pull request #30175: URL: https://github.com/apache/spark/pull/30175#issuecomment-768557736 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39152/

[GitHub] [spark] AmplabJenkins commented on pull request #31362: [SPARK-34263][SQL] Simplify the code for treating unicode/octal/escaped characters in string literals

AmplabJenkins commented on pull request #31362: URL: https://github.com/apache/spark/pull/31362#issuecomment-768557733 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134557/

[GitHub] [spark] AmplabJenkins commented on pull request #31363: [SPARK-34154][YARN] Extend LocalityPlacementStrategySuite's test with a timeout

AmplabJenkins commented on pull request #31363: URL: https://github.com/apache/spark/pull/31363#issuecomment-768557732 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39147/

[GitHub] [spark] AmplabJenkins commented on pull request #30175: [SPARK-33274][SS] Fix job hang in cp mode when total cores less than total kafka partition

AmplabJenkins commented on pull request #30175: URL: https://github.com/apache/spark/pull/30175#issuecomment-768557736 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39152/

[GitHub] [spark] AmplabJenkins commented on pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

AmplabJenkins commented on pull request #31249: URL: https://github.com/apache/spark/pull/31249#issuecomment-768557734 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39149/

[GitHub] [spark] AmplabJenkins commented on pull request #31254: [SPARK-34165][SQL] Add count_distinct as an option to Dataset#summary

AmplabJenkins commented on pull request #31254: URL: https://github.com/apache/spark/pull/31254#issuecomment-768557738 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134558/

[GitHub] [spark] AmplabJenkins commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

AmplabJenkins commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-768557730 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39148/

[GitHub] [spark] SparkQA commented on pull request #30175: [SPARK-33274][SS] Fix job hang in cp mode when total cores less than total kafka partition

SparkQA commented on pull request #30175: URL: https://github.com/apache/spark/pull/30175#issuecomment-768554225 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39152/

[GitHub] [spark] MaxGekk commented on pull request #31361: [SPARK-34262][SQL] Refresh cached data of v1 table in `ALTER TABLE .. SET LOCATION`

MaxGekk commented on pull request #31361: URL: https://github.com/apache/spark/pull/31361#issuecomment-768552743 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #30175: [SPARK-33274][SS] Fix job hang in cp mode when total cores less than total kafka partition

SparkQA commented on pull request #30175: URL: https://github.com/apache/spark/pull/30175#issuecomment-768551727 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39152/

[GitHub] [spark] holdenk commented on a change in pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

holdenk commented on a change in pull request #31249: URL: https://github.com/apache/spark/pull/31249#discussion_r565606020 ## File path: core/src/test/scala/org/apache/spark/scheduler/HealthTrackerSuite.scala ## @@ -554,6 +554,51 @@ class HealthTrackerSuite extends

[GitHub] [spark] holdenk commented on a change in pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

holdenk commented on a change in pull request #31249: URL: https://github.com/apache/spark/pull/31249#discussion_r565605069 ## File path: core/src/test/scala/org/apache/spark/scheduler/HealthTrackerSuite.scala ## @@ -554,6 +554,49 @@ class HealthTrackerSuite extends

[GitHub] [spark] holdenk commented on pull request #31298: [SPARK-34193][CORE] TorrentBroadcast block manager decommissioning race fix

holdenk commented on pull request #31298: URL: https://github.com/apache/spark/pull/31298#issuecomment-768549645 @HyukjinKwon do you want me to wait for @jiangxb1987's review? Personally I'm comfortable with @attilapiros's sign-off.

[GitHub] [spark] holdenk commented on pull request #31299: [SPARK-32866][K8S] Fix docker cross-build

holdenk commented on pull request #31299: URL: https://github.com/apache/spark/pull/31299#issuecomment-768549148 > > So previously docker buildx automatically did the push without the push flag, but that's no longer the case, so yeah the current code doesn't work if you need to push it

[GitHub] [spark] SparkQA commented on pull request #31349: [SPARK-34246][SQL] New type coercion syntax rules in ANSI mode

SparkQA commented on pull request #31349: URL: https://github.com/apache/spark/pull/31349#issuecomment-768545010 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39148/

<    1   2   3   4   5   6   7   8   >