[GitHub] [spark] shardulm94 commented on a change in pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

shardulm94 commented on a change in pull request #31591: URL: https://github.com/apache/spark/pull/31591#discussion_r613532867 ## File path: resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala ## @@ -583,6 +602,44 @@ private object YarnCla

[GitHub] [spark] SparkQA removed a comment on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/h

SparkQA removed a comment on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819669808 **[Test build #137365 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137365/testReport)** for PR 32172 at commit [`2d81aa7`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop co

SparkQA commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819764718 **[Test build #137365 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137365/testReport)** for PR 32172 at commit [`2d81aa7`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32171: [DO NOT MERGE] Test NEW GA FAILURE

SparkQA removed a comment on pull request #32171: URL: https://github.com/apache/spark/pull/32171#issuecomment-819658830 **[Test build #137362 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137362/testReport)** for PR 32171 at commit [`6b468f1`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32171: [DO NOT MERGE] Test NEW GA FAILURE

SparkQA commented on pull request #32171: URL: https://github.com/apache/spark/pull/32171#issuecomment-819763428 **[Test build #137362 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137362/testReport)** for PR 32171 at commit [`6b468f1`](https://github.co

[GitHub] [spark] venkata91 commented on pull request #30480: [SPARK-32921][SHUFFLE] MapOutputTracker extensions to support push-based shuffle

venkata91 commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-819760722 Test failures seems unrelated, can we kick off a new test run @mridulm ? Gentle ping @Ngone51 for another review. -- This is an automated message from the Apache Git Service

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32139: [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

AmplabJenkins removed a comment on pull request #32139: URL: https://github.com/apache/spark/pull/32139#issuecomment-819755742 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137359/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32139: [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

AmplabJenkins commented on pull request #32139: URL: https://github.com/apache/spark/pull/32139#issuecomment-819755742 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137359/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32139: [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

SparkQA removed a comment on pull request #32139: URL: https://github.com/apache/spark/pull/32139#issuecomment-819619406 **[Test build #137359 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137359/testReport)** for PR 32139 at commit [`33ef1a0`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32139: [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

SparkQA commented on pull request #32139: URL: https://github.com/apache/spark/pull/32139#issuecomment-819754371 **[Test build #137359 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137359/testReport)** for PR 32139 at commit [`33ef1a0`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32152: [SPARK-35034][PYTHON] Port Koalas miscellaneous unit tests into PySpark

AmplabJenkins removed a comment on pull request #32152: URL: https://github.com/apache/spark/pull/32152#issuecomment-819753648 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137358/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32152: [SPARK-35034][PYTHON] Port Koalas miscellaneous unit tests into PySpark

AmplabJenkins commented on pull request #32152: URL: https://github.com/apache/spark/pull/32152#issuecomment-819753648 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137358/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32158: [DO NOT MERGE] Try the new Github action process

AmplabJenkins removed a comment on pull request #32158: URL: https://github.com/apache/spark/pull/32158#issuecomment-819753259 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41945/

[GitHub] [spark] AmplabJenkins commented on pull request #32158: [DO NOT MERGE] Try the new Github action process

AmplabJenkins commented on pull request #32158: URL: https://github.com/apache/spark/pull/32158#issuecomment-819753259 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41945/ -- T

[GitHub] [spark] SparkQA commented on pull request #32158: [DO NOT MERGE] Try the new Github action process

SparkQA commented on pull request #32158: URL: https://github.com/apache/spark/pull/32158#issuecomment-819753213 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA removed a comment on pull request #32152: [SPARK-35034][PYTHON] Port Koalas miscellaneous unit tests into PySpark

SparkQA removed a comment on pull request #32152: URL: https://github.com/apache/spark/pull/32152#issuecomment-819616067 **[Test build #137358 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137358/testReport)** for PR 32152 at commit [`48a17d9`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default

AmplabJenkins removed a comment on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819751493 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41944/

[GitHub] [spark] SparkQA commented on pull request #32152: [SPARK-35034][PYTHON] Port Koalas miscellaneous unit tests into PySpark

SparkQA commented on pull request #32152: URL: https://github.com/apache/spark/pull/32152#issuecomment-819751876 **[Test build #137358 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137358/testReport)** for PR 32152 at commit [`48a17d9`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/had

AmplabJenkins commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819751493 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41944/ -- T

[GitHub] [spark] SparkQA commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop co

SparkQA commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819751447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] srowen commented on pull request #32169: [SPARK-35009][CORE] Avoid creating multiple python worker monitor threads for the same worker and same task context

srowen commented on pull request #32169: URL: https://github.com/apache/spark/pull/32169#issuecomment-819749376 Is there any downside or problem that this could cause? I don't know enough about what a monitor thread does to really evaluate it. The change itself looks clean and does what it

[GitHub] [spark] SparkQA commented on pull request #32174: [SPARK-35048][INFRA] Only trigger the notify test workflow in upstream

SparkQA commented on pull request #32174: URL: https://github.com/apache/spark/pull/32174#issuecomment-819745463 **[Test build #137368 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137368/testReport)** for PR 32174 at commit [`6fde92d`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #32175: Incubation

AmplabJenkins commented on pull request #32175: URL: https://github.com/apache/spark/pull/32175#issuecomment-819745183 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default

AmplabJenkins removed a comment on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819745008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

AmplabJenkins removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-819745010 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137349/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32169: [SPARK-35009][CORE] Avoid creating multiple python worker monitor threads for the same worker and same task context

AmplabJenkins removed a comment on pull request #32169: URL: https://github.com/apache/spark/pull/32169#issuecomment-819745007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137355/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32159: [WIP][SPARK-35055][SQL] Fix the requirement in BitSet.union

AmplabJenkins removed a comment on pull request #32159: URL: https://github.com/apache/spark/pull/32159#issuecomment-819745012 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137360/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/had

AmplabJenkins commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819745011 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For q

[GitHub] [spark] AmplabJenkins commented on pull request #32159: [WIP][SPARK-35055][SQL] Fix the requirement in BitSet.union

AmplabJenkins commented on pull request #32159: URL: https://github.com/apache/spark/pull/32159#issuecomment-819745012 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137360/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32169: [SPARK-35009][CORE] Avoid creating multiple python worker monitor threads for the same worker and same task context

AmplabJenkins commented on pull request #32169: URL: https://github.com/apache/spark/pull/32169#issuecomment-819745007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137355/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

AmplabJenkins commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-819745010 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137349/ -- This

[GitHub] [spark] dzhi-lyft opened a new pull request #32175: Incubation

dzhi-lyft opened a new pull request #32175: URL: https://github.com/apache/spark/pull/32175 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service

[GitHub] [spark] attilapiros edited a comment on pull request #32169: [SPARK-35009][CORE] Avoid creating multiple python worker monitor threads for the same worker and same task context

attilapiros edited a comment on pull request #32169: URL: https://github.com/apache/spark/pull/32169#issuecomment-819741657 ok, so the python tests was successful even on the jenkins (+ locally, but failed in my github action): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] attilapiros commented on pull request #32169: [SPARK-35009][CORE] Avoid creating multiple python worker monitor threads for the same worker and same task context

attilapiros commented on pull request #32169: URL: https://github.com/apache/spark/pull/32169#issuecomment-819741657 ok, so the python tests was successful even on jenkins too: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137355/testReport/pyspark.tests.test_daemon/

[GitHub] [spark] SparkQA removed a comment on pull request #32159: [WIP][SPARK-35055][SQL] Fix the requirement in BitSet.union

SparkQA removed a comment on pull request #32159: URL: https://github.com/apache/spark/pull/32159#issuecomment-819621408 **[Test build #137360 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137360/testReport)** for PR 32159 at commit [`88fc731`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32159: [WIP][SPARK-35055][SQL] Fix the requirement in BitSet.union

SparkQA commented on pull request #32159: URL: https://github.com/apache/spark/pull/32159#issuecomment-819740321 **[Test build #137360 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137360/testReport)** for PR 32159 at commit [`88fc731`](https://github.co

[GitHub] [spark] github-actions[bot] commented on pull request #32139: [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

github-actions[bot] commented on pull request #32139: URL: https://github.com/apache/spark/pull/32139#issuecomment-819738348 **[Test build #748889579](https://github.com/xinrong-databricks/spark/actions/runs/748889579)** for PR 32139 at commit [`33ef1a0`](https://github.com/xinrong-databr

[GitHub] [spark] Yikun commented on pull request #32168: [DO NOT MERGE] Test NEW GA FAILURE

Yikun commented on pull request #32168: URL: https://github.com/apache/spark/pull/32168#issuecomment-819736508 I met same problem on the 1st error `fatal: Not possible to fast-forward, aborting.`, after some investagations, I found it is caused by `yaooqinn:SPARK-35044` is not synced with

[GitHub] [spark] github-actions[bot] commented on pull request #32152: [SPARK-35034][PYTHON] Port Koalas miscellaneous unit tests into PySpark

github-actions[bot] commented on pull request #32152: URL: https://github.com/apache/spark/pull/32152#issuecomment-819734898 **[Test build #748860054](https://github.com/xinrong-databricks/spark/actions/runs/748860054)** for PR 32152 at commit [`48a17d9`](https://github.com/xinrong-databr

[GitHub] [spark] SparkQA removed a comment on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-819497235 **[Test build #137349 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137349/testReport)** for PR 31913 at commit [`cff9b9a`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-819731883 **[Test build #137349 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137349/testReport)** for PR 31913 at commit [`cff9b9a`](https://github.co

[GitHub] [spark] github-actions[bot] commented on pull request #32170: [SPARK-35051][SQL] Support add/subtract of a day-time interval to/from a date

github-actions[bot] commented on pull request #32170: URL: https://github.com/apache/spark/pull/32170#issuecomment-819730769 **[Test build #748727708](https://github.com/MaxGekk/spark/actions/runs/748727708)** for PR 32170 at commit [`4a425e1`](https://github.com/MaxGekk/spark/commit/4a42

[GitHub] [spark] Yikun opened a new pull request #32174: [SPARK-35048][INFRA] Only trigger the notify test workflow in upstream

Yikun opened a new pull request #32174: URL: https://github.com/apache/spark/pull/32174 ### What changes were proposed in this pull request? Only trigger the notify test workflow in upstream ### Why are the changes needed? We should only trigger the notify test workflow in u

[GitHub] [spark] SparkQA commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop co

SparkQA commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819726785 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] viirya edited a comment on pull request #32090: [SPARK-34212][SQL][FOLLOWUP] Move the added test to ParquetQuerySuite

viirya edited a comment on pull request #32090: URL: https://github.com/apache/spark/pull/32090#issuecomment-819725770 Hi, as 2.4.8 RC2 is under voting now. I'd like to confirm that we don't want to support the case in 2.4.8, right? This PR just moves the test case. cc @wangyum @cloud-fan

[GitHub] [spark] viirya edited a comment on pull request #32090: [SPARK-34212][SQL][FOLLOWUP] Move the added test to ParquetQuerySuite

viirya edited a comment on pull request #32090: URL: https://github.com/apache/spark/pull/32090#issuecomment-819725770 Hi, as 2.4.8 RC2 is under voting now. I'd like to confirm that we don't want to support the case in 2.4.8, right? This PR just moves the test case. cc @wangyum @cloud-fan

[GitHub] [spark] viirya commented on pull request #32090: [SPARK-34212][SQL][FOLLOWUP] Move the added test to ParquetQuerySuite

viirya commented on pull request #32090: URL: https://github.com/apache/spark/pull/32090#issuecomment-819725770 Hi, as 2.4.8 RC2 is under voting now. I'd like to confirm that we don't want to support the case, right? This PR just moves the test case. cc @wangyum @cloud-fan -- This is an

[GitHub] [spark] SparkQA removed a comment on pull request #32169: [WIP][SPARK-35009][CORE] Avoid creating multiple python worker monitor threads for the same worker and same task context

SparkQA removed a comment on pull request #32169: URL: https://github.com/apache/spark/pull/32169#issuecomment-819584328 **[Test build #137355 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137355/testReport)** for PR 32169 at commit [`4f1b687`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32169: [WIP][SPARK-35009][CORE] Avoid creating multiple python worker monitor threads for the same worker and same task context

SparkQA commented on pull request #32169: URL: https://github.com/apache/spark/pull/32169#issuecomment-819723871 **[Test build #137355 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137355/testReport)** for PR 32169 at commit [`4f1b687`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop co

SparkQA commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819722022 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41942/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

AmplabJenkins removed a comment on pull request #31591: URL: https://github.com/apache/spark/pull/31591#issuecomment-819718340 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137352/ -

[GitHub] [spark] SparkQA commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop co

SparkQA commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819718412 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41942/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

AmplabJenkins commented on pull request #31591: URL: https://github.com/apache/spark/pull/31591#issuecomment-819718340 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137352/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

SparkQA removed a comment on pull request #31591: URL: https://github.com/apache/spark/pull/31591#issuecomment-819570700 **[Test build #137352 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137352/testReport)** for PR 31591 at commit [`fab9f9e`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

SparkQA commented on pull request #31591: URL: https://github.com/apache/spark/pull/31591#issuecomment-819716804 **[Test build #137352 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137352/testReport)** for PR 31591 at commit [`fab9f9e`](https://github.co

[GitHub] [spark] yaooqinn closed pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop configs

yaooqinn closed pull request #32172: URL: https://github.com/apache/spark/pull/32172 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pleas

[GitHub] [spark] yaooqinn commented on pull request #32144: [SPARK-35044][SQL] `SET propertyKey` shall also lookup `sparkSession.sharedState.hadoopConf` to display the effective default hive/hadoop co

yaooqinn commented on pull request #32144: URL: https://github.com/apache/spark/pull/32144#issuecomment-819705470 Jenkins passed for many empty commits the GA also passed before rebasing master, the `fast forward` is not related Thanks for reviewing and merged to master. -- This

[GitHub] [spark] yaooqinn closed pull request #32144: [SPARK-35044][SQL] `SET propertyKey` shall also lookup `sparkSession.sharedState.hadoopConf` to display the effective default hive/hadoop configs

yaooqinn closed pull request #32144: URL: https://github.com/apache/spark/pull/32144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pleas

[GitHub] [spark] SparkQA commented on pull request #32158: [DO NOT MERGE] Try the new Github action process

SparkQA commented on pull request #32158: URL: https://github.com/apache/spark/pull/32158#issuecomment-819698606 **[Test build #137367 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137367/testReport)** for PR 32158 at commit [`8a79b5e`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop co

SparkQA commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819698497 **[Test build #137366 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137366/testReport)** for PR 32172 at commit [`95e9130`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32168: [DO NOT MERGE] Test NEW GA FAILURE

AmplabJenkins removed a comment on pull request #32168: URL: https://github.com/apache/spark/pull/32168#issuecomment-819696983 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41941/

[GitHub] [spark] AmplabJenkins commented on pull request #32168: [DO NOT MERGE] Test NEW GA FAILURE

AmplabJenkins commented on pull request #32168: URL: https://github.com/apache/spark/pull/32168#issuecomment-819696983 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41941/ -- T

[GitHub] [spark] SparkQA commented on pull request #32168: [DO NOT MERGE] Test NEW GA FAILURE

SparkQA commented on pull request #32168: URL: https://github.com/apache/spark/pull/32168#issuecomment-819696944 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32159: [WIP][SPARK-35055][SQL] Fix the requirement in BitSet.union

AmplabJenkins removed a comment on pull request #32159: URL: https://github.com/apache/spark/pull/32159#issuecomment-819696223 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41939/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

AmplabJenkins removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-819696226 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41940/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32168: [DO NOT MERGE] Test NEW GA FAILURE

AmplabJenkins removed a comment on pull request #32168: URL: https://github.com/apache/spark/pull/32168#issuecomment-819696222 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41936/

[GitHub] [spark] AmplabJenkins commented on pull request #32168: [DO NOT MERGE] Test NEW GA FAILURE

AmplabJenkins commented on pull request #32168: URL: https://github.com/apache/spark/pull/32168#issuecomment-819696222 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41936/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

AmplabJenkins commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-819696226 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41940/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32159: [WIP][SPARK-35055][SQL] Fix the requirement in BitSet.union

AmplabJenkins commented on pull request #32159: URL: https://github.com/apache/spark/pull/32159#issuecomment-819696223 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41939/ -- T

[GitHub] [spark] SparkQA commented on pull request #32159: [WIP][SPARK-35055][SQL] Fix the requirement in BitSet.union

SparkQA commented on pull request #32159: URL: https://github.com/apache/spark/pull/32159#issuecomment-819695658 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41939/ -- This is an automated message from the A

[GitHub] [spark] github-actions[bot] commented on pull request #32169: [WIP][SPARK-35009][CORE] Avoid creating multiple python worker monitor threads for the same worker and same task context

github-actions[bot] commented on pull request #32169: URL: https://github.com/apache/spark/pull/32169#issuecomment-819692843 **[Test build #748664690](https://github.com/attilapiros/spark/actions/runs/748664690)** for PR 32169 at commit [`4f1b687`](https://github.com/attilapiros/spark/com

[GitHub] [spark] github-actions[bot] commented on pull request #32144: [SPARK-35044][SQL] `SET propertyKey` shall also lookup `sparkSession.sharedState.hadoopConf` to display the effective default hiv

github-actions[bot] commented on pull request #32144: URL: https://github.com/apache/spark/pull/32144#issuecomment-819691416 **[Test build #749140422](https://github.com/yaooqinn/spark/actions/runs/749140422)** for PR 32144 at commit [`b6d26b7`](https://github.com/yaooqinn/spark/commit/b6

[GitHub] [spark] github-actions[bot] commented on pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

github-actions[bot] commented on pull request #31591: URL: https://github.com/apache/spark/pull/31591#issuecomment-819691105 **[Test build #592944647](https://github.com/shardulm94/spark/actions/runs/592944647)** for PR 31591 at commit [`fab9f9e`](https://github.com/shardulm94/spark/commi

[GitHub] [spark] github-actions[bot] commented on pull request #32144: [SPARK-35044][SQL] `SET propertyKey` shall also lookup `sparkSession.sharedState.hadoopConf` to display the effective default hiv

github-actions[bot] commented on pull request #32144: URL: https://github.com/apache/spark/pull/32144#issuecomment-819690465 **[Test build #749140422](https://github.com/yaooqinn/spark/actions/runs/749140422)** for PR 32144 at commit [`a3a6c5e`](https://github.com/yaooqinn/spark/commit/a3

[GitHub] [spark] github-actions[bot] commented on pull request #32167: [SPARK-35067][TESTS]Add test case for function COALESCE().

github-actions[bot] commented on pull request #32167: URL: https://github.com/apache/spark/pull/32167#issuecomment-819689335 **[Test build #748529576](https://github.com/zengruios/spark/actions/runs/748529576)** for PR 32167 at commit [`586b690`](https://github.com/zengruios/spark/commit/

[GitHub] [spark] github-actions[bot] commented on pull request #32163: [SPARK-35086][SQL][CORE] --verbose should be passed to Spark SQL CLI too

github-actions[bot] commented on pull request #32163: URL: https://github.com/apache/spark/pull/32163#issuecomment-819688975 **[Test build #748540421](https://github.com/AngersZh/spark/actions/runs/748540421)** for PR 32163 at commit [`195c933`](https://github.com/AngersZh/spark/c

[GitHub] [spark] github-actions[bot] commented on pull request #32144: [SPARK-35044][SQL] `SET propertyKey` shall also lookup `sparkSession.sharedState.hadoopConf` to display the effective default hiv

github-actions[bot] commented on pull request #32144: URL: https://github.com/apache/spark/pull/32144#issuecomment-819684782 **[Test build #749140422](https://github.com/yaooqinn/spark/actions/runs/749140422)** for PR 32144 at commit [`8dbed7b`](https://github.com/yaooqinn/spark/commit/8d

[GitHub] [spark] github-actions[bot] commented on pull request #32107: [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function `sum`

github-actions[bot] commented on pull request #32107: URL: https://github.com/apache/spark/pull/32107#issuecomment-819682673 **[Test build #747608412](https://github.com/beliefer/spark/actions/runs/747608412)** for PR 32107 at commit [`18c17ff`](https://github.com/beliefer/spark/commit/18

[GitHub] [spark] shardulm94 commented on a change in pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

shardulm94 commented on a change in pull request #31591: URL: https://github.com/apache/spark/pull/31591#discussion_r613430732 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala ## @@ -793,6 +793,25 @@ private[spark] class Client(

[GitHub] [spark] github-actions[bot] commented on pull request #32166: [SPARK-35071][PYTHON] Rename Koalas to pandas-on-Spark in main codes

github-actions[bot] commented on pull request #32166: URL: https://github.com/apache/spark/pull/32166#issuecomment-819681503 **[Test build #748086638](https://github.com/HyukjinKwon/spark/actions/runs/748086638)** for PR 32166 at commit [`4ca5c6d`](https://github.com/HyukjinKwon/spark/com

[GitHub] [spark] SparkQA commented on pull request #31913: [SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-819681117 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] github-actions[bot] commented on pull request #32144: [SPARK-35044][SQL] `SET propertyKey` shall also lookup `sparkSession.sharedState.hadoopConf` to display the effective default hiv

github-actions[bot] commented on pull request #32144: URL: https://github.com/apache/spark/pull/32144#issuecomment-819679970 **[Test build #749140422](https://github.com/yaooqinn/spark/actions/runs/749140422)** for PR 32144 at commit [`23248c3`](https://github.com/yaooqinn/spark/commit/23

[GitHub] [spark] github-actions[bot] commented on pull request #32160: [SPARK-35061][BUILD] Upgrade pycodestyle from 2.6.0 to 2.7.0

github-actions[bot] commented on pull request #32160: URL: https://github.com/apache/spark/pull/32160#issuecomment-819677874 **[Test build #748029554](https://github.com/HyukjinKwon/spark/actions/runs/748029554)** for PR 32160 at commit [`fe07e5c`](https://github.com/HyukjinKwon/spark/com

[GitHub] [spark] lhotari edited a comment on pull request #32102: [SPARK-35002][INFRA][FOLLOW-UP] Use localhost instead of 127.0.0.1 at SPARK_LOCAL_IP in GA builds

lhotari edited a comment on pull request #32102: URL: https://github.com/apache/spark/pull/32102#issuecomment-819668837 Just in case it is useful, I created an alternative fix which fixes the root cause of the problem. Reverse name lookups for the current hostname is broken in GitHub Actio

[GitHub] [spark] SparkQA commented on pull request #32168: [DO NOT MERGE] Test NEW GA FAILURE

SparkQA commented on pull request #32168: URL: https://github.com/apache/spark/pull/32168#issuecomment-819673716 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA commented on pull request #32159: [WIP][SPARK-35055][SQL] Fix the requirement in BitSet.union

SparkQA commented on pull request #32159: URL: https://github.com/apache/spark/pull/32159#issuecomment-819673432 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41939/ -- This is an automated message from the Apache

[GitHub] [spark] lhotari commented on pull request #32173: [SPARK-35002][INFRA][FOLLOW-UP] Add current ip address, long hostname and short hostname to /etc/hosts

lhotari commented on pull request #32173: URL: https://github.com/apache/spark/pull/32173#issuecomment-819670655 bui...@apache.org mailing list thread: https://lists.apache.org/thread.html/r40b2da182952f21a3b94696e6f1bf8594e7ff16e1c5979fe8b2d51c8%40%3Cbuilds.apache.org%3E -- This is an

[GitHub] [spark] SparkQA commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop co

SparkQA commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819669808 **[Test build #137365 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137365/testReport)** for PR 32172 at commit [`2d81aa7`](https://github.com

[GitHub] [spark] lhotari commented on pull request #32102: [SPARK-35002][INFRA][FOLLOW-UP] Use localhost instead of 127.0.0.1 at SPARK_LOCAL_IP in GA builds

lhotari commented on pull request #32102: URL: https://github.com/apache/spark/pull/32102#issuecomment-819668837 Just in case it is useful, I created an alternative fix which fixes the root cause of the problem. Reverse name lookups for the current hostname is broken in GitHub Actions Runn

[GitHub] [spark] AmplabJenkins commented on pull request #32173: [SPARK-35002][INFRA][FOLLOW-UP] Add current ip address, long hostname and short hostname to /etc/hosts

AmplabJenkins commented on pull request #32173: URL: https://github.com/apache/spark/pull/32173#issuecomment-819668250 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] lhotari opened a new pull request #32173: [SPARK-35002][INFRA][FOLLOW-UP] Add current ip address, long hostname and short hostname to /etc/hosts

lhotari opened a new pull request #32173: URL: https://github.com/apache/spark/pull/32173 ### What changes were proposed in this pull request? - Fixes reverse DNS lookup for current hostname in GitHub Actions ### Why are the changes needed? Reverse DNS lookups are broken

[GitHub] [spark] SparkQA commented on pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop co

SparkQA commented on pull request #32172: URL: https://github.com/apache/spark/pull/32172#issuecomment-819667661 **[Test build #137364 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137364/testReport)** for PR 32172 at commit [`8da8d88`](https://github.com

[GitHub] [spark] yaooqinn opened a new pull request #32172: [WIP][SPARK-35044][SQL] SET propertyKey shall also lookup sparkSession.sharedState.hadoopConf to display the effective default hive/hadoop c

yaooqinn opened a new pull request #32172: URL: https://github.com/apache/spark/pull/32172 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ##

[GitHub] [spark] viirya edited a comment on pull request #32136: [WIP][SPARK-35022][CORE] Task Scheduling Plugin in Spark

viirya edited a comment on pull request #32136: URL: https://github.com/apache/spark/pull/32136#issuecomment-819661211 > I think the scheduler already distributes tasks evenly when there's no locality preference as we'll shuffle the executors before scheduling: > > Doesn't it work?

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32163: [SPARK-35086][SQL][CORE] --verbose should be passed to Spark SQL CLI too

AmplabJenkins removed a comment on pull request #32163: URL: https://github.com/apache/spark/pull/32163#issuecomment-819663807 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137350/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32163: [SPARK-35086][SQL][CORE] --verbose should be passed to Spark SQL CLI too

AmplabJenkins commented on pull request #32163: URL: https://github.com/apache/spark/pull/32163#issuecomment-819663807 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137350/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32139: [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

AmplabJenkins removed a comment on pull request #32139: URL: https://github.com/apache/spark/pull/32139#issuecomment-819662892 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41938/

[GitHub] [spark] srowen commented on pull request #31942: [SPARK-34834][NETWORK] Fix a potential Netty memory leak in TransportResponseHandler.

srowen commented on pull request #31942: URL: https://github.com/apache/spark/pull/31942#issuecomment-819663225 Merged to master/3.1/3.0/2.4 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [spark] AmplabJenkins commented on pull request #32139: [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

AmplabJenkins commented on pull request #32139: URL: https://github.com/apache/spark/pull/32139#issuecomment-819662892 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41938/ -- T

[GitHub] [spark] SparkQA commented on pull request #32139: [SPARK-35032][PYTHON] Port Koalas Index unit tests into PySpark

SparkQA commented on pull request #32139: URL: https://github.com/apache/spark/pull/32139#issuecomment-819662842 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

<    1   2   3   4   5   6   7   8   9   10   >