[GitHub] [spark] holdenk commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

holdenk commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-657792220 appveyor failure is unrelated (no rlang installed). This passes all tests so I'm going to merge it. This is an

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

AmplabJenkins removed a comment on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657790584 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] tanelk opened a new pull request #29092: [SPARK-32295][SQL] Add not null and size > 0 filters before inner explode to benefit from predicate pushdown

tanelk opened a new pull request #29092: URL: https://github.com/apache/spark/pull/29092 ### What changes were proposed in this pull request? Add `And(IsNotNull(e), GreaterThan(Size(e), Literal(0)))` filter before Explode and PosExplode, when `outer = false`. ### Why

[GitHub] [spark] AmplabJenkins commented on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

AmplabJenkins commented on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657790584 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

SparkQA commented on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657790109 **[Test build #125790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125790/testReport)** for PR 29078 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

dongjoon-hyun commented on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657788086 Thank you for the fix, @srowen ! This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] srowen commented on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

srowen commented on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657787280 Oh good catch, I think that's it. The issue is that `ListBuffer.toSeq` does _not_ simply return itself (not sure why). So this passes copies of the mutable ListBuffer which is

[GitHub] [spark] sarutak commented on a change in pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

sarutak commented on a change in pull request #29002: URL: https://github.com/apache/spark/pull/29002#discussion_r453895184 ## File path: core/src/main/scala/org/apache/spark/TestUtils.scala ## @@ -179,11 +179,18 @@ private[spark] object TestUtils { destDir: File,

[GitHub] [spark] gatorsmile commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

gatorsmile commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657776217 cc @gengliangwang @cloud-fan @MaxGekk This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting

AmplabJenkins removed a comment on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-657775899 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting feature.

AmplabJenkins commented on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-657775899 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting featur

SparkQA removed a comment on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-657672039 **[Test build #125780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125780/testReport)** for PR 28874 at commit

[GitHub] [spark] SparkQA commented on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting feature.

SparkQA commented on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-657774381 **[Test build #125780 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125780/testReport)** for PR 28874 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

AmplabJenkins commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-657773247 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-657773247 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

SparkQA removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-657679389 **[Test build #125782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125782/testReport)** for PR 28864 at commit

[GitHub] [spark] SparkQA commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

SparkQA commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-657772589 **[Test build #125782 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125782/testReport)** for PR 28864 at commit

[GitHub] [spark] Tagar commented on pull request #29082: [SPARK-32288][UI] Add exception summary for failed tasks in stage page

Tagar commented on pull request #29082: URL: https://github.com/apache/spark/pull/29082#issuecomment-657769389 Great improvement Would be nice to aggregate across similar exceptions that are only different in terms of literal values. E.g. in your screenshot, two exceptions were on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

AmplabJenkins removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-657765941 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

AmplabJenkins commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-657765941 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

AmplabJenkins removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657764959 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

SparkQA removed a comment on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-657604967 **[Test build #125775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125775/testReport)** for PR 29085 at commit

[GitHub] [spark] SparkQA commented on pull request #29085: [SPARK-32106][SQL]Implement SparkScriptTransformationExec in sql/core

SparkQA commented on pull request #29085: URL: https://github.com/apache/spark/pull/29085#issuecomment-657765230 **[Test build #125775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125775/testReport)** for PR 29085 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

AmplabJenkins removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657764950 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] agrawaldevesh commented on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

agrawaldevesh commented on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-657764758 Jenkins, retest this please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark'

AmplabJenkins commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657764950 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spar

SparkQA removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657689826 **[Test build #125783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125783/testReport)** for PR 28287 at commit

[GitHub] [spark] SparkQA commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's blac

SparkQA commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657764128 **[Test build #125783 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125783/testReport)** for PR 28287 at commit

[GitHub] [spark] sarutak commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

sarutak commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-657763975 > I am +0 with the proposal. The pagination makes the visualization simpler, but also makes the UI usage more complex. If you insist, let's merge this one. I wondered the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

AmplabJenkins removed a comment on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-655208442 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] agrawaldevesh commented on pull request #29032: [SPARK-32217] Plumb whether a worker would also be decommissioned along with executor

agrawaldevesh commented on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-657763170 Retest this please. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

SparkQA commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-657761388 **[Test build #125789 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125789/testReport)** for PR 29002 at commit

[GitHub] [spark] sarutak commented on a change in pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

sarutak commented on a change in pull request #29002: URL: https://github.com/apache/spark/pull/29002#discussion_r453895184 ## File path: core/src/main/scala/org/apache/spark/TestUtils.scala ## @@ -179,11 +179,18 @@ private[spark] object TestUtils { destDir: File,

[GitHub] [spark] MaxGekk commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

MaxGekk commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-657759278 @HyukjinKwon gently ping This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

AmplabJenkins removed a comment on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-657758781 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29091: [SPARK-32258][SQL] Not duplicate normalization on children for float/double If/CaseWhen/Coalesce

AmplabJenkins removed a comment on pull request #29091: URL: https://github.com/apache/spark/pull/29091#issuecomment-657758683 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29091: [SPARK-32258][SQL] Not duplicate normalization on children for float/double If/CaseWhen/Coalesce

AmplabJenkins commented on pull request #29091: URL: https://github.com/apache/spark/pull/29091#issuecomment-657758683 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

AmplabJenkins commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-657758781 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29091: [SPARK-32258][SQL] Not duplicate normalization on children for float/double If/CaseWhen/Coalesce

SparkQA commented on pull request #29091: URL: https://github.com/apache/spark/pull/29091#issuecomment-657758173 **[Test build #125788 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125788/testReport)** for PR 29091 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

AmplabJenkins removed a comment on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-657757136 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

AmplabJenkins removed a comment on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-657757123 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] viirya opened a new pull request #29091: [SPARK-32258][SQL] Not duplicate normalization on children for float/double If/CaseWhen/Coalesce

viirya opened a new pull request #29091: URL: https://github.com/apache/spark/pull/29091 ### What changes were proposed in this pull request? This is followup to #29061. See https://github.com/apache/spark/pull/29061#discussion_r453458611. Basically this moves

[GitHub] [spark] AmplabJenkins commented on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

AmplabJenkins commented on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-657757123 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

SparkQA removed a comment on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-657593145 **[Test build #125773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125773/testReport)** for PR 29064 at commit

[GitHub] [spark] SparkQA commented on pull request #29064: [SPARK-32272][SQL] Add SQL standard command SET TIME ZONE

SparkQA commented on pull request #29064: URL: https://github.com/apache/spark/pull/29064#issuecomment-657756229 **[Test build #125773 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125773/testReport)** for PR 29064 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

AmplabJenkins removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-657742819 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

AmplabJenkins commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-657742819 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

SparkQA removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-657561120 **[Test build #125772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125772/testReport)** for PR 28363 at commit

[GitHub] [spark] SparkQA commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

SparkQA commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-657742124 **[Test build #125772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125772/testReport)** for PR 28363 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29090: [WIP][SPARK-32293] Fix inconsistency between Spark memory configs and JVM option

AmplabJenkins removed a comment on pull request #29090: URL: https://github.com/apache/spark/pull/29090#issuecomment-657736117 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29090: [WIP][SPARK-32293] Fix inconsistency between Spark memory configs and JVM option

SparkQA commented on pull request #29090: URL: https://github.com/apache/spark/pull/29090#issuecomment-657738943 **[Test build #125787 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125787/testReport)** for PR 29090 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

AmplabJenkins removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657736717 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

AmplabJenkins commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657736717 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

dongjoon-hyun edited a comment on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657736058 @srowen . Interestingly, the root cause of the failure is the following inside `ContinuousMemoryStream`. Can we revert `.map(_.toSeq)` and use a different

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

dongjoon-hyun edited a comment on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657736058 @srowen . Interestingly, the root cause of the failure is the following inside `ContinuousMemoryStream`. Can we revert it and use a different approach? ```scala

[GitHub] [spark] dongjoon-hyun commented on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

dongjoon-hyun commented on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657736058 @srowen . Interestingly, the root cause of the failure is the following inside `ContinuousMemoryStream`. Can we revert it and use a different approach? ```scala -

[GitHub] [spark] AmplabJenkins commented on pull request #29090: [WIP][SPARK-32293] Fix inconsistency between Spark memory configs and JVM option

AmplabJenkins commented on pull request #29090: URL: https://github.com/apache/spark/pull/29090#issuecomment-657736117 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] attilapiros opened a new pull request #29090: [WIP][SPARK-32293] Fix inconsistency between Spark memory configs and JVM option

attilapiros opened a new pull request #29090: URL: https://github.com/apache/spark/pull/29090 ### What changes were proposed in this pull request? Fixing inconsistency between Spark memory configs and JVM option by adding the "m" default unit before setting Xmx/Xms JVM options when

[GitHub] [spark] SparkQA commented on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

SparkQA commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657735646 **[Test build #125786 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125786/testReport)** for PR 28957 at commit

[GitHub] [spark] BryanCutler commented on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

BryanCutler commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657733254 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is l

AmplabJenkins removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-657729251 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

AmplabJenkins commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-657729251 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29084: [SPARK-32220][SQL][FOLLOW-UP]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

AmplabJenkins removed a comment on pull request #29084: URL: https://github.com/apache/spark/pull/29084#issuecomment-657728417 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29084: [SPARK-32220][SQL][FOLLOW-UP]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

AmplabJenkins commented on pull request #29084: URL: https://github.com/apache/spark/pull/29084#issuecomment-657728417 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

SparkQA commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-657728722 **[Test build #125785 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125785/testReport)** for PR 28848 at commit

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r453857178 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1912,12 +1934,8 @@ private[spark] class DAGScheduler( * modify

[GitHub] [spark] SparkQA removed a comment on pull request #29084: [SPARK-32220][SQL][FOLLOW-UP]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

SparkQA removed a comment on pull request #29084: URL: https://github.com/apache/spark/pull/29084#issuecomment-657557130 **[Test build #125771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125771/testReport)** for PR 29084 at commit

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r453856811 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -170,13 +170,34 @@ private[spark] class DAGScheduler( */

[GitHub] [spark] SparkQA commented on pull request #29084: [SPARK-32220][SQL][FOLLOW-UP]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

SparkQA commented on pull request #29084: URL: https://github.com/apache/spark/pull/29084#issuecomment-657727502 **[Test build #125771 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125771/testReport)** for PR 29084 at commit

[GitHub] [spark] viirya commented on a change in pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

viirya commented on a change in pull request #29089: URL: https://github.com/apache/spark/pull/29089#discussion_r453851262 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -981,6 +982,10 @@ object EliminateSorts extends

[GitHub] [spark] imback82 commented on a change in pull request #28375: [SPARK-30282][SQL][FOLLOWUP] SHOW TBLPROPERTIES should support views

imback82 commented on a change in pull request #28375: URL: https://github.com/apache/spark/pull/28375#discussion_r453850728 ## File path: sql/core/src/test/resources/sql-tests/inputs/show-tblproperties.sql ## @@ -0,0 +1,26 @@ +-- create a table with properties +CREATE TABLE

[GitHub] [spark] imback82 commented on a change in pull request #28840: [SPARK-31999][SQL] Add REFRESH FUNCTION command

imback82 commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r453846870 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/LookupCatalog.scala ## @@ -155,4 +155,31 @@ private[sql] trait

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is l

AmplabJenkins removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-657718459 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

AmplabJenkins commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-657718459 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] agrawaldevesh commented on a change in pull request #29015: [SPARK-32215] Expose a (protected) /workers/kill endpoint on the MasterWebUI

agrawaldevesh commented on a change in pull request #29015: URL: https://github.com/apache/spark/pull/29015#discussion_r453845348 ## File path: core/src/main/scala/org/apache/spark/deploy/master/ui/MasterWebUI.scala ## @@ -49,6 +56,23 @@ class MasterWebUI( "/app/kill",

[GitHub] [spark] SparkQA commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

SparkQA commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-657717862 **[Test build #125784 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125784/testReport)** for PR 28848 at commit

[GitHub] [spark] agrawaldevesh commented on a change in pull request #29015: [SPARK-32215] Expose a (protected) /workers/kill endpoint on the MasterWebUI

agrawaldevesh commented on a change in pull request #29015: URL: https://github.com/apache/spark/pull/29015#discussion_r453843780 ## File path: core/src/main/scala/org/apache/spark/deploy/master/Master.scala ## @@ -863,7 +872,36 @@ private[deploy] class Master( true }

[GitHub] [spark] dongjoon-hyun commented on pull request #29089: [SPARK-32276][SQL] Remove redundant sorts before repartition nodes

dongjoon-hyun commented on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-657713339 Thank you for pinging me, @aokolnychyi . This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28942: [SPARK-32125][UI] Support get taskList by status in Web UI and SHS Rest API

AmplabJenkins removed a comment on pull request #28942: URL: https://github.com/apache/spark/pull/28942#issuecomment-657711496 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28942: [SPARK-32125][UI] Support get taskList by status in Web UI and SHS Rest API

AmplabJenkins commented on pull request #28942: URL: https://github.com/apache/spark/pull/28942#issuecomment-657711496 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28942: [SPARK-32125][UI] Support get taskList by status in Web UI and SHS Rest API

SparkQA removed a comment on pull request #28942: URL: https://github.com/apache/spark/pull/28942#issuecomment-657625932 **[Test build #125777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125777/testReport)** for PR 28942 at commit

[GitHub] [spark] SparkQA commented on pull request #28942: [SPARK-32125][UI] Support get taskList by status in Web UI and SHS Rest API

SparkQA commented on pull request #28942: URL: https://github.com/apache/spark/pull/28942#issuecomment-657710836 **[Test build #125777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125777/testReport)** for PR 28942 at commit

[GitHub] [spark] aokolnychyi commented on pull request #29089: [SQL][SPARK-32276] Remove redundant sorts before repartition nodes

aokolnychyi commented on pull request #29089: URL: https://github.com/apache/spark/pull/29089#issuecomment-657697965 cc @dongjoon-hyun @dbtsai @cloud-fan @viirya @gengliangwang for feedback This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29088: [SPARK-32289][SQL] Some characters are garbled when opening csv files with Excel

AmplabJenkins removed a comment on pull request #29088: URL: https://github.com/apache/spark/pull/29088#issuecomment-657694140 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29088: [SPARK-32289][SQL] Some characters are garbled when opening csv files with Excel

AmplabJenkins commented on pull request #29088: URL: https://github.com/apache/spark/pull/29088#issuecomment-657694129 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29088: [SPARK-32289][SQL] Some characters are garbled when opening csv files with Excel

SparkQA commented on pull request #29088: URL: https://github.com/apache/spark/pull/29088#issuecomment-657693900 **[Test build #125776 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125776/testReport)** for PR 29088 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29088: [SPARK-32289][SQL] Some characters are garbled when opening csv files with Excel

SparkQA removed a comment on pull request #29088: URL: https://github.com/apache/spark/pull/29088#issuecomment-657625853 **[Test build #125776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125776/testReport)** for PR 29088 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

AmplabJenkins removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657693684 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29088: [SPARK-32289][SQL] Some characters are garbled when opening csv files with Excel

AmplabJenkins removed a comment on pull request #29088: URL: https://github.com/apache/spark/pull/29088#issuecomment-657694129 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

AmplabJenkins commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657693672 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

AmplabJenkins removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657693672 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] srowen commented on pull request #29078: [SPARK-29292][STREAMING][SQL][BUILD] Get streaming, catalyst, sql compiling for Scala 2.13

srowen commented on pull request #29078: URL: https://github.com/apache/spark/pull/29078#issuecomment-657693660 Weird one: ``` KafkaContinuousSinkSuite: [info] - streaming - write to kafka with topic field *** FAILED *** (31 seconds, 238 milliseconds) [info] The code passed

[GitHub] [spark] SparkQA removed a comment on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

SparkQA removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657601013 **[Test build #125774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125774/testReport)** for PR 28957 at commit

[GitHub] [spark] SparkQA commented on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

SparkQA commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657692680 **[Test build #125774 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125774/testReport)** for PR 28957 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

AmplabJenkins removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657690538 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark'

AmplabJenkins commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657690538 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's blac

SparkQA commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657689826 **[Test build #125783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125783/testReport)** for PR 28287 at commit

[GitHub] [spark] tgravescs commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's bl

tgravescs commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657686732 test this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] venkata91 commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's bl

venkata91 commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-657682658 > **[Test build #125723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125723/testReport)** for PR 28287 at commit

[GitHub] [spark] aokolnychyi commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

aokolnychyi commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-657680636 The test failure in `ArrowConvertersSuite` is related to the optimization I did to dedup sorts. I've created [another](https://github.com/apache/spark/pull/29089) PR to

<    1   2   3   4   5   6   7   >