[GitHub] [spark] fqaiser94 commented on a change in pull request #27066: [SPARK-31317][SQL] Add withField method to Column

fqaiser94 commented on a change in pull request #27066: URL: https://github.com/apache/spark/pull/27066#discussion_r442617236 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala ## @@ -539,3 +541,82 @@ case class StringT

[GitHub] [spark] agrawaldevesh commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

agrawaldevesh commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r442615769 ## File path: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala ## @@ -178,6 +184,10 @@ private[spark] class HighlyCompressedMapStatus

[GitHub] [spark] HeartSaVioR commented on pull request #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

HeartSaVioR commented on pull request #25135: URL: https://github.com/apache/spark/pull/25135#issuecomment-646420436 @Tagar Please refer the comment in JIRA issue: https://issues.apache.org/jira/browse/SPARK-28367?focusedCommentId=17088514&page=com.atlassian.jira.plugin.system.issuet

[GitHub] [spark] AmplabJenkins commented on pull request #28831: [SPARK-31993][SQL] Build arrays for passing variables generated from children for 'concat_ws' with columns having at least one of array

AmplabJenkins commented on pull request #28831: URL: https://github.com/apache/spark/pull/28831#issuecomment-646420162 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28831: [SPARK-31993][SQL] Build arrays for passing variables generated from children for 'concat_ws' with columns having at least one

AmplabJenkins removed a comment on pull request #28831: URL: https://github.com/apache/spark/pull/28831#issuecomment-646420162 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28831: [SPARK-31993][SQL] Build arrays for passing variables generated from children for 'concat_ws' with columns having at least one of arr

SparkQA removed a comment on pull request #28831: URL: https://github.com/apache/spark/pull/28831#issuecomment-646349387 **[Test build #124239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124239/testReport)** for PR 28831 at commit [`22ab4ff`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28831: [SPARK-31993][SQL] Build arrays for passing variables generated from children for 'concat_ws' with columns having at least one of array type

SparkQA commented on pull request #28831: URL: https://github.com/apache/spark/pull/28831#issuecomment-646419702 **[Test build #124239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124239/testReport)** for PR 28831 at commit [`22ab4ff`](https://github.co

[GitHub] [spark] agrawaldevesh commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

agrawaldevesh commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r442615585 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -420,6 +420,30 @@ package object config { .booleanConf

[GitHub] [spark] xuanyuanking commented on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

xuanyuanking commented on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-646418641 Thanks for reviewing. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646417972 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] SparkQA removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646417341 **[Test build #124255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124255/testReport)** for PR 28866 at commit [`fe42fd5`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646417965 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646417965 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646417952 **[Test build #124255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124255/testReport)** for PR 28866 at commit [`fe42fd5`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646417639 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646417639 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646417341 **[Test build #124255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124255/testReport)** for PR 28866 at commit [`fe42fd5`](https://github.com

[GitHub] [spark] TJX2014 commented on a change in pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

TJX2014 commented on a change in pull request #28856: URL: https://github.com/apache/spark/pull/28856#discussion_r442613764 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala ## @@ -2635,7 +2643,11 @@ object Sequence

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646416246 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646416242 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646416242 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646416228 **[Test build #124253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124253/testReport)** for PR 28866 at commit [`7e18dcc`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646415577 **[Test build #124253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124253/testReport)** for PR 28866 at commit [`7e18dcc`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646415868 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

AmplabJenkins commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646415868 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646415860 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646415860 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

SparkQA commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646415612 **[Test build #124254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124254/testReport)** for PR 28856 at commit [`b33514f`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646415577 **[Test build #124253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124253/testReport)** for PR 28866 at commit [`7e18dcc`](https://github.com

[GitHub] [spark] wankunde commented on pull request #28857: [SPARK-32023][Streaming]Generate spark streaming test jar with maven plugin maven-jar-plugin

wankunde commented on pull request #28857: URL: https://github.com/apache/spark/pull/28857#issuecomment-646414088 Hi @srowen, I have compared the compilation results with and without shade plugin. Their result classes are the same. So I don't think we need to keep shade plugin anymore.

[GitHub] [spark] holdenk commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

holdenk commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r442604350 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -775,7 +802,12 @@ private[spark] class MapOutputTrackerMaster( override

[GitHub] [spark] Ngone51 commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

Ngone51 commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r442610125 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,22 @@ private[spark] class DAGScheduler( hostT

[GitHub] [spark] Ngone51 commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

Ngone51 commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r442610030 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,23 @@ private[spark] class DAGScheduler( hostT

[GitHub] [spark] HyukjinKwon closed pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

HyukjinKwon closed pull request #28854: URL: https://github.com/apache/spark/pull/28854 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] HyukjinKwon commented on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

HyukjinKwon commented on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-646412636 Merged to master and branch-3.0 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #28860: [SPARK-32002][SQL]Support Extract valve from nested ArrayStruct

AmplabJenkins commented on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-646410212 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28860: [SPARK-32002][SQL]Support Extract valve from nested ArrayStruct

AmplabJenkins removed a comment on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-646410212 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28860: [SPARK-32002][SQL]Support Extract valve from nested ArrayStruct

SparkQA commented on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-646409843 **[Test build #124252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124252/testReport)** for PR 28860 at commit [`400ad7d`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646404851 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] SparkQA removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646404216 **[Test build #124251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124251/testReport)** for PR 28866 at commit [`4a6f903`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646404847 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646404847 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646404833 **[Test build #124251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124251/testReport)** for PR 28866 at commit [`4a6f903`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins removed a comment on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646404507 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

AmplabJenkins commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646404507 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] agrawaldevesh commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

agrawaldevesh commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r442581482 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -775,7 +802,12 @@ private[spark] class MapOutputTrackerMaster( ov

[GitHub] [spark] SparkQA commented on pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

SparkQA commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-646404216 **[Test build #124251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124251/testReport)** for PR 28866 at commit [`4a6f903`](https://github.com

[GitHub] [spark] beliefer opened a new pull request #28866: [SPARK-31845][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

beliefer opened a new pull request #28866: URL: https://github.com/apache/spark/pull/28866 ### What changes were proposed in this pull request? `DAGSchedulerSuite` provides `completeNextStageWithFetchFailure` to make all tasks in non first stage occur `FetchFailed`. But many test case

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP][test-hive1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

AmplabJenkins removed a comment on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646402637 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28720: [SPARK-31900][SPARK-SUBMIT] Client memory passed unvalidated to the JVM Xmx

AmplabJenkins removed a comment on pull request #28720: URL: https://github.com/apache/spark/pull/28720#issuecomment-646402640 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646402311 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins commented on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP][test-hive1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

AmplabJenkins commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646402637 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28720: [SPARK-31900][SPARK-SUBMIT] Client memory passed unvalidated to the JVM Xmx

AmplabJenkins commented on pull request #28720: URL: https://github.com/apache/spark/pull/28720#issuecomment-646402640 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

SparkQA removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646396650 **[Test build #124246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124246/testReport)** for PR 28856 at commit [`9650122`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646402306 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28720: [SPARK-31900][SPARK-SUBMIT] Client memory passed unvalidated to the JVM Xmx

SparkQA removed a comment on pull request #28720: URL: https://github.com/apache/spark/pull/28720#issuecomment-646355461 **[Test build #124240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124240/testReport)** for PR 28720 at commit [`87e1d67`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

AmplabJenkins commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646402306 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

SparkQA commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646402278 **[Test build #124246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124246/testReport)** for PR 28856 at commit [`9650122`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP][test-hive1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

SparkQA commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646402299 **[Test build #124250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124250/testReport)** for PR 28835 at commit [`e409f9a`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28720: [SPARK-31900][SPARK-SUBMIT] Client memory passed unvalidated to the JVM Xmx

SparkQA commented on pull request #28720: URL: https://github.com/apache/spark/pull/28720#issuecomment-646402044 **[Test build #124240 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124240/testReport)** for PR 28720 at commit [`87e1d67`](https://github.co

[GitHub] [spark] Ngone51 commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

Ngone51 commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r442599457 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,23 @@ private[spark] class DAGScheduler( hostT

[GitHub] [spark] Ngone51 commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

Ngone51 commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r442599457 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,23 @@ private[spark] class DAGScheduler( hostT

[GitHub] [spark] yaooqinn commented on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP][test-hive1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

yaooqinn commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646400808 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP][test-hive1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

AmplabJenkins removed a comment on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646400756 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP][test-hive1.2][test-maven] Fix concurrency issue for ThriftCLIService to getPortNumber

AmplabJenkins commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646400756 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP][test-hive1.2] Fix concurrency issue for ThriftCLIService to getPortNumber

SparkQA commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646400501 **[Test build #124249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124249/testReport)** for PR 28835 at commit [`e409f9a`](https://github.com

[GitHub] [spark] yaooqinn commented on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP][test-hive1.2] Fix concurrency issue for ThriftCLIService to getPortNumber

yaooqinn commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646400317 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] Ngone51 commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

Ngone51 commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r442597972 ## File path: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ## @@ -540,6 +540,46 @@ class DAGSchedulerSuite extends SparkFunSuit

[GitHub] [spark] holdenk commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

holdenk commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-646399281 I'm going to hold off on merging this for a little longer actually, it seems like there are some other folks who seem interested in the space (cc @HyukjinKwon who's recently sho

[GitHub] [spark] Ngone51 commented on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

Ngone51 commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-646398922 @wypoon Just a reminder, please do not resolve conversations before we reach into an agreement. This is an aut

[GitHub] [spark] SparkQA commented on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

SparkQA commented on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646398561 **[Test build #124248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124248/testReport)** for PR 28645 at commit [`e6bb55d`](https://github.com

[GitHub] [spark] maropu commented on a change in pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

maropu commented on a change in pull request #28123: URL: https://github.com/apache/spark/pull/28123#discussion_r442596514 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/bucketing/CoalesceBucketsInSortMergeJoin.scala ## @@ -0,0 +1,132 @@ +/* + * Licensed

[GitHub] [spark] maropu commented on a change in pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

maropu commented on a change in pull request #28123: URL: https://github.com/apache/spark/pull/28123#discussion_r442596155 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/bucketing/CoalesceBucketsInSortMergeJoinSuite.scala ## @@ -0,0 +1,194 @@ +/* + * Lice

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646396920 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

AmplabJenkins removed a comment on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-646396968 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

AmplabJenkins removed a comment on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646397013 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

AmplabJenkins commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646396920 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

AmplabJenkins commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-646396968 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

AmplabJenkins commented on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646397013 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

SparkQA commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646396650 **[Test build #124246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124246/testReport)** for PR 28856 at commit [`9650122`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

SparkQA commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-646396659 **[Test build #124247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124247/testReport)** for PR 28841 at commit [`256cb1b`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-645944138 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] maropu commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

maropu commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646395857 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

AmplabJenkins removed a comment on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-644667095 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] maropu commented on pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

maropu commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-646395368 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on a change in pull request #28840: [SPARK-31999][SQL] Add REFRESH FUNCTION command

maropu commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r442590610 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/LookupCatalog.scala ## @@ -155,4 +155,37 @@ private[sql] trait LookupCata

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646393419 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

AmplabJenkins commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646393419 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

SparkQA commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646393153 **[Test build #124245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124245/testReport)** for PR 28853 at commit [`600b933`](https://github.com

[GitHub] [spark] liucht-inspur commented on pull request #28855: [SPARK-31871][CORE][WEBUI][2.3] History page and Executors tab page show the correct sort icons

liucht-inspur commented on pull request #28855: URL: https://github.com/apache/spark/pull/28855#issuecomment-646391545 Thank you all. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] shahidki31 commented on a change in pull request #28861: [MINOR] update dev/create-release/known_translations

shahidki31 commented on a change in pull request #28861: URL: https://github.com/apache/spark/pull/28861#discussion_r442590160 ## File path: dev/create-release/known_translations ## @@ -261,3 +261,151 @@ yanlin-Lynn - Yanlin Wang yucai - Yucai Yu zhengruifeng - Ruifeng Zheng

[GitHub] [spark] teeyog commented on a change in pull request #28861: [MINOR] update dev/create-release/known_translations

teeyog commented on a change in pull request #28861: URL: https://github.com/apache/spark/pull/28861#discussion_r442588202 ## File path: dev/create-release/known_translations ## @@ -261,3 +261,151 @@ yanlin-Lynn - Yanlin Wang yucai - Yucai Yu zhengruifeng - Ruifeng Zheng zuo

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r441280950 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileIndexSuite.scala ## @@ -19,18 +19,18 @@ package org.apache.spark.s

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL][SS] Refactor DateTimeUtils

AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646388534 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27617: [SPARK-30865][SQL][SS] Refactor DateTimeUtils

AmplabJenkins commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646388534 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] holdenk commented on pull request #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

holdenk commented on pull request #26440: URL: https://github.com/apache/spark/pull/26440#issuecomment-646388097 Also the first PR I made here was back in Aug 24, 2017. There has been plenty of time. This is an automated mes

[GitHub] [spark] SparkQA removed a comment on pull request #27617: [SPARK-30865][SQL][SS] Refactor DateTimeUtils

SparkQA removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646306268 **[Test build #124235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124235/testReport)** for PR 27617 at commit [`863d747`](https://gi

[GitHub] [spark] SparkQA commented on pull request #27617: [SPARK-30865][SQL][SS] Refactor DateTimeUtils

SparkQA commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646388065 **[Test build #124235 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124235/testReport)** for PR 27617 at commit [`863d747`](https://github.co

[GitHub] [spark] holdenk edited a comment on pull request #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

holdenk edited a comment on pull request #26440: URL: https://github.com/apache/spark/pull/26440#issuecomment-646387458 > I haven't looked into the codes closely yet - I will try to read and follow more closely. I just noticed the discussions made in these PRs which are virtually from you.

[GitHub] [spark] holdenk commented on pull request #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

holdenk commented on pull request #26440: URL: https://github.com/apache/spark/pull/26440#issuecomment-646387458 > I haven't looked into the codes closely yet - I will try to read and follow more closely. I just noticed the discussions made in these PRs which are virtually from you. >

<    1   2   3   4   5   6   7   8   >