[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699442012 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699442007 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments numbe

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699442007 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments num

2020-09-25 Thread GitBox
SparkQA removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699281169 **[Test build #129130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129130/testReport)** for PR 29054 at commit [`95cfebe`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699441723 **[Test build #129130 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129130/testReport)** for PR 29054 at commit [`95cfebe`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #29872: [SPARK-32996][Web-UI] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer

2020-09-25 Thread GitBox
SparkQA commented on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699402597 **[Test build #129131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129131/testReport)** for PR 29872 at commit [`2967673`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699400125 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699399818 **[Test build #129128 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129128/testReport)** for PR 29054 at commit [`a8549c4`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699400119 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments numbe

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699400119 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments num

2020-09-25 Thread GitBox
SparkQA removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699279546 **[Test build #129128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129128/testReport)** for PR 29054 at commit [`a8549c4`](https://gi

[GitHub] [spark] shrutig commented on pull request #29872: [SPARK-32996][Web-UI] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer

2020-09-25 Thread GitBox
shrutig commented on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699399318 Updated PR to have `peakMemoryMetrics` revert to `None` in `ExecutorMetricsJsonDeserializer` This is an automat

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699318647 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699318487 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments numbe

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699318487 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699318439 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33746/ ---

[GitHub] [spark] SparkQA commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
SparkQA commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699318603 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33747/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699318647 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
SparkQA commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699296378 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33747/ -

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699287405 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33746/ -

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699281169 **[Test build #129130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129130/testReport)** for PR 29054 at commit [`95cfebe`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
SparkQA commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699281142 **[Test build #129129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129129/testReport)** for PR 29875 at commit [`d7aeded`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699279546 **[Test build #129128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129128/testReport)** for PR 29054 at commit [`a8549c4`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699274719 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699274719 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
SparkQA removed a comment on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699168581 **[Test build #129124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129124/testReport)** for PR 29875 at commit [`3f14f68`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
SparkQA commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699274191 **[Test build #129124 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129124/testReport)** for PR 29875 at commit [`3f14f68`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699272523 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/129

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699272519 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments num

2020-09-25 Thread GitBox
SparkQA removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699231076 **[Test build #129127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129127/testReport)** for PR 29054 at commit [`766c931`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments numbe

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699272519 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699272432 **[Test build #129127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129127/testReport)** for PR 29054 at commit [`766c931`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699271839 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699271839 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
SparkQA removed a comment on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699207624 **[Test build #129126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129126/testReport)** for PR 29855 at commit [`85b0de8`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
SparkQA commented on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699271332 **[Test build #129126 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129126/testReport)** for PR 29855 at commit [`85b0de8`](https://github.co

[GitHub] [spark] HeartSaVioR commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-09-25 Thread GitBox
HeartSaVioR commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-699270951 Would you mind going through another round of review? Thanks in advance! This is an automated message from t

[GitHub] [spark] HeartSaVioR commented on pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API

2020-09-25 Thread GitBox
HeartSaVioR commented on pull request #29729: URL: https://github.com/apache/spark/pull/29729#issuecomment-699269552 Worth noting that the issue is not just occurred in theory, but I've seen the case multiple times around community report, customers, etc. Probably we'd feel better to docum

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29872: [SPARK-32996][Web-UI] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699266831 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29872: [SPARK-32996][Web-UI] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699266831 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29872: [SPARK-32996][Web-UI] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer

2020-09-25 Thread GitBox
SparkQA commented on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699266269 **[Test build #129125 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129125/testReport)** for PR 29872 at commit [`c27a699`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29872: [SPARK-32996][Web-UI] Handle empty ExecutorMetrics in ExecutorMetricsJsonSerializer

2020-09-25 Thread GitBox
SparkQA removed a comment on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699197271 **[Test build #129125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129125/testReport)** for PR 29872 at commit [`c27a699`](https://gi

[GitHub] [spark] viirya commented on pull request #29831: [SPARK-32351][SQL] Show partially pushed down partition filters in explain()

2020-09-25 Thread GitBox
viirya commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-699265145 cc @maropu too This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] viirya commented on a change in pull request #29831: [SPARK-32351][SQL] show pushed down partition filters in explain()

2020-09-25 Thread GitBox
viirya commented on a change in pull request #29831: URL: https://github.com/apache/spark/pull/29831#discussion_r495365478 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala ## @@ -254,22 +254,28 @@ private[hive] trait HiveStrategies { * R

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699257263 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments numbe

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699257257 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699257243 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33745/ ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid argumen

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699257257 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] marmbrus commented on a change in pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

2020-09-25 Thread GitBox
marmbrus commented on a change in pull request #29403: URL: https://github.com/apache/spark/pull/29403#discussion_r495355330 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala ## @@ -377,6 +378,29 @@ object ScalaReflection extends Sca

[GitHub] [spark] jkleckner commented on a change in pull request #29496: [SPARK-24266][K8S][2.4] Restart the watcher when we receive a version changed from k8s

2020-09-25 Thread GitBox
jkleckner commented on a change in pull request #29496: URL: https://github.com/apache/spark/pull/29496#discussion_r495355337 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/LoggingPodStatusWatcher.scala ## @@ -177,4 +188,27 @@

[GitHub] [spark] marmbrus commented on a change in pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

2020-09-25 Thread GitBox
marmbrus commented on a change in pull request #29403: URL: https://github.com/apache/spark/pull/29403#discussion_r495355058 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala ## @@ -377,6 +378,29 @@ object ScalaReflection extends Sca

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699249683 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33745/ -

[GitHub] [spark] github-actions[bot] commented on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-699248438 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] dbtsai commented on a change in pull request #29873: [SPARK-32997][K8S] Support dynamic PVC creation and deletion in K8s driver

2020-09-25 Thread GitBox
dbtsai commented on a change in pull request #29873: URL: https://github.com/apache/spark/pull/29873#discussion_r495337096 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/MountVolumesFeatureStep.scala ## @@ -66,32 +66,30 @@ p

[GitHub] [spark] dbtsai commented on a change in pull request #29873: [SPARK-32997][K8S] Support dynamic PVC creation and deletion in K8s driver

2020-09-25 Thread GitBox
dbtsai commented on a change in pull request #29873: URL: https://github.com/apache/spark/pull/29873#discussion_r495337096 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/MountVolumesFeatureStep.scala ## @@ -66,32 +66,30 @@ p

[GitHub] [spark] AmplabJenkins commented on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699235889 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
SparkQA commented on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699235862 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33744/ ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699235889 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should throw earlier when got Spark UDAF Invalid arguments number erro

2020-09-25 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-699231076 **[Test build #129127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129127/testReport)** for PR 29054 at commit [`766c931`](https://github.com

[GitHub] [spark] dbtsai commented on pull request #29874: [SPARK-32998] Add ability to override default remote repos with inter…

2020-09-25 Thread GitBox
dbtsai commented on pull request #29874: URL: https://github.com/apache/spark/pull/29874#issuecomment-699229945 okay to test. This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
SparkQA commented on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699225633 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33744/ -

[GitHub] [spark] marmbrus commented on a change in pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

2020-09-25 Thread GitBox
marmbrus commented on a change in pull request #29403: URL: https://github.com/apache/spark/pull/29403#discussion_r495318035 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala ## @@ -739,6 +771,8 @@ object ScalaReflection extends Scal

[GitHub] [spark] dongjoon-hyun closed pull request #29873: [SPARK-32997][K8S] Support dynamic PVC creation and deletion in K8s driver

2020-09-25 Thread GitBox
dongjoon-hyun closed pull request #29873: URL: https://github.com/apache/spark/pull/29873 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #29873: [SPARK-32997][K8S] Support dynamic PVC creation and deletion in K8s driver

2020-09-25 Thread GitBox
dongjoon-hyun commented on pull request #29873: URL: https://github.com/apache/spark/pull/29873#issuecomment-699217663 Thank you, @viirya . Merged to master. This is an automated message from the Apache Git Service. To respon

[GitHub] [spark] viirya commented on pull request #29872: [SPARK-32996][Web-UI] Handle Option.empty v1.ExecutorSummary#peakMemoryMetrics

2020-09-25 Thread GitBox
viirya commented on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699208384 Thanks @shrutig. This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] AmplabJenkins commented on pull request #29877: [SPARK-27872][K8S][2.4] Fix executor service account inconsistency backport to branch-2.4

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29877: URL: https://github.com/apache/spark/pull/29877#issuecomment-699207424 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29877: [SPARK-27872][K8S][2.4] Fix executor service account inconsistency backport to branch-2.4

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29877: URL: https://github.com/apache/spark/pull/29877#issuecomment-699204532 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] SparkQA commented on pull request #29855: [SPARK-32915][CORE] Network-layer and shuffle RPC layer changes to support push shuffle blocks

2020-09-25 Thread GitBox
SparkQA commented on pull request #29855: URL: https://github.com/apache/spark/pull/29855#issuecomment-699207624 **[Test build #129126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129126/testReport)** for PR 29855 at commit [`85b0de8`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29877: [SPARK-27872][K8S][2.4] Fix executor service account inconsistency backport to branch-2.4

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29877: URL: https://github.com/apache/spark/pull/29877#issuecomment-699204532 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] nssalian opened a new pull request #29877: [SPARK-27872][K8S][2.4] Fix executor service account inconsistency backport to branch-2.4

2020-09-25 Thread GitBox
nssalian opened a new pull request #29877: URL: https://github.com/apache/spark/pull/29877 ### What changes were proposed in this pull request? Similar patch to #24748 but applied to the branch-2.4. Backporting the fix to releases 2.4.x. Please let me know if I missed some step

[GitHub] [spark] SparkQA commented on pull request #29872: [SPARK-32996][Web-UI] Handle Option.empty v1.ExecutorSummary#peakMemoryMetrics

2020-09-25 Thread GitBox
SparkQA commented on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699197271 **[Test build #129125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129125/testReport)** for PR 29872 at commit [`c27a699`](https://github.com

[GitHub] [spark] nssalian commented on pull request #29876: [SPARK-27872][K8S][2.4] Fix for #29844 breaking config changes

2020-09-25 Thread GitBox
nssalian commented on pull request #29876: URL: https://github.com/apache/spark/pull/29876#issuecomment-699197097 > The original commit is reverted via [32a28ff](https://github.com/apache/spark/commit/32a28ff8cee534cd5fa0da1bdcf5efdc46d8c830) . You can merge your original PR into here and

[GitHub] [spark] nssalian closed pull request #29876: [SPARK-27872][K8S][2.4] Fix for #29844 breaking config changes

2020-09-25 Thread GitBox
nssalian closed pull request #29876: URL: https://github.com/apache/spark/pull/29876 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] shrutig commented on pull request #29872: [SPARK-32996][Web-UI] Handle Option.empty v1.ExecutorSummary#peakMemoryMetrics

2020-09-25 Thread GitBox
shrutig commented on pull request #29872: URL: https://github.com/apache/spark/pull/29872#issuecomment-699191435 Ack. fixing the test This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699190618 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] SparkQA commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
SparkQA commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699190595 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33743/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699190614 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699190614 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29844: [SPARK-27872][K8s][2.4] Fix executor service account inconsistency

2020-09-25 Thread GitBox
dongjoon-hyun edited a comment on pull request #29844: URL: https://github.com/apache/spark/pull/29844#issuecomment-699185924 Yep. It looks like that. I understand the situation, @erikerlandson . The committers had better be more careful because the contributors make this kind of mistakes

[GitHub] [spark] dongjoon-hyun commented on pull request #29844: [SPARK-27872][K8s][2.4] Fix executor service account inconsistency

2020-09-25 Thread GitBox
dongjoon-hyun commented on pull request #29844: URL: https://github.com/apache/spark/pull/29844#issuecomment-699185924 Yep. It looks like that. I understand the situation, @erikerlandson . The committers had better be more careful because the contributors make this kind of mistakes sometim

[GitHub] [spark] sunchao commented on a change in pull request #29792: [SPARK-32858][SQL] UnwrapCastInBinaryComparison: support other numeric types

2020-09-25 Thread GitBox
sunchao commented on a change in pull request #29792: URL: https://github.com/apache/spark/pull/29792#discussion_r495279771 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparisonSuite.scala ## @@ -79,13 +106,65 @@ class U

[GitHub] [spark] erikerlandson edited a comment on pull request #29844: [SPARK-27872][K8s][2.4] Fix executor service account inconsistency

2020-09-25 Thread GitBox
erikerlandson edited a comment on pull request #29844: URL: https://github.com/apache/spark/pull/29844#issuecomment-699183582 @dongjoon-hyun the changes backported correspond to https://github.com/apache/spark/pull/24748, and SPARK-27872 was tagged as a bug fix (although a credible argumen

[GitHub] [spark] erikerlandson commented on pull request #29844: [SPARK-27872][K8s][2.4] Fix executor service account inconsistency

2020-09-25 Thread GitBox
erikerlandson commented on pull request #29844: URL: https://github.com/apache/spark/pull/29844#issuecomment-699183582 the changes backported correspond to https://github.com/apache/spark/pull/24748, and SPARK-27872 was tagged as a bug fix (although a credible argument could be made it was

[GitHub] [spark] dongjoon-hyun commented on pull request #29876: [SPARK-27872][K8S][2.4] Fix for #29844 breaking config changes

2020-09-25 Thread GitBox
dongjoon-hyun commented on pull request #29876: URL: https://github.com/apache/spark/pull/29876#issuecomment-699182480 The original commit is reverted via https://github.com/apache/spark/commit/32a28ff8cee534cd5fa0da1bdcf5efdc46d8c830 . You can merge your original PR into here and squish i

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29844: [SPARK-27872][K8s][2.4] Fix executor service account inconsistency

2020-09-25 Thread GitBox
dongjoon-hyun edited a comment on pull request #29844: URL: https://github.com/apache/spark/pull/29844#issuecomment-699180039 Thanks for swift replying, @nssalian . However, your addition PR isn't better than a clean revert in the perspective of downstreams. We had better have a clean and

[GitHub] [spark] dongjoon-hyun commented on pull request #29844: [SPARK-27872][K8s][2.4] Fix executor service account inconsistency

2020-09-25 Thread GitBox
dongjoon-hyun commented on pull request #29844: URL: https://github.com/apache/spark/pull/29844#issuecomment-699180769 Since @erikerlandson seems to be busy, I'll revert the problematic commit first. This is an automated mes

[GitHub] [spark] SparkQA commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
SparkQA commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699180805 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33743/ -

[GitHub] [spark] dongjoon-hyun commented on pull request #29844: [SPARK-27872][K8s][2.4] Fix executor service account inconsistency

2020-09-25 Thread GitBox
dongjoon-hyun commented on pull request #29844: URL: https://github.com/apache/spark/pull/29844#issuecomment-699180039 Thanks for swift replying, @nssalian . However, your addition PR isn't not better than a clean revert in the perspective of downstreams. We had better have a clean and cor

[GitHub] [spark] nssalian commented on pull request #29844: [SPARK-27872][K8s][2.4] Fix executor service account inconsistency

2020-09-25 Thread GitBox
nssalian commented on pull request #29844: URL: https://github.com/apache/spark/pull/29844#issuecomment-699175248 @dongjoon-hyun @erikerlandson I added another PR to fix these changes, easier than a revert. -> #29876 This i

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29842: [SPARK-32970][TEST] Reduce the runtime of an UT for SPARK-32019

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29842: URL: https://github.com/apache/spark/pull/29842#issuecomment-699171973 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29842: [SPARK-32970][TEST] Reduce the runtime of an UT for SPARK-32019

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29842: URL: https://github.com/apache/spark/pull/29842#issuecomment-699171973 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29876: Fix for #29844 breaking config changes

2020-09-25 Thread GitBox
AmplabJenkins removed a comment on pull request #29876: URL: https://github.com/apache/spark/pull/29876#issuecomment-699171203 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins commented on pull request #29876: Fix for #29844 breaking config changes

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29876: URL: https://github.com/apache/spark/pull/29876#issuecomment-699171728 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] dongjoon-hyun commented on pull request #29873: [SPARK-32997][K8S] Support dynamic PVC creation and deletion in K8s driver

2020-09-25 Thread GitBox
dongjoon-hyun commented on pull request #29873: URL: https://github.com/apache/spark/pull/29873#issuecomment-699171718 Could you review this, please, @dbtsai and @viirya ? This is an automated message from the Apache Git Serv

[GitHub] [spark] SparkQA removed a comment on pull request #29842: [SPARK-32970][TEST] Reduce the runtime of an UT for SPARK-32019

2020-09-25 Thread GitBox
SparkQA removed a comment on pull request #29842: URL: https://github.com/apache/spark/pull/29842#issuecomment-699056795 **[Test build #129120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129120/testReport)** for PR 29842 at commit [`d71ad45`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29842: [SPARK-32970][TEST] Reduce the runtime of an UT for SPARK-32019

2020-09-25 Thread GitBox
SparkQA commented on pull request #29842: URL: https://github.com/apache/spark/pull/29842#issuecomment-699171283 **[Test build #129120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129120/testReport)** for PR 29842 at commit [`d71ad45`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29876: Fix for #29844 breaking config changes

2020-09-25 Thread GitBox
AmplabJenkins commented on pull request #29876: URL: https://github.com/apache/spark/pull/29876#issuecomment-699171203 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] nssalian opened a new pull request #29876: Fix for #29844 breaking config changes

2020-09-25 Thread GitBox
nssalian opened a new pull request #29876: URL: https://github.com/apache/spark/pull/29876 #29844 introduced a breaking config change whilst backporting. Fixing that change. cc: @dongjoon-hyun This is an automated

[GitHub] [spark] xorz57 commented on pull request #26365: [SPARK-29720][CORE] Add linux condition to make ProcfsMetricsGetter more complete

2020-09-25 Thread GitBox
xorz57 commented on pull request #26365: URL: https://github.com/apache/spark/pull/26365#issuecomment-699168766 Is this why I keep getting the following warning on windows? ``` WARN ProcfsMetricsGetter: Exception when trying to compute pagesize, as a result reporting of ProcessTree me

[GitHub] [spark] SparkQA commented on pull request #29875: [SPARK-32999][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in TreeNode

2020-09-25 Thread GitBox
SparkQA commented on pull request #29875: URL: https://github.com/apache/spark/pull/29875#issuecomment-699168581 **[Test build #129124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129124/testReport)** for PR 29875 at commit [`3f14f68`](https://github.com

  1   2   3   4   5   6   7   >