[GitHub] [spark] SparkQA removed a comment on pull request #29799: [SPARK-32933][PYTHON] Use keyword-only syntax for keyword_only methods

2020-09-21 Thread GitBox
SparkQA removed a comment on pull request #29799: URL: https://github.com/apache/spark/pull/29799#issuecomment-696528151 **[Test build #128968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128968/testReport)** for PR 29799 at commit [`2d30326`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29827: URL: https://github.com/apache/spark/pull/29827#issuecomment-696535805 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29799: [SPARK-32933][PYTHON] Use keyword-only syntax for keyword_only methods

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29799: URL: https://github.com/apache/spark/pull/29799#issuecomment-696528626 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29828: [SPARK-32948][SQL] Optimize to_json and from_json expression chain

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29828: URL: https://github.com/apache/spark/pull/29828#issuecomment-696528649 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
SparkQA removed a comment on pull request #29827: URL: https://github.com/apache/spark/pull/29827#issuecomment-696500528 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] AmplabJenkins commented on pull request #29799: [SPARK-32933][PYTHON] Use keyword-only syntax for keyword_only methods

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29799: URL: https://github.com/apache/spark/pull/29799#issuecomment-696539487 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29799: [SPARK-32933][PYTHON] Use keyword-only syntax for keyword_only methods

2020-09-21 Thread GitBox
SparkQA commented on pull request #29799: URL: https://github.com/apache/spark/pull/29799#issuecomment-696539156 **[Test build #128968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128968/testReport)** for PR 29799 at commit [`2d30326`](https://github.co

[GitHub] [spark] HeartSaVioR commented on pull request #29830: [SPARK-32960][SQL] Provide better exception on temporary view against DataFrameWriterV2

2020-09-21 Thread GitBox
HeartSaVioR commented on pull request #29830: URL: https://github.com/apache/spark/pull/29830#issuecomment-696537973 cc. @cloud-fan @rdblue as well, as the issue came from https://github.com/apache/spark/pull/29767#discussion_r490721265

[GitHub] [spark] AmplabJenkins commented on pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29827: URL: https://github.com/apache/spark/pull/29827#issuecomment-696536878 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
SparkQA commented on pull request #29827: URL: https://github.com/apache/spark/pull/29827#issuecomment-696535996 **[Test build #128958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128958/testReport)** for PR 29827 at commit [`5206561`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29827: URL: https://github.com/apache/spark/pull/29827#issuecomment-696535805 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
SparkQA commented on pull request #29827: URL: https://github.com/apache/spark/pull/29827#issuecomment-696535289 **[Test build #128959 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128959/testReport)** for PR 29827 at commit [`cb6aef4`](https://github.co

[GitHub] [spark] beliefer commented on a change in pull request #29754: [SPARK-32875][CORE][TEST] TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the general

2020-09-21 Thread GitBox
beliefer commented on a change in pull request #29754: URL: https://github.com/apache/spark/pull/29754#discussion_r492500277 ## File path: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala ## @@ -140,6 +140,16 @@ class TaskSchedulerImplSuite extends S

[GitHub] [spark] HeartSaVioR commented on a change in pull request #29830: [SPARK-32960][SQL] Provide better exception on temporary view against DataFrameWriterV2

2020-09-21 Thread GitBox
HeartSaVioR commented on a change in pull request #29830: URL: https://github.com/apache/spark/pull/29830#discussion_r492499380 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala ## @@ -204,6 +206,7 @@ final class DataFrameWriterV2[T] private[sql

[GitHub] [spark] viirya commented on a change in pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceStrategy and HiveTableScans

2020-09-21 Thread GitBox
viirya commented on a change in pull request #29831: URL: https://github.com/apache/spark/pull/29831#discussion_r492497787 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala ## @@ -158,6 +158,7 @@ object FileSourceStrategy

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29830: [SPARK-32960][SQL] Provide better exception on temporary view against DataFrameWriterV2

2020-09-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #29830: URL: https://github.com/apache/spark/pull/29830#discussion_r492497612 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala ## @@ -204,6 +206,7 @@ final class DataFrameWriterV2[T] private[s

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29822: [SPARK-32949][R][SQL] Add timestamp_seconds to SparkR

2020-09-21 Thread GitBox
dongjoon-hyun edited a comment on pull request #29822: URL: https://github.com/apache/spark/pull/29822#issuecomment-696531885 This PR aims the following. I thought you may want it. If you don't want, never mind. :) ``` ### Why are the changes needed? Feature parity. ``` --

[GitHub] [spark] beliefer commented on a change in pull request #29754: [SPARK-32875][CORE][TEST] TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the general

2020-09-21 Thread GitBox
beliefer commented on a change in pull request #29754: URL: https://github.com/apache/spark/pull/29754#discussion_r492497147 ## File path: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala ## @@ -140,6 +140,16 @@ class TaskSchedulerImplSuite extends S

[GitHub] [spark] dongjoon-hyun commented on pull request #29822: [SPARK-32949][R][SQL] Add timestamp_seconds to SparkR

2020-09-21 Thread GitBox
dongjoon-hyun commented on pull request #29822: URL: https://github.com/apache/spark/pull/29822#issuecomment-696531885 This PR aims the following. I thought we may want it. If you don't want, never mind. :) ``` ### Why are the changes needed? Feature parity. ``` --

[GitHub] [spark] Ngone51 commented on a change in pull request #29644: [SPARK-32598][Scheduler] Fix missing driver logs under UI App-Executors tab in standalone cluster mode

2020-09-21 Thread GitBox
Ngone51 commented on a change in pull request #29644: URL: https://github.com/apache/spark/pull/29644#discussion_r492496743 ## File path: core/src/test/scala/org/apache/spark/status/AppStatusListenerSuite.scala ## @@ -1400,19 +1400,20 @@ class AppStatusListenerSuite extends Sp

[GitHub] [spark] dongjoon-hyun closed pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
dongjoon-hyun closed pull request #29832: URL: https://github.com/apache/spark/pull/29832 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] viirya commented on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceStrategy and HiveTableScans

2020-09-21 Thread GitBox
viirya commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696530528 BTW, the PR title seems not correct at all? This adds partially pushed partition filters to explain result, not pushdown partition filter. --

[GitHub] [spark] viirya commented on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceStrategy and HiveTableScans

2020-09-21 Thread GitBox
viirya commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696529692 Could you add explain result before and after in the PR description? So it can be clearer to know what is changed. --

[GitHub] [spark] Ngone51 commented on a change in pull request #29644: [SPARK-32598][Scheduler] Fix missing driver logs under UI App-Executors tab in standalone cluster mode

2020-09-21 Thread GitBox
Ngone51 commented on a change in pull request #29644: URL: https://github.com/apache/spark/pull/29644#discussion_r492494702 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/StandaloneSchedulerBackend.scala ## @@ -231,6 +232,20 @@ private[spark] class Standa

[GitHub] [spark] viirya edited a comment on pull request #29587: [SPARK-32376][SQL] Make unionByName null-filling behavior work with struct columns

2020-09-21 Thread GitBox
viirya edited a comment on pull request #29587: URL: https://github.com/apache/spark/pull/29587#issuecomment-695811361 @maropu @dongjoon-hyun @cloud-fan Spent some time fixing the optimization issue https://github.com/apache/spark/pull/29587#discussion_r489466321. This is ready for review

[GitHub] [spark] viirya commented on a change in pull request #29812: [SPARK-32941][SQL] Optimize WithFields expression chain

2020-09-21 Thread GitBox
viirya commented on a change in pull request #29812: URL: https://github.com/apache/spark/pull/29812#discussion_r492425468 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/WithFields.scala ## @@ -17,16 +17,29 @@ package org.apache.spark.sql.

[GitHub] [spark] AmplabJenkins commented on pull request #29828: [SPARK-32948][SQL] Optimize to_json and from_json expression chain

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29828: URL: https://github.com/apache/spark/pull/29828#issuecomment-696528649 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29799: [SPARK-32933][PYTHON] Use keyword-only syntax for keyword_only methods

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29799: URL: https://github.com/apache/spark/pull/29799#issuecomment-696528626 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] zero323 commented on pull request #29822: [SPARK-32949][R][SQL] Add timestamp_seconds to SparkR

2020-09-21 Thread GitBox
zero323 commented on pull request #29822: URL: https://github.com/apache/spark/pull/29822#issuecomment-696528379 Thanks @dongjoon-hyun @HyukjinKwon About that: > Could you make a PR for the other functions of [SPARK-31797](https://issues.apache.org/jira/browse/SPARK-31797)?

[GitHub] [spark] SparkQA commented on pull request #29828: [SPARK-32948][SQL] Optimize to_json and from_json expression chain

2020-09-21 Thread GitBox
SparkQA commented on pull request #29828: URL: https://github.com/apache/spark/pull/29828#issuecomment-696528107 **[Test build #128967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128967/testReport)** for PR 29828 at commit [`6c3b15d`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29799: [SPARK-32933][PYTHON] Use keyword-only syntax for keyword_only methods

2020-09-21 Thread GitBox
SparkQA commented on pull request #29799: URL: https://github.com/apache/spark/pull/29799#issuecomment-696528151 **[Test build #128968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128968/testReport)** for PR 29799 at commit [`2d30326`](https://github.com

[GitHub] [spark] HyukjinKwon commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-09-21 Thread GitBox
HyukjinKwon commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-695861989 I think it's because `timestamp_seconds` can be the direct replacement in `cast(num as timestamp)` but arguably `timestamp_millis` and `timestamp_micros` are less common. So

[GitHub] [spark] dongjoon-hyun commented on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
dongjoon-hyun commented on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696527810 The failure is irrelevant to this PR. PRBuilder seems to meet a broken maven local repository on the server. > This patch fails build dependency tests. ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696526763 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/128

[GitHub] [spark] github-actions[bot] commented on pull request #28323: [SPARK-31551][CORE] Fix createSparkUser lost user's non-Hadoop credentials

2020-09-21 Thread GitBox
github-actions[bot] commented on pull request #28323: URL: https://github.com/apache/spark/pull/28323#issuecomment-695859780 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] viirya commented on a change in pull request #29587: [SPARK-32376][SQL] Make unionByName null-filling behavior work with struct columns

2020-09-21 Thread GitBox
viirya commented on a change in pull request #29587: URL: https://github.com/apache/spark/pull/29587#discussion_r491711425 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveUnion.scala ## @@ -17,29 +17,202 @@ package org.apache.spark.sq

[GitHub] [spark] AmplabJenkins removed a comment on pull request #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #23576: URL: https://github.com/apache/spark/pull/23576#issuecomment-531895012 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696526300 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
SparkQA removed a comment on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696525897 **[Test build #128966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128966/testReport)** for PR 29832 at commit [`c0fda02`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696526758 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] mundaym opened a new pull request #29819: [SPARK-27428][CORE][TEST] Increase receive buffer size used in Statsd…

2020-09-21 Thread GitBox
mundaym opened a new pull request #29819: URL: https://github.com/apache/spark/pull/29819 …SinkSuite. The socket receive buffer size set in this test was too small for the StatsdSinkSuite tests to run reliably on some systems. For a test in this suite to run reliably the buffer

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696526758 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
SparkQA commented on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696526745 **[Test build #128966 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128966/testReport)** for PR 29832 at commit [`c0fda02`](https://github.co

[GitHub] [spark] viirya commented on a change in pull request #29828: [SPARK-32948][SQL] Optimize to_json and from_json expression chain

2020-09-21 Thread GitBox
viirya commented on a change in pull request #29828: URL: https://github.com/apache/spark/pull/29828#discussion_r492491866 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Json.scala ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software F

[GitHub] [spark] dongjoon-hyun commented on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
dongjoon-hyun commented on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696526290 Thank you, @Ngone51 ! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696526300 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29795: [SPARK-32511][SQL][WIP] Add dropFields method to Column class

2020-09-21 Thread GitBox
SparkQA commented on pull request #29795: URL: https://github.com/apache/spark/pull/29795#issuecomment-695854224 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
SparkQA commented on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696525897 **[Test build #128966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128966/testReport)** for PR 29832 at commit [`c0fda02`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #29823: [SPARK-32718][SQL][3.0] Remove unnecessary keywords for interval units

2020-09-21 Thread GitBox
SparkQA removed a comment on pull request #29823: URL: https://github.com/apache/spark/pull/29823#issuecomment-696198262 **[Test build #128941 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128941/testReport)** for PR 29823 at commit [`bd54e0a`](https://gi

[GitHub] [spark] viirya commented on a change in pull request #29828: [SPARK-32948][SQL] Optimize to_json and from_json expression chain

2020-09-21 Thread GitBox
viirya commented on a change in pull request #29828: URL: https://github.com/apache/spark/pull/29828#discussion_r492491314 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Json.scala ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software F

[GitHub] [spark] Ngone51 commented on pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
Ngone51 commented on pull request #29832: URL: https://github.com/apache/spark/pull/29832#issuecomment-696525293 cc @dongjoon-hyun This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [spark] Ngone51 opened a new pull request #29832: [2.4][SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
Ngone51 opened a new pull request #29832: URL: https://github.com/apache/spark/pull/29832 ### What changes were proposed in this pull request? Only calculate the executorRunTime when taskStartTime > 0. Otherwise, set executorRunTime to 0. ### Why are the changes ne

[GitHub] [spark] sarutak commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
sarutak commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492490262 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome: +

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29830: [SPARK-32960][SQL] Provide better exception on temporary view against DataFrameWriterV2

2020-09-21 Thread GitBox
HyukjinKwon commented on a change in pull request #29830: URL: https://github.com/apache/spark/pull/29830#discussion_r492490010 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala ## @@ -204,6 +206,7 @@ final class DataFrameWriterV2[T] private[sql

[GitHub] [spark] SparkQA removed a comment on pull request #29825: [HOTFIX][2.4] Revert SPARK-32886

2020-09-21 Thread GitBox
SparkQA removed a comment on pull request #29825: URL: https://github.com/apache/spark/pull/29825#issuecomment-696218992 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29767: [SPARK-32896][SS] Add DataStreamWriter.table API

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29767: URL: https://github.com/apache/spark/pull/29767#issuecomment-695947893 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon edited a comment on pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

2020-09-21 Thread GitBox
HyukjinKwon edited a comment on pull request #29817: URL: https://github.com/apache/spark/pull/29817#issuecomment-696492521 @holdenk, why don't you take a look for the test failure since it blocks all changes in decommission in k8s, and you were involved mainly in the development there?

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
HyukjinKwon commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492488827 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome:

[GitHub] [spark] AmplabJenkins commented on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696503583 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] sarutak commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
sarutak commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492469526 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome: +

[GitHub] [spark] Ngone51 commented on pull request #29789: [SPARK-32898][CORE] Fix wrong executorRunTime when task killed before real start

2020-09-21 Thread GitBox
Ngone51 commented on pull request #29789: URL: https://github.com/apache/spark/pull/29789#issuecomment-696520839 Thanks! Sure, I'll backport it @dongjoon-hyun This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29828: [SPARK-32948][SQL] Optimize to_json and from_json expression chain

2020-09-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #29828: URL: https://github.com/apache/spark/pull/29828#discussion_r492486934 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Json.scala ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Sof

[GitHub] [spark] HyukjinKwon closed pull request #29821: [SPARK-32955][DOCS] An item in the navigation bar in the WebUI has a wrong link.

2020-09-21 Thread GitBox
HyukjinKwon closed pull request #29821: URL: https://github.com/apache/spark/pull/29821 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceStrategy and HiveTableScans

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696519937 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceStrategy and HiveTableScans

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696519937 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] HyukjinKwon commented on pull request #29821: [SPARK-32955][DOCS] An item in the navigation bar in the WebUI has a wrong link.

2020-09-21 Thread GitBox
HyukjinKwon commented on pull request #29821: URL: https://github.com/apache/spark/pull/29821#issuecomment-696519800 Merged to master. This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [spark] SparkQA commented on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceStrategy and HiveTableScans

2020-09-21 Thread GitBox
SparkQA commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696519602 **[Test build #128965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128965/testReport)** for PR 29831 at commit [`54b896a`](https://github.com

[GitHub] [spark] dongjoon-hyun commented on pull request #29737: [SPARK-32864][SQL] Support ORC forced positional evolution

2020-09-21 Thread GitBox
dongjoon-hyun commented on pull request #29737: URL: https://github.com/apache/spark/pull/29737#issuecomment-696503430 Thank you so much, @peter-toth and @cloud-fan . This is an automated message from the Apache Git Service.

[GitHub] [spark] sarutak commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
sarutak commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492484703 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome: +

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29828: [SPARK-32948][SQL] Optimize to_json and from_json expression chain

2020-09-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #29828: URL: https://github.com/apache/spark/pull/29828#discussion_r492484506 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Json.scala ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Sof

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29812: [SPARK-32941][SQL] Optimize WithFields expression chain

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29812: URL: https://github.com/apache/spark/pull/29812#issuecomment-696518033 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29812: [SPARK-32941][SQL] Optimize WithFields expression chain

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29812: URL: https://github.com/apache/spark/pull/29812#issuecomment-696518033 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceScanExec and HiveTableScanExec

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696517049 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/128

[GitHub] [spark] SparkQA commented on pull request #29812: [SPARK-32941][SQL] Optimize WithFields expression chain

2020-09-21 Thread GitBox
SparkQA commented on pull request #29812: URL: https://github.com/apache/spark/pull/29812#issuecomment-696517456 **[Test build #128955 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128955/testReport)** for PR 29812 at commit [`00acff9`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29812: [SPARK-32941][SQL] Optimize WithFields expression chain

2020-09-21 Thread GitBox
SparkQA removed a comment on pull request #29812: URL: https://github.com/apache/spark/pull/29812#issuecomment-696460856 **[Test build #128955 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128955/testReport)** for PR 29812 at commit [`00acff9`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceScanExec and HiveTableScanExec

2020-09-21 Thread GitBox
SparkQA removed a comment on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696514295 **[Test build #128964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128964/testReport)** for PR 29831 at commit [`3690a79`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceScanExec and HiveTableScanExec

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696517046 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492483254 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome

[GitHub] [spark] SparkQA commented on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
SparkQA commented on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696503296 **[Test build #128961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128961/testReport)** for PR 29703 at commit [`20491e0`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceScanExec and HiveTableScanExec

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696517046 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceScanExec and HiveTableScanExec

2020-09-21 Thread GitBox
SparkQA commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696517035 **[Test build #128964 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128964/testReport)** for PR 29831 at commit [`3690a79`](https://github.co

[GitHub] [spark] dongjoon-hyun closed pull request #29822: [SPARK-32949][R][SQL] Add timestamp_seconds to SparkR

2020-09-21 Thread GitBox
dongjoon-hyun closed pull request #29822: URL: https://github.com/apache/spark/pull/29822 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492467982 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492467982 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696502238 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696502238 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696502086 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696502086 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492467982 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome

[GitHub] [spark] SparkQA removed a comment on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
SparkQA removed a comment on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696469772 **[Test build #128956 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128956/testReport)** for PR 29703 at commit [`33594e1`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
SparkQA commented on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696501892 **[Test build #128960 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128960/testReport)** for PR 29703 at commit [`1e3507f`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #29703: [SPARK-32017][PYTHON][BUILD] Make Pyspark Hadoop 3.2+ Variant available in PyPI

2020-09-21 Thread GitBox
SparkQA commented on pull request #29703: URL: https://github.com/apache/spark/pull/29703#issuecomment-696501755 **[Test build #128956 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128956/testReport)** for PR 29703 at commit [`33594e1`](https://github.co

[GitHub] [spark] sarutak commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
sarutak commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492480542 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome: +

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceScanExec and HiveTableScanExec

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696514552 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceScanExec and HiveTableScanExec

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696514552 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] sarutak commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
sarutak commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492480542 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,44 @@ jobs: cd docs jekyll build + webui-tests-with-chrome: +

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #29827: URL: https://github.com/apache/spark/pull/29827#discussion_r492467363 ## File path: .github/workflows/build_and_test.yml ## @@ -273,6 +273,50 @@ jobs: cd docs jekyll build + webui-tests-with-chrome

[GitHub] [spark] SparkQA commented on pull request #29831: [SPARK-32351][SQL] pushdown partition filter in FileSourceScanExec and HiveTableScanExec

2020-09-21 Thread GitBox
SparkQA commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-696514295 **[Test build #128964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128964/testReport)** for PR 29831 at commit [`3690a79`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
AmplabJenkins commented on pull request #29827: URL: https://github.com/apache/spark/pull/29827#issuecomment-696500796 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29827: [SPARK-32957][INFRA] Add a GitHub Actions job to run WebUI tests with Chrome

2020-09-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29827: URL: https://github.com/apache/spark/pull/29827#issuecomment-696500796 This is an automated message from the Apache Git Service. To respond to the message, please log on

  1   2   3   4   5   6   7   8   >