[GitHub] [spark] AmplabJenkins commented on issue #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

AmplabJenkins commented on issue #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#issuecomment-497127582 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

SparkQA commented on issue #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#issuecomment-497127553 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distrib

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

dongjoon-hyun commented on a change in pull request #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#discussion_r288788976 ## File path: sql/catalyst/src/m

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

dongjoon-hyun commented on a change in pull request #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#discussion_r288788449 ## File path: sql/catalyst/src/m

[GitHub] [spark] AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497126054 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497126062 Test PASSed. Refer to this link for build result

[GitHub] [spark] AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497126062 Test PASSed. Refer to this link for build results (acces

[GitHub] [spark] AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497126054 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

SparkQA removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497061299 **[Test build #105927 has started](https://amplab.cs.ber

[GitHub] [spark] erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288787585 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kuber

[GitHub] [spark] SparkQA commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

SparkQA commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497125502 **[Test build #105927 has finished](https://amplab.cs.berkeley.ed

[GitHub] [spark] dongjoon-hyun closed pull request #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

dongjoon-hyun closed pull request #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732 This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

dongjoon-hyun commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-497123870 Also, merged to `branch-2.4`, too. -

[GitHub] [spark] dongjoon-hyun commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

dongjoon-hyun commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-497123427 Got it. Thank you, @vanzin . +1, LGTM. Merged to master. ---

[GitHub] [spark] vanzin commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

vanzin commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497122971 Changing to SPARK-27378 sounds good. This is an automated mess

[GitHub] [spark] SparkQA commented on issue #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

SparkQA commented on issue #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#issuecomment-497122716 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-

[GitHub] [spark] vanzin commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

vanzin commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-497122483 It's such a small change that it shouldn't affect anybody. (For comparison, the default value on so

[GitHub] [spark] SparkQA commented on issue #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

SparkQA commented on issue #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#issuecomment-497120267 **[Test build #105931 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105931/testReport)** for

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

dongjoon-hyun edited a comment on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-497119215 I checked `Oracle JDK8 / OpenJDK8 / IBM OpenJ9 JDK8` and additionally `Oracle JDK 11`

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497119236 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497119231 Merged build finished. Test PASSed. --

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

dongjoon-hyun edited a comment on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-497119215 I checked `Oracle JDK8 / OpenJDK8 / IBM OpenJ9` and additionally `Oracle JDK 11`. The

[GitHub] [spark] dongjoon-hyun commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

dongjoon-hyun commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-497119215 I checked `Oracle JDK8 / OpenJDK8 / IBM OpenJ9` and additionally `Oracle JDK 11`. The defaul

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497119231 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497119236 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

SparkQA removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497055052 **[Test build #105924 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497118697 **[Test build #105924 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105924/te

[GitHub] [spark] mengxr edited a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

mengxr edited a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-497111995 If a buffered writer is used, it doesn't flush data to output stream immediately.

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288773729 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] mengxr commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

mengxr commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-497111995 If a buffered writer is used, it doesn't flush data to output stream immediately. So the

[GitHub] [spark] tgravescs commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

tgravescs commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497110557 the other thing we could do is change this PR to be SPARK-27378 specific since its a subtask under the whole yarn support si

[GitHub] [spark] BryanCutler commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

BryanCutler commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-497109494 >@BryanCutler The issue is that without flush the reader side might not even see th

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288767931 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288767931 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] tgravescs commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

tgravescs commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497107140 yes this covers all of SPARK-27361. That item can be changed, it was the initial investigate item but yarn doesn't tell you

[GitHub] [spark] vanzin commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

vanzin commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497105207 Just to confirm: does this cover all of SPARK-27361? There's one item ("YARN can pass GPU info to Spark executor.") which doesn

[GitHub] [spark] AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497104115 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] mengxr commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

mengxr commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-497104464 @BryanCutler The issue is that without flush the reader side might not even see the data

[GitHub] [spark] AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497104100 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497104115 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497104100 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

SparkQA removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497055047 **[Test build #105925 has started](https://amplab.cs.berkeley.edu/jenkins/job/

[GitHub] [spark] SparkQA commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

SparkQA commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497103450 **[Test build #105925 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288761025 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernet

[GitHub] [spark] SparkQA removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

SparkQA removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497096070 **[Test build #105929 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105929/testRepor

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

AmplabJenkins commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497102675 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497102675 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497102681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] vanzin commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

vanzin commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-497102785 Looks OK but please explain the fix, not the problem, in the PR title / description.

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

AmplabJenkins commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497102681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] SparkQA commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

SparkQA commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497102576 **[Test build #105929 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105929/testReport)** f

[GitHub] [spark] SparkQA commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

SparkQA commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497101234 **[Test build #105930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] BryanCutler commented on a change in pull request #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

BryanCutler commented on a change in pull request #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#discussion_r288754136 ## File path: sql/core/src/main/scala/org/apache/spark/s

[GitHub] [spark] AmplabJenkins removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

AmplabJenkins removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497100532 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

AmplabJenkins commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497100543 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] BryanCutler commented on a change in pull request #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

BryanCutler commented on a change in pull request #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#discussion_r288751402 ## File path: sql/core/src/main/scala/org/apache/spark/s

[GitHub] [spark] AmplabJenkins commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

AmplabJenkins commented on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497100532 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

AmplabJenkins removed a comment on issue #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#issuecomment-497100543 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] vanzin commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

vanzin commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288756782 ## File path: core/src/test/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] dongjoon-hyun closed pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

dongjoon-hyun closed pull request #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719 This is an automated message from the Apache Git Servic

[GitHub] [spark] vanzin commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

vanzin commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288755923 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497098031 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497098015 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

AmplabJenkins commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497098031 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

AmplabJenkins commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497098015 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] SparkQA commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

SparkQA commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497096070 **[Test build #105929 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105929/testReport)** fo

[GitHub] [spark] vanzin commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

vanzin commented on issue #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497095552 retest this please This is an automated message from the Apach

[GitHub] [spark] SparkQA removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

SparkQA removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497088207 **[Test build #105928 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497094425 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497094417 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

SparkQA commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497094298 **[Test build #105928 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105928/

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497094425 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497094417 Merged build finished. Test PASSed. Thi

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288748277 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/v2/DataSourceV2SQLSu

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288747984 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSo

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288747443 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/PlanResolu

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497090103 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497090093 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497090093 Merged build finished. Test PASSed. Thi

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497090103 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288745143 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/PlanResolu

[GitHub] [spark] SparkQA commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

SparkQA commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497088207 **[Test build #105928 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105928/t

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288744071 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSo

[GitHub] [spark] tgravescs commented on a change in pull request #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

tgravescs commented on a change in pull request #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#discussion_r288743416 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Y

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288743228 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/b

[GitHub] [spark] erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288742039 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kuber

[GitHub] [spark] erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288741180 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kuber

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288740641 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] AmplabJenkins removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

AmplabJenkins removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497084343 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

AmplabJenkins removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497084349 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

AmplabJenkins commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497084349 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

AmplabJenkins commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497084343 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

SparkQA commented on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497083695 **[Test build #105922 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] SparkQA removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

SparkQA removed a comment on issue #24719: [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase URL: https://github.com/apache/spark/pull/24719#issuecomment-497012890 **[Test build #105922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

AmplabJenkins removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497082154 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288737831 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] AmplabJenkins commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

AmplabJenkins commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497082154 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

AmplabJenkins removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497082141 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

AmplabJenkins commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497082141 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] SparkQA removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

SparkQA removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497054977 **[Test build #105923 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105923/testRepor

<    1   2   3   4   5   6   7   8   9   10   >