[GitHub] [spark] AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497081015 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497081024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] SparkQA commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-05-29 Thread GitBox
SparkQA commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497081963 **[Test build #105923 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105923/testReport)** f

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288736507 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/s

[GitHub] [spark] AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497081024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497081015 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288735916 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/s

[GitHub] [spark] SparkQA removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497006810 **[Test build #105921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105921/te

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288735439 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuild

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
dongjoon-hyun commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288735439 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuild

[GitHub] [spark] SparkQA commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
SparkQA commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497080440 **[Test build #105921 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105921/testRepor

[GitHub] [spark] erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288730857 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kuber

[GitHub] [spark] erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
erikerlandson commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288728263 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kuber

[GitHub] [spark] AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497069427 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497069442 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497069442 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497069427 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288723469 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] SparkQA removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497061285 **[Test build #105926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] SparkQA removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497000296 **[Test build #105920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105920/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497068697 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497068688 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
SparkQA commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497068785 **[Test build #105920 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105920/testRepor

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497068697 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497068688 Merged build finished. Test PASSed. Thi

[GitHub] [spark] SparkQA commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
SparkQA commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497068566 **[Test build #105926 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105926/

[GitHub] [spark] dongjoon-hyun commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
dongjoon-hyun commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497064751 Thank you for pinging me, @rdblue . Yep. I'll take a look, too~ -

[GitHub] [spark] gaborgsomogyi commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

2019-05-29 Thread GitBox
gaborgsomogyi commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-497063432 @cloud-fan @gatorsmile you're driving the DSv2 effort and having lot of experience, so I would like to ask whether some

[GitHub] [spark] AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-497062089 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-497062085 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-497062085 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-497062089 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-496990121 **[Test build #105919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequ

[GitHub] [spark] SparkQA commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

2019-05-29 Thread GitBox
SparkQA commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497061299 **[Test build #105927 has started](https://amplab.cs.berkeley.edu

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497060571 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497060567 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec

2019-05-29 Thread GitBox
SparkQA commented on issue #24603: [SPARK-27706][SQL][WEBUI] Add SQL metrics of numOutputRows for BroadcastExchangeExec URL: https://github.com/apache/spark/pull/24603#issuecomment-497061335 **[Test build #105919 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
SparkQA commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497061285 **[Test build #105926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105926/t

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497060571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497060567 Merged build finished. Test PASSed. Thi

[GitHub] [spark] squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

2019-05-29 Thread GitBox
squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288714016 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

2019-05-29 Thread GitBox
squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288713829 ## File path: core/src/test/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

2019-05-29 Thread GitBox
squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288695928 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

2019-05-29 Thread GitBox
squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288698722 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

2019-05-29 Thread GitBox
squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288699085 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

2019-05-29 Thread GitBox
squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288698370 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation.

2019-05-29 Thread GitBox
squito commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r288677519 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/Executo

[GitHub] [spark] rdblue commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
rdblue commented on issue #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#issuecomment-497059525 +1 overall, just one minor style problem with boolean args to fix. I think this is ready to go. You might also men

[GitHub] [spark] AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497057608 Test PASSed. Refer to this link for build result

[GitHub] [spark] AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497057565 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497057576 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497057602 Merged build finished. Test PASSed. --

[GitHub] [spark] vanzin commented on a change in pull request #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
vanzin commented on a change in pull request #24634: [SPARK-27361][YARN] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#discussion_r288710015 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.

[GitHub] [spark] vanzin commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling

2019-05-29 Thread GitBox
vanzin commented on issue #24634: [SPARK-27361][YARN][test-hadoop3.2] YARN support for GPU-aware scheduling URL: https://github.com/apache/spark/pull/24634#issuecomment-497058065 retest this please This is an automated messag

[GitHub] [spark] AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497057602 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497057608 Test PASSed. Refer to this link for build results (acces

[GitHub] [spark] AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497057565 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497057576 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] rdblue commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
rdblue commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288710143 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceRes

[GitHub] [spark] skambha edited a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

2019-05-29 Thread GitBox
skambha edited a comment on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497056361 @dongjoon-hyun , I have pushed the changes to address the

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288710024 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernet

[GitHub] [spark] skambha commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

2019-05-29 Thread GitBox
skambha commented on issue #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#issuecomment-497056361 @dongjoon-hyun , I have pushed the changes to address the renames

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288706042 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernet

[GitHub] [spark] skambha commented on a change in pull request #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals

2019-05-29 Thread GitBox
skambha commented on a change in pull request #24593: [SPARK-27692][SQL] Add new optimizer rule to evaluate the deterministic scala udf only once if all inputs are literals URL: https://github.com/apache/spark/pull/24593#discussion_r288709384 ## File path: sql/catalyst/src/main/sc

[GitHub] [spark] rdblue commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
rdblue commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288709315 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scal

[GitHub] [spark] rdblue edited a comment on issue #24689: [SPARK-26946][SQL][FOLLOWUP] Require lookup function

2019-05-29 Thread GitBox
rdblue edited a comment on issue #24689: [SPARK-26946][SQL][FOLLOWUP] Require lookup function URL: https://github.com/apache/spark/pull/24689#issuecomment-497055324 Looks good to me. One minor comment: it doesn't look like Analyzer implementations created in BaseSessionStateBuilder actuall

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288709084 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497054275 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-493853645 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497054283 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497054247 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497054228 Merged build finished. Test PASSed. This is an

[GitHub] [spark] rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#discussion_r288706970 ## File path: sql/catalyst/src/main/scala/org/apache/spar

[GitHub] [spark] rdblue commented on issue #24689: [SPARK-26946][SQL][FOLLOWUP] Require lookup function

2019-05-29 Thread GitBox
rdblue commented on issue #24689: [SPARK-26946][SQL][FOLLOWUP] Require lookup function URL: https://github.com/apache/spark/pull/24689#issuecomment-497055324 Looks good to me. One minor comment: it doesn't look like Analyzer implementations created in BaseSessionStateBuilder actually overr

[GitHub] [spark] rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#discussion_r288692135 ## File path: sql/core/src/test/scala/org/apache/spark/sq

[GitHub] [spark] rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#discussion_r288700780 ## File path: sql/catalyst/src/main/scala/org/apache/spar

[GitHub] [spark] rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#discussion_r288705981 ## File path: sql/catalyst/src/main/scala/org/apache/spar

[GitHub] [spark] rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
rednaxelafx commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#discussion_r288701933 ## File path: sql/catalyst/src/main/scala/org/apache/spar

[GitHub] [spark] SparkQA commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

2019-05-29 Thread GitBox
SparkQA commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497055047 **[Test build #105925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-05-29 Thread GitBox
SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497055052 **[Test build #105924 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105924/tes

[GitHub] [spark] SparkQA commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-05-29 Thread GitBox
SparkQA commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497054977 **[Test build #105923 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105923/testReport)** fo

[GitHub] [spark] vanzin commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler

2019-05-29 Thread GitBox
vanzin commented on issue #24645: [SPARK-27773][Shuffle] add metrics for number of exceptions caught in ExternalShuffleBlockHandler URL: https://github.com/apache/spark/pull/24645#issuecomment-497054560 ok to test This is an

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288707710 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features

[GitHub] [spark] AmplabJenkins commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497054228 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497054247 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497054283 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-497054275 Merged build finished. Test PASSed. This

[GitHub] [spark] rdblue commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-05-29 Thread GitBox
rdblue commented on issue #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#issuecomment-497053324 Retest this please. This is an automated message from the Apac

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288706042 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernet

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288705075 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288704913 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288704815 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
liyinan926 commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288704228 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernet

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288704248 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288703148 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Kubernete

[GitHub] [spark] tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s

2019-05-29 Thread GitBox
tgravescs commented on a change in pull request #24703: [SPARK-27362][K8S] Resource Scheduling support for k8s URL: https://github.com/apache/spark/pull/24703#discussion_r288702763 ## File path: docs/configuration.md ## @@ -206,6 +206,13 @@ of the most common options to s

[GitHub] [spark] dongjoon-hyun commented on issue #24728: [SPARK-27737][SQL][FOLLOW-UP] Move sql/hive-thriftserver/v2.3.4 to sql/hive-thriftserver/v2.3.5

2019-05-29 Thread GitBox
dongjoon-hyun commented on issue #24728: [SPARK-27737][SQL][FOLLOW-UP] Move sql/hive-thriftserver/v2.3.4 to sql/hive-thriftserver/v2.3.5 URL: https://github.com/apache/spark/pull/24728#issuecomment-497048212 Hi, @juliuszsompolski . This PR is okay because it's clearly saying `move`, not

[GitHub] [spark] dongjoon-hyun commented on issue #24713: [SPARK-26192][MESOS][2.4] Retrieve enableFetcherCache option from submission for driver URIs

2019-05-29 Thread GitBox
dongjoon-hyun commented on issue #24713: [SPARK-26192][MESOS][2.4] Retrieve enableFetcherCache option from submission for driver URIs URL: https://github.com/apache/spark/pull/24713#issuecomment-497048471 Yep. Thanks. This is

[GitHub] [spark] dongjoon-hyun closed pull request #24713: [SPARK-26192][MESOS][2.4] Retrieve enableFetcherCache option from submission for driver URIs

2019-05-29 Thread GitBox
dongjoon-hyun closed pull request #24713: [SPARK-26192][MESOS][2.4] Retrieve enableFetcherCache option from submission for driver URIs URL: https://github.com/apache/spark/pull/24713 This is an automated message from the Apa

[GitHub] [spark] IvanVergiliev commented on a change in pull request #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

2019-05-29 Thread GitBox
IvanVergiliev commented on a change in pull request #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#discussion_r288700718 ## File path: sql/core/v1.2.1/src/main/scala/org/apache/spark/sql/ex

<    1   2   3   4   5   6   7   8   9   10   >