[GitHub] [spark] SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511899074 **[Test build #107747 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] AmplabJenkins removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AmplabJenkins removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511898351 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511898291 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

SparkQA removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511819047 **[Test build #107740 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107740/testReport)** f

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511898315 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AmplabJenkins removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511898355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304015757 ## File path: sql/core/src/main/scala/org/apache/spark/s

[GitHub] [spark] AmplabJenkins commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

AmplabJenkins commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511898281 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511898291 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AmplabJenkins commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511898355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AmplabJenkins commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511898351 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

AmplabJenkins commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511898292 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511898315 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304015169 ## File path: sql/core/src/main/scala/org/apache/spark/s

[GitHub] [spark] SparkQA commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

SparkQA commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511897700 **[Test build #107740 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107740/testReport)** for PR 2

[GitHub] [spark] AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511895669 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511895660 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

SparkQA commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511896019 **[Test build #107746 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107746/testReport)

[GitHub] [spark] SparkQA removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

SparkQA removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511886988 **[Test build #107745 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107745/tes

[GitHub] [spark] AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511895669 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

AmplabJenkins removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511053894 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511895660 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] holdenk commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

holdenk commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511895621 Jenkins ok to test This is an automated message from th

[GitHub] [spark] holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API

holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#discussion_r304010743 ## File path: python/pyspark/sql/catalog.py ## @@ -138,6 +139,78 @@ def listColumns(s

[GitHub] [spark] holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API

holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#discussion_r304011185 ## File path: python/pyspark/sql/catalog.py ## @@ -138,6 +139,78 @@ def listColumns(s

[GitHub] [spark] holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API

holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#discussion_r304011700 ## File path: python/pyspark/sql/catalog.py ## @@ -138,6 +139,78 @@ def listColumns(s

[GitHub] [spark] SparkQA commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

SparkQA commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511895552 **[Test build #107745 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107745/testReport

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303960037 ## File path: core/src/main/scala/org/apache/spark/deploy/master/Master.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303999029 ## File path: core/src/main/scala/org/apache/spark/resource/ResourceUtils.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303922832 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scal

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303951072 ## File path: core/src/main/scala/org/apache/spark/deploy/master/ExecutorDesc.

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303937483 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303929005 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scal

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303998177 ## File path: core/src/main/scala/org/apache/spark/resource/ResourceUtils.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303986055 ## File path: core/src/main/scala/org/apache/spark/deploy/master/WorkerInfo.sca

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303907877 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r304010541 ## File path: core/src/test/scala/org/apache/spark/SparkContextSuite.scala ###

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303994207 ## File path: core/src/main/scala/org/apache/spark/resource/ResourceUtils.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r304007299 ## File path: core/src/main/scala/org/apache/spark/resource/ResourceUtils.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303931387 ## File path: core/src/main/scala/org/apache/spark/resource/ResourceUtils.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303939553 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303965288 ## File path: core/src/main/scala/org/apache/spark/deploy/master/WorkerInfo.sca

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303922559 ## File path: docs/configuration.md ## @@ -193,6 +193,18 @@ of the mo

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303941781 ## File path: core/src/main/scala/org/apache/spark/deploy/ApplicationDescripti

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r304007440 ## File path: core/src/main/scala/org/apache/spark/resource/ResourceUtils.scala

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303921431 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ##

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303920726 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ##

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r304010722 ## File path: core/src/test/scala/org/apache/spark/SparkContextSuite.scala ###

[GitHub] [spark] tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

tgravescs commented on a change in pull request #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#discussion_r303952636 ## File path: core/src/main/scala/org/apache/spark/deploy/master/DriverInfo.sca

[GitHub] [spark] gatorsmile commented on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner

gatorsmile commented on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner URL: https://github.com/apache/spark/pull/25111#issuecomment-511894207 cc @maryannxue @hvanhovell This is

[GitHub] [spark] cloud-fan edited a comment on issue #24991: [SPARK-28188] Materialize Dataframe API

cloud-fan edited a comment on issue #24991: [SPARK-28188] Materialize Dataframe API URL: https://github.com/apache/spark/pull/24991#issuecomment-511712741 I've spent more time understanding the use case, and think table cache should be a better choice here 1. disk vs memory: you can set

[GitHub] [spark] AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511889265 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511889254 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511889265 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] SparkQA commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

SparkQA commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511886988 **[Test build #107745 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107745/testReport)

[GitHub] [spark] vanzin commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

vanzin commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511886374 retest this please This is an automated message from the

[GitHub] [spark] rdblue commented on issue #24991: [SPARK-28188] Materialize Dataframe API

rdblue commented on issue #24991: [SPARK-28188] Materialize Dataframe API URL: https://github.com/apache/spark/pull/24991#issuecomment-511885931 @cloud-fan, I wasn't aware of #24499. Serving cache blocks from the shuffle service sounds like it could be a good alternative solution. I like th

[GitHub] [spark] DylanGuedes commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

DylanGuedes commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-511884689 @dongjoon-hyun Sorry for taking too long on this one. I'll update the tests with the new JIRAs/comments and finish it until tomorrow. -

[GitHub] [spark] DylanGuedes commented on a change in pull request #24881: [SPARK-23160][SQL][TEST] Port window.sql

DylanGuedes commented on a change in pull request #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#discussion_r303999016 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala ## @@ -495,6 +495,32

[GitHub] [spark] AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511882949 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511882939 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

SparkQA commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511883758 **[Test build #107744 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107744/testRe

[GitHub] [spark] SparkQA commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

SparkQA commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511883729 **[Test build #107743 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107743/testReport)** for PR 251

[GitHub] [spark] dongjoon-hyun commented on issue #24989: [SPARK-27959][YARN][test-hadoop3.2] Change YARN resource configs to use .amount

dongjoon-hyun commented on issue #24989: [SPARK-27959][YARN][test-hadoop3.2] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511883099 Shall we test this with `hadoop-2.7` profile, too? ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

AmplabJenkins removed a comment on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511882865 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511882949 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511882939 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

AmplabJenkins commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511882865 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins removed a comment on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

AmplabJenkins removed a comment on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511882860 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

AmplabJenkins commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511882860 Merged build finished. Test PASSed. This is an automated messag

[GitHub] [spark] dongjoon-hyun commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

dongjoon-hyun commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511880531 Retest this please. This is an automated mes

[GitHub] [spark] dongjoon-hyun commented on issue #24779: [SPARK-27929][SQL] Make percentile function receive frq of double

dongjoon-hyun commented on issue #24779: [SPARK-27929][SQL] Make percentile function receive frq of double URL: https://github.com/apache/spark/pull/24779#issuecomment-511879804 Gentle ping. This is an automated message from

[GitHub] [spark] dongjoon-hyun commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

dongjoon-hyun commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-511879098 Gentle ping. This is an automated message from the Apache Git Service. T

[GitHub] [spark] dongjoon-hyun closed pull request #25170: [SPARK-28343][FOLLOW-UP][SQL][TEST] Enable spark.sql.function.preferIntegralDivision for PostgreSQL testing

dongjoon-hyun closed pull request #25170: [SPARK-28343][FOLLOW-UP][SQL][TEST] Enable spark.sql.function.preferIntegralDivision for PostgreSQL testing URL: https://github.com/apache/spark/pull/25170 This is an automated messa

[GitHub] [spark] dongjoon-hyun commented on issue #25167: [SPARK-27485] EnsureRequirements.reorder should handle duplicate expressions gracefully

dongjoon-hyun commented on issue #25167: [SPARK-27485] EnsureRequirements.reorder should handle duplicate expressions gracefully URL: https://github.com/apache/spark/pull/25167#issuecomment-511872595 Thank you for pinging me, @cloud-fan . Hi, @hvanhovell . Could you make a backporting PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

AmplabJenkins removed a comment on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#issuecomment-511871446 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

AmplabJenkins removed a comment on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#issuecomment-511871437 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

AmplabJenkins commented on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#issuecomment-511871446 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] dongjoon-hyun commented on issue #25165: [SPARK-28201][SQL][TEST][FOLLOWUP] Fix Integration test suite according to the new exception message

dongjoon-hyun commented on issue #25165: [SPARK-28201][SQL][TEST][FOLLOWUP] Fix Integration test suite according to the new exception message URL: https://github.com/apache/spark/pull/25165#issuecomment-511871696 Thank you, @cloud-fan and @mgaido91 ! ---

[GitHub] [spark] AmplabJenkins commented on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

AmplabJenkins commented on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#issuecomment-511871437 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

SparkQA removed a comment on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#issuecomment-511825946 **[Test build #107742 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA commented on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

SparkQA commented on issue #25047: [WIP][SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone URL: https://github.com/apache/spark/pull/25047#issuecomment-511870942 **[Test build #107742 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107

[GitHub] [spark] AngersZhuuuu commented on issue #24228: [SPARK-27280][SQL]infer more filter from join or condition

AngersZh commented on issue #24228: [SPARK-27280][SQL]infer more filter from join or condition URL: https://github.com/apache/spark/pull/24228#issuecomment-511862618 #24973 I want to do the same thing ... This is an auto

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #24228: [SPARK-27280][SQL]infer more filter from join or condition

AngersZh commented on a change in pull request #24228: [SPARK-27280][SQL]infer more filter from join or condition URL: https://github.com/apache/spark/pull/24228#discussion_r303969795 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.sc

[GitHub] [spark] AngersZhuuuu commented on issue #24575: [SPARK-27670][SQL]Add HA for HiveThriftServer2 based on HiveServer2.

AngersZh commented on issue #24575: [SPARK-27670][SQL]Add HA for HiveThriftServer2 based on HiveServer2. URL: https://github.com/apache/spark/pull/24575#issuecomment-511860106 Add zk method in HiveServer2 and call this with reflection is ok。

[GitHub] [spark] AngersZhuuuu commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AngersZh commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511846779 > Hi, @AngersZh, could you show us use cases for this extension and add them in the PR description? (I think this is one of

[GitHub] [spark] srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler

srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler URL: https://github.com/apache/spark/pull/25160#discussion_r303927234 ## File path: mllib/src/test/scala/org/apache/spark/ml/feature/RobustScalerSuite.scala ## @@ -0,0 +1,209 @@

[GitHub] [spark] srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler

srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler URL: https://github.com/apache/spark/pull/25160#discussion_r303923456 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/RobustScaler.scala ## @@ -0,0 +1,290 @@ +/* +

[GitHub] [spark] AmplabJenkins removed a comment on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

AmplabJenkins removed a comment on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector URL: https://github.com/apache/spark/pull/25135#issuecomment-511830351 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

AmplabJenkins removed a comment on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector URL: https://github.com/apache/spark/pull/25135#issuecomment-511830341 Merged build finished. Test PASSed. T

[GitHub] [spark] srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler

srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler URL: https://github.com/apache/spark/pull/25160#discussion_r303925618 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/RobustScaler.scala ## @@ -0,0 +1,290 @@ +/* +

[GitHub] [spark] srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler

srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler URL: https://github.com/apache/spark/pull/25160#discussion_r303926393 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/StandardScaler.scala ## @@ -245,4 +224,85 @@

[GitHub] [spark] srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler

srowen commented on a change in pull request #25160: [SPARK-28399][ML] implement RobustScaler URL: https://github.com/apache/spark/pull/25160#discussion_r303925218 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/RobustScaler.scala ## @@ -0,0 +1,290 @@ +/* +

[GitHub] [spark] SparkQA removed a comment on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

SparkQA removed a comment on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector URL: https://github.com/apache/spark/pull/25135#issuecomment-511819058 **[Test build #107739 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107739

[GitHub] [spark] AmplabJenkins commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

AmplabJenkins commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector URL: https://github.com/apache/spark/pull/25135#issuecomment-511830341 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

AmplabJenkins commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector URL: https://github.com/apache/spark/pull/25135#issuecomment-511830351 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] SparkQA commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

SparkQA commented on issue #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector URL: https://github.com/apache/spark/pull/25135#issuecomment-511830197 **[Test build #107739 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107739/testRe

[GitHub] [spark] srowen closed pull request #24793: [SPARK-27944][ML] Unify the behavior of checking empty output column names

srowen closed pull request #24793: [SPARK-27944][ML] Unify the behavior of checking empty output column names URL: https://github.com/apache/spark/pull/24793 This is an automated message from the Apache Git Service. To respo

[GitHub] [spark] gatorsmile commented on issue #25167: [SPARK-27485] EnsureRequirements.reorder should handle duplicate expressions gracefully

gatorsmile commented on issue #25167: [SPARK-27485] EnsureRequirements.reorder should handle duplicate expressions gracefully URL: https://github.com/apache/spark/pull/25167#issuecomment-511827932 https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Compile/job/spark-branch-2.4-compile

[GitHub] [spark] srowen commented on issue #24793: [SPARK-27944][ML] Unify the behavior of checking empty output column names

srowen commented on issue #24793: [SPARK-27944][ML] Unify the behavior of checking empty output column names URL: https://github.com/apache/spark/pull/24793#issuecomment-511826897 Merged to master This is an automated message

<    1   2   3   4   5   6   7   8   9   >