[GitHub] [spark] SparkQA commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
SparkQA commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594632158 **[Test build #119320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119320/testR

[GitHub] [spark] SparkQA commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
SparkQA commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594632225 **[Test build #119319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] AmplabJenkins commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594632953 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594632965 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594632953 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594632965 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] Ngone51 opened a new pull request #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF

2020-03-04 Thread GitBox
Ngone51 opened a new pull request #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF URL: https://github.com/apache/spark/pull/27794 ### What changes were proposed in this pull request? Use scala annotation @deprecate to deprecate untyped scala UDF.

[GitHub] [spark] SparkQA commented on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone

2020-03-04 Thread GitBox
SparkQA commented on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone URL: https://github.com/apache/spark/pull/27792#issuecomment-594637580 **[Test build #119322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119322/testReport

[GitHub] [spark] SparkQA commented on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF

2020-03-04 Thread GitBox
SparkQA commented on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF URL: https://github.com/apache/spark/pull/27794#issuecomment-594637715 **[Test build #119321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119321/testReport)** fo

[GitHub] [spark] Ngone51 commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode

2020-03-04 Thread GitBox
Ngone51 commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode URL: https://github.com/apache/spark/pull/27787#issuecomment-594637947 cc @jiangxb1987 @tgravescs This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF URL: https://github.com/apache/spark/pull/27794#issuecomment-594638320 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF URL: https://github.com/apache/spark/pull/27794#issuecomment-594638302 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone URL: https://github.com/apache/spark/pull/27792#issuecomment-594638447 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone URL: https://github.com/apache/spark/pull/27792#issuecomment-594638438 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins removed a comment on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone URL: https://github.com/apache/spark/pull/27792#issuecomment-594638447 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF URL: https://github.com/apache/spark/pull/27794#issuecomment-594638320 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone URL: https://github.com/apache/spark/pull/27792#issuecomment-594638438 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27794: [SPARK-31010][SQL][FOLLOW-UP] Deprecate untyped scala UDF URL: https://github.com/apache/spark/pull/27794#issuecomment-594638302 Merged build finished. Test PASSed. This is an

[GitHub] [spark] MaxGekk opened a new pull request #27795: [MINOR][SQL] Remove an ignored test from JsonSuite

2020-03-04 Thread GitBox
MaxGekk opened a new pull request #27795: [MINOR][SQL] Remove an ignored test from JsonSuite URL: https://github.com/apache/spark/pull/27795 ### What changes were proposed in this pull request? Remove ignored and outdated test `Type conflict in primitive field values (Ignored)` from Jso

[GitHub] [spark] sarutak commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode

2020-03-04 Thread GitBox
sarutak commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode URL: https://github.com/apache/spark/pull/27787#issuecomment-594640524 I've noticed that resource-aware scheduling doesn't support local mode so I'll work on that. I'll also change

[GitHub] [spark] SparkQA commented on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite

2020-03-04 Thread GitBox
SparkQA commented on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite URL: https://github.com/apache/spark/pull/27795#issuecomment-594641974 **[Test build #119323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119323/testReport)** for PR 27

[GitHub] [spark] SparkQA commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
SparkQA commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594642017 **[Test build #119324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119324/testReport)** for PR 27793 at co

[GitHub] [spark] AmplabJenkins commented on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite URL: https://github.com/apache/spark/pull/27795#issuecomment-594642581 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins commented on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite URL: https://github.com/apache/spark/pull/27795#issuecomment-594642569 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594642685 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//j

[GitHub] [spark] AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594642677 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594642677 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594642685 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins removed a comment on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite URL: https://github.com/apache/spark/pull/27795#issuecomment-594642569 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] AmplabJenkins removed a comment on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27795: [MINOR][SQL] Remove an ignored test from JsonSuite URL: https://github.com/apache/spark/pull/27795#issuecomment-594642581 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594644041 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//jo

[GitHub] [spark] AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594644026 Merged build finished. Test FAILed. This is an automated message from

[GitHub] [spark] SparkQA removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
SparkQA removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594642017 **[Test build #119324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119324/testReport)** for PR 27

[GitHub] [spark] SparkQA commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
SparkQA commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594644013 **[Test build #119324 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119324/testReport)** for PR 27793 at c

[GitHub] [spark] AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594644026 Merged build finished. Test FAILed. This is an automated messa

[GitHub] [spark] AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594644041 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] cloud-fan commented on issue #27627: [WIP][SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-03-04 Thread GitBox
cloud-fan commented on issue #27627: [WIP][SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow URL: https://github.com/apache/spark/pull/27627#issuecomment-594644908 I tried some queries locally but can't reproduce. Is it only a problem wi

[GitHub] [spark] SparkQA commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
SparkQA commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594646020 **[Test build #119325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119325/testReport)** for PR 27793 at co

[GitHub] [spark] tgravescs commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode

2020-03-04 Thread GitBox
tgravescs commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode URL: https://github.com/apache/spark/pull/27787#issuecomment-594646618 I"m confused by the description of this. local mode doesn't support custom resource scheduling ---

[GitHub] [spark] AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594646806 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594646806 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594646819 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//j

[GitHub] [spark] AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594646819 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] [spark] dongjoon-hyun commented on issue #27778: [SPARK-31027] [SQL] Refactor DataSourceStrategy to be more extendable

2020-03-04 Thread GitBox
dongjoon-hyun commented on issue #27778: [SPARK-31027] [SQL] Refactor DataSourceStrategy to be more extendable URL: https://github.com/apache/spark/pull/27778#issuecomment-594647549 Thank you all. Looks much better! This is a

[GitHub] [spark] AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594647945 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//jo

[GitHub] [spark] SparkQA commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
SparkQA commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594647912 **[Test build #119325 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119325/testReport)** for PR 27793 at c

[GitHub] [spark] AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594647936 Merged build finished. Test FAILed. This is an automated messa

[GitHub] [spark] SparkQA removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
SparkQA removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594646020 **[Test build #119325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119325/testReport)** for PR 27

[GitHub] [spark] AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594647936 Merged build finished. Test FAILed. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#issuecomment-594647945 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] dongjoon-hyun commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0

2020-03-04 Thread GitBox
dongjoon-hyun commented on issue #27746: [SPARK-30994][CORE] Update xerces to 2.12.0 URL: https://github.com/apache/spark/pull/27746#issuecomment-594648762 Thank you~ This is an automated message from the Apache Git Service.

[GitHub] [spark] yaooqinn commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
yaooqinn commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#discussion_r387789436 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -388,99 +397

[GitHub] [spark] SparkQA commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
SparkQA commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594649777 **[Test build #119308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] SparkQA removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
SparkQA removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594543021 **[Test build #119308 has started](https://amplab.cs.berkeley.edu/jenkins/job/

[GitHub] [spark] AmplabJenkins commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594650410 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594650403 Merged build finished. Test FAILed.

[GitHub] [spark] sarutak commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode

2020-03-04 Thread GitBox
sarutak commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode URL: https://github.com/apache/spark/pull/27787#issuecomment-594652204 I'll close this PR because resource-aware scheduling doesn't support local mode. I'll open another PR for supp

[GitHub] [spark] sarutak closed pull request #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode

2020-03-04 Thread GitBox
sarutak closed pull request #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode URL: https://github.com/apache/spark/pull/27787 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] onursatici commented on issue #27695: [SPARK-30949][K8S][CORE] decouple requests and parallelism on kubernetes drivers

2020-03-04 Thread GitBox
onursatici commented on issue #27695: [SPARK-30949][K8S][CORE] decouple requests and parallelism on kubernetes drivers URL: https://github.com/apache/spark/pull/27695#issuecomment-594652279 @dongjoon-hyun, what are the next steps? Does it look fine from your perspective? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594650403 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27786: [SPARK-31034][CORE] ShuffleBlockFetcherIterator should always create request for last block group URL: https://github.com/apache/spark/pull/27786#issuecomment-594650410 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] yaooqinn commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
yaooqinn commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#discussion_r387794271 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -388,99 +397

[GitHub] [spark] SparkQA commented on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone

2020-03-04 Thread GitBox
SparkQA commented on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone URL: https://github.com/apache/spark/pull/27768#issuecomment-594661203 **[Test build #119307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins commented on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone URL: https://github.com/apache/spark/pull/27768#issuecomment-594663806 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone URL: https://github.com/apache/spark/pull/27768#issuecomment-594663789 Merged build finished. Test PASSed. -

[GitHub] [spark] maryannxue commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
maryannxue commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#discussion_r387806656 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -388,99 +3

[GitHub] [spark] dongjoon-hyun commented on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0

2020-03-04 Thread GitBox
dongjoon-hyun commented on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0 URL: https://github.com/apache/spark/pull/27790#issuecomment-59445 Retest this please. This is an automated message fro

[GitHub] [spark] dongjoon-hyun commented on issue #27710: [SPARK-30960][SQL] add back the legacy date/timestamp format support in CSV/JSON parser

2020-03-04 Thread GitBox
dongjoon-hyun commented on issue #27710: [SPARK-30960][SQL] add back the legacy date/timestamp format support in CSV/JSON parser URL: https://github.com/apache/spark/pull/27710#issuecomment-594668548 Thank you all! This is an

[GitHub] [spark] dongjoon-hyun commented on issue #27780: [SPARK-31026] [SQL] [test-hive1.2] Parquet predicate pushdown on columns with dots

2020-03-04 Thread GitBox
dongjoon-hyun commented on issue #27780: [SPARK-31026] [SQL] [test-hive1.2] Parquet predicate pushdown on columns with dots URL: https://github.com/apache/spark/pull/27780#issuecomment-594669474 Please rebase to the master because the related sub-PR is merged now. -

[GitHub] [spark] SparkQA commented on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0

2020-03-04 Thread GitBox
SparkQA commented on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0 URL: https://github.com/apache/spark/pull/27790#issuecomment-594670456 **[Test build #119326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119326/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594671367 Merged build finished. Test FAILed. This is

[GitHub] [spark] SparkQA commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
SparkQA commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594671148 **[Test build #119320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119320/test

[GitHub] [spark] AmplabJenkins commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594671379 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0 URL: https://github.com/apache/spark/pull/27790#issuecomment-594671399 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0 URL: https://github.com/apache/spark/pull/27790#issuecomment-594671414 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] cloud-fan commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
cloud-fan commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594673924 retest this please This is an automated message

[GitHub] [spark] cloud-fan commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
cloud-fan commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#discussion_r387813602 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -388,99 +39

[GitHub] [spark] cloud-fan commented on a change in pull request #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone

2020-03-04 Thread GitBox
cloud-fan commented on a change in pull request #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone URL: https://github.com/apache/spark/pull/27792#discussion_r387814355 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] SparkQA commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
SparkQA commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594676463 **[Test build #119327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119327/testR

[GitHub] [spark] AmplabJenkins commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594677670 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594677684 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] cloud-fan commented on a change in pull request #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone

2020-03-04 Thread GitBox
cloud-fan commented on a change in pull request #27792: [SPARK-31038][SQL] Add checkValue for spark.sql.session.timeZone URL: https://github.com/apache/spark/pull/27792#discussion_r387816365 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] maryannxue commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names

2020-03-04 Thread GitBox
maryannxue commented on a change in pull request #27793: [SPARK-31037][SQL] refine AQE config names URL: https://github.com/apache/spark/pull/27793#discussion_r387819088 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -388,99 +3

[GitHub] [spark] huaxingao commented on issue #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR

2020-03-04 Thread GitBox
huaxingao commented on issue #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR URL: https://github.com/apache/spark/pull/27570#issuecomment-594682827 LGTM @zero323 You may want to delete the dir using ```unlink(modelPath)``` after testing model save/load, and delete the extra

[GitHub] [spark] AmplabJenkins removed a comment on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0 URL: https://github.com/apache/spark/pull/27790#issuecomment-594671414 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594671379 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone URL: https://github.com/apache/spark/pull/27768#issuecomment-594663789 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594671367 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone URL: https://github.com/apache/spark/pull/27768#issuecomment-594663806 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] AmplabJenkins removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594677670 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27790: [SPARK-30994][CORE][FOLLOWUP] Add core dep for xerces 2.12.0 URL: https://github.com/apache/spark/pull/27790#issuecomment-594671399 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA removed a comment on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone

2020-03-04 Thread GitBox
SparkQA removed a comment on issue #27768: [SPARK-31018][CORE] Deprecate support of multiple workers on the same host in Standalone URL: https://github.com/apache/spark/pull/27768#issuecomment-594530124 **[Test build #119307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] [spark] AmplabJenkins removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594677684 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] SparkQA removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys

2020-03-04 Thread GitBox
SparkQA removed a comment on issue #27772: [SPARK-31019][SQL] make it clear that people can deduplicate map keys URL: https://github.com/apache/spark/pull/27772#issuecomment-594632158 **[Test build #119320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1193

[GitHub] [spark] huaxingao commented on issue #27785: [SPARK-30934][ML][DOCS] Update ml-guide and ml-migration-guide for 3.0 release

2020-03-04 Thread GitBox
huaxingao commented on issue #27785: [SPARK-30934][ML][DOCS] Update ml-guide and ml-migration-guide for 3.0 release URL: https://github.com/apache/spark/pull/27785#issuecomment-594684927 Thanks @srowen for reviewing! Also cc @WeichenXu123 @zhengruifeng

[GitHub] [spark] dbtsai commented on issue #27778: [SPARK-31027] [SQL] Refactor DataSourceStrategy to be more extendable

2020-03-04 Thread GitBox
dbtsai commented on issue #27778: [SPARK-31027] [SQL] Refactor DataSourceStrategy to be more extendable URL: https://github.com/apache/spark/pull/27778#issuecomment-594688462 Also merged into 3.0 branch since it's just refactoring without introducing new feature. It will make code maintena

[GitHub] [spark] tgravescs commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode

2020-03-04 Thread GitBox
tgravescs commented on issue #27787: [SPARK-31035][WEBUI] Show assigned resource information for local mode URL: https://github.com/apache/spark/pull/27787#issuecomment-594692839 what is the use case for this in local mode? If you are just running on a single box you would generally have v

[GitHub] [spark] AmplabJenkins commented on issue #27780: [SPARK-31026] [SQL] [test-hive1.2] Parquet predicate pushdown on columns with dots

2020-03-04 Thread GitBox
AmplabJenkins commented on issue #27780: [SPARK-31026] [SQL] [test-hive1.2] Parquet predicate pushdown on columns with dots URL: https://github.com/apache/spark/pull/27780#issuecomment-594702075 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins removed a comment on issue #27780: [SPARK-31026] [SQL] [test-hive1.2] Parquet predicate pushdown on columns with dots

2020-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #27780: [SPARK-31026] [SQL] [test-hive1.2] Parquet predicate pushdown on columns with dots URL: https://github.com/apache/spark/pull/27780#issuecomment-594702042 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #27637: [SPARK-30874][SQL] Support Postgres Kerberos login in JDBC connector

2020-03-04 Thread GitBox
SparkQA commented on issue #27637: [SPARK-30874][SQL] Support Postgres Kerberos login in JDBC connector URL: https://github.com/apache/spark/pull/27637#issuecomment-594703086 **[Test build #119311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119311/testR

<    3   4   5   6   7   8   9   10   11   >