[GitHub] [spark] AmplabJenkins removed a comment on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629982682 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122

[GitHub] [spark] AmplabJenkins commented on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629982670 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
SparkQA commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629982536 **[Test build #122785 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122785/testReport)** for PR 27066 at commit [`c99c086`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629943931 **[Test build #122785 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122785/testReport)** for PR 27066 at commit [`c99c086`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629982670 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] Fokko commented on a change in pull request #28554: [SPARK-31735][CORE] Include date/timestamp in the summary report

2020-05-17 Thread GitBox
Fokko commented on a change in pull request #28554: URL: https://github.com/apache/spark/pull/28554#discussion_r426402521 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala ## @@ -264,7 +264,10 @@ object StatFunctions extends Logging

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28208: URL: https://github.com/apache/spark/pull/28208#issuecomment-629978159 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28208: URL: https://github.com/apache/spark/pull/28208#issuecomment-629978159 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] Ngone51 commented on a change in pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-17 Thread GitBox
Ngone51 commented on a change in pull request #28370: URL: https://github.com/apache/spark/pull/28370#discussion_r426398285 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1829,7 +1901,58 @@ private[spark] class BlockManager( data.dispo

[GitHub] [spark] Ngone51 commented on a change in pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-17 Thread GitBox
Ngone51 commented on a change in pull request #28370: URL: https://github.com/apache/spark/pull/28370#discussion_r426398285 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1829,7 +1901,58 @@ private[spark] class BlockManager( data.dispo

[GitHub] [spark] SparkQA removed a comment on pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28208: URL: https://github.com/apache/spark/pull/28208#issuecomment-629890268 **[Test build #122771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122771/testReport)** for PR 28208 at commit [`2f9522f`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-17 Thread GitBox
SparkQA commented on pull request #28208: URL: https://github.com/apache/spark/pull/28208#issuecomment-629977464 **[Test build #122771 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122771/testReport)** for PR 28208 at commit [`2f9522f`](https://github.co

[GitHub] [spark] yaooqinn commented on a change in pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-17 Thread GitBox
yaooqinn commented on a change in pull request #28511: URL: https://github.com/apache/spark/pull/28511#discussion_r426394163 ## File path: sql/hive/benchmarks/InsertIntoHiveTableBenchmark-results.txt ## @@ -0,0 +1,11 @@ +Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS

[GitHub] [spark] yaooqinn commented on a change in pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-17 Thread GitBox
yaooqinn commented on a change in pull request #28511: URL: https://github.com/apache/spark/pull/28511#discussion_r426394163 ## File path: sql/hive/benchmarks/InsertIntoHiveTableBenchmark-results.txt ## @@ -0,0 +1,11 @@ +Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS

[GitHub] [spark] yaooqinn commented on a change in pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-17 Thread GitBox
yaooqinn commented on a change in pull request #28511: URL: https://github.com/apache/spark/pull/28511#discussion_r426394163 ## File path: sql/hive/benchmarks/InsertIntoHiveTableBenchmark-results.txt ## @@ -0,0 +1,11 @@ +Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28534: [SPARK-31710][SQL]Fix millisecond and microsecond convert to timestamp in to_timestamp

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-629976971 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28534: [SPARK-31710][SQL]Fix millisecond and microsecond convert to timestamp in to_timestamp

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-629976971 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28534: [SPARK-31710][SQL]Fix millisecond and microsecond convert to timestamp in to_timestamp

2020-05-17 Thread GitBox
SparkQA commented on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-629976178 **[Test build #122765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122765/testReport)** for PR 28534 at commit [`7d562f4`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28534: [SPARK-31710][SQL]Fix millisecond and microsecond convert to timestamp in to_timestamp

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-629885392 **[Test build #122765 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122765/testReport)** for PR 28534 at commit [`7d562f4`](https://gi

[GitHub] [spark] viirya commented on a change in pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-17 Thread GitBox
viirya commented on a change in pull request #28560: URL: https://github.com/apache/spark/pull/28560#discussion_r426391779 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -68,10 +76,23 @@ object NestedColumnAli

[GitHub] [spark] yaooqinn commented on a change in pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-17 Thread GitBox
yaooqinn commented on a change in pull request #28511: URL: https://github.com/apache/spark/pull/28511#discussion_r426394163 ## File path: sql/hive/benchmarks/InsertIntoHiveTableBenchmark-results.txt ## @@ -0,0 +1,11 @@ +Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS

[GitHub] [spark] viirya commented on a change in pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-17 Thread GitBox
viirya commented on a change in pull request #28560: URL: https://github.com/apache/spark/pull/28560#discussion_r426391779 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -68,10 +76,23 @@ object NestedColumnAli

[GitHub] [spark] viirya commented on a change in pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-17 Thread GitBox
viirya commented on a change in pull request #28560: URL: https://github.com/apache/spark/pull/28560#discussion_r426391779 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -68,10 +76,23 @@ object NestedColumnAli

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28558: URL: https://github.com/apache/spark/pull/28558#issuecomment-629968873 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28558: URL: https://github.com/apache/spark/pull/28558#issuecomment-629968873 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28558: URL: https://github.com/apache/spark/pull/28558#issuecomment-629964194 **[Test build #122790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122790/testReport)** for PR 28558 at commit [`8a43b8c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
SparkQA commented on pull request #28558: URL: https://github.com/apache/spark/pull/28558#issuecomment-629968746 **[Test build #122790 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122790/testReport)** for PR 28558 at commit [`8a43b8c`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28511: URL: https://github.com/apache/spark/pull/28511#issuecomment-629966971 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

2020-05-17 Thread GitBox
SparkQA commented on pull request #28511: URL: https://github.com/apache/spark/pull/28511#issuecomment-629966651 **[Test build #122791 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122791/testReport)** for PR 28511 at commit [`f7c6b51`](https://github.com

[GitHub] [spark] maropu commented on a change in pull request #28544: [SPARK-31387][test-maven] Handle unknown operation/session ID in HiveThriftServer2Listener

2020-05-17 Thread GitBox
maropu commented on a change in pull request #28544: URL: https://github.com/apache/spark/pull/28544#discussion_r426387696 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/HiveThriftServer2Listener.scala ## @@ -131,60 +132,81 @@ priv

[GitHub] [spark] AmplabJenkins commented on pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28511: URL: https://github.com/apache/spark/pull/28511#issuecomment-629966971 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] maropu commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
maropu commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629965293 Looks nice! Thanks for re-trigger the tests, @HyukjinKwon . This is an automated message from the Apache Git Serv

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28558: URL: https://github.com/apache/spark/pull/28558#issuecomment-629964663 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629964658 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629964658 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28558: URL: https://github.com/apache/spark/pull/28558#issuecomment-629964663 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
SparkQA commented on pull request #28558: URL: https://github.com/apache/spark/pull/28558#issuecomment-629964194 **[Test build #122790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122790/testReport)** for PR 28558 at commit [`8a43b8c`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
SparkQA commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629964220 **[Test build #122789 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122789/testReport)** for PR 28565 at commit [`49fa2a8`](https://github.com

[GitHub] [spark] maropu commented on pull request #28138: [SPARK-31366][DOCS][SQL] Add doc for the aggregation in SQL reference guide

2020-05-17 Thread GitBox
maropu commented on pull request #28138: URL: https://github.com/apache/spark/pull/28138#issuecomment-629964286 Ah, I forgot to close this Thanks, @srowen This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] maropu commented on a change in pull request #28544: [SPARK-31387][test-maven] Handle unknown operation/session ID in HiveThriftServer2Listener

2020-05-17 Thread GitBox
maropu commented on a change in pull request #28544: URL: https://github.com/apache/spark/pull/28544#discussion_r426385130 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/HiveThriftServer2Listener.scala ## @@ -131,60 +132,81 @@ priv

[GitHub] [spark] HyukjinKwon commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
HyukjinKwon commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629963202 retest this please This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28566: [SPARK-31746][YARN][TESTS] Show the actual error message in LocalityPlacementStrategySuite

2020-05-17 Thread GitBox
HyukjinKwon commented on a change in pull request #28566: URL: https://github.com/apache/spark/pull/28566#discussion_r426384293 ## File path: resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/LocalityPlacementStrategySuite.scala ## @@ -57,7 +62,6 @@ class Loca

[GitHub] [spark] MaxGekk commented on a change in pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
MaxGekk commented on a change in pull request #28558: URL: https://github.com/apache/spark/pull/28558#discussion_r426383975 ## File path: docs/sql-ref-datetime-pattern.md ## @@ -76,6 +76,57 @@ The count of pattern letters determines the format. - Year: The count of letters d

[GitHub] [spark] maropu commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
maropu commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629962468 It seems the failure above is not related to this PR. See: https://github.com/apache/spark/pull/28566 This is an

[GitHub] [spark] MaxGekk commented on a change in pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
MaxGekk commented on a change in pull request #28558: URL: https://github.com/apache/spark/pull/28558#discussion_r426383919 ## File path: docs/sql-ref-datetime-pattern.md ## @@ -76,6 +76,57 @@ The count of pattern letters determines the format. - Year: The count of letters d

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28566: [SPARK-31746][YARN][TESTS] Show the actual error message in LocalityPlacementStrategySuite

2020-05-17 Thread GitBox
HyukjinKwon commented on a change in pull request #28566: URL: https://github.com/apache/spark/pull/28566#discussion_r426383725 ## File path: resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/LocalityPlacementStrategySuite.scala ## @@ -57,7 +62,6 @@ class Loca

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28527: [SPARK-31709][SQL] Proper base path for database/table location when it is a relative path

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28527: URL: https://github.com/apache/spark/pull/28527#issuecomment-629961956 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28527: [SPARK-31709][SQL] Proper base path for database/table location when it is a relative path

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28527: URL: https://github.com/apache/spark/pull/28527#issuecomment-629961956 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] maropu commented on a change in pull request #28566: [SPARK-31746][YARN][TESTS] Show the actual error message in LocalityPlacementStrategySuite

2020-05-17 Thread GitBox
maropu commented on a change in pull request #28566: URL: https://github.com/apache/spark/pull/28566#discussion_r426383379 ## File path: resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/LocalityPlacementStrategySuite.scala ## @@ -57,7 +62,6 @@ class LocalityP

[GitHub] [spark] maropu edited a comment on pull request #28566: [SPARK-31746][YARN][TESTS] Show the actual error message in LocalityPlacementStrategySuite

2020-05-17 Thread GitBox
maropu edited a comment on pull request #28566: URL: https://github.com/apache/spark/pull/28566#issuecomment-629961204 @HyukjinKwon It seems branch-3.0 broken? ``` [info] Done packaging. [error] /home/jenkins/workspace/SparkPullRequestBuilder@4/resource-managers/yarn/src/test/scal

[GitHub] [spark] SparkQA removed a comment on pull request #28527: [SPARK-31709][SQL] Proper base path for database/table location when it is a relative path

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28527: URL: https://github.com/apache/spark/pull/28527#issuecomment-629879870 **[Test build #122764 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122764/testReport)** for PR 28527 at commit [`7d50c17`](https://gi

[GitHub] [spark] maropu commented on pull request #28566: [SPARK-31746][YARN][TESTS] Show the actual error message in LocalityPlacementStrategySuite

2020-05-17 Thread GitBox
maropu commented on pull request #28566: URL: https://github.com/apache/spark/pull/28566#issuecomment-629961204 @HyukjinKwon It seems branch-3.0 broken? ``` LocalityPlacementStrategySuite ``` This is an automated me

[GitHub] [spark] SparkQA commented on pull request #28527: [SPARK-31709][SQL] Proper base path for database/table location when it is a relative path

2020-05-17 Thread GitBox
SparkQA commented on pull request #28527: URL: https://github.com/apache/spark/pull/28527#issuecomment-629961162 **[Test build #122764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122764/testReport)** for PR 28527 at commit [`7d50c17`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629960072 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122

[GitHub] [spark] SparkQA commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
SparkQA commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629960051 **[Test build #122788 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122788/testReport)** for PR 28565 at commit [`49fa2a8`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629960066 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629957300 **[Test build #122788 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122788/testReport)** for PR 28565 at commit [`49fa2a8`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629960066 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28563: [SPARK-31743][CORE] Add spark_info metric into PrometheusResource

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28563: URL: https://github.com/apache/spark/pull/28563#issuecomment-629959652 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28563: [SPARK-31743][CORE] Add spark_info metric into PrometheusResource

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28563: URL: https://github.com/apache/spark/pull/28563#issuecomment-629959652 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] yaooqinn commented on a change in pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-17 Thread GitBox
yaooqinn commented on a change in pull request #28511: URL: https://github.com/apache/spark/pull/28511#discussion_r426381332 ## File path: sql/hive/benchmarks/InsertIntoHiveTableBenchmark-results.txt ## @@ -0,0 +1,11 @@ +Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS

[GitHub] [spark] SparkQA removed a comment on pull request #28563: [SPARK-31743][CORE] Add spark_info metric into PrometheusResource

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28563: URL: https://github.com/apache/spark/pull/28563#issuecomment-629892529 **[Test build #122773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122773/testReport)** for PR 28563 at commit [`a0aff8a`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28563: [SPARK-31743][CORE] Add spark_info metric into PrometheusResource

2020-05-17 Thread GitBox
SparkQA commented on pull request #28563: URL: https://github.com/apache/spark/pull/28563#issuecomment-629958887 **[Test build #122773 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122773/testReport)** for PR 28563 at commit [`a0aff8a`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28562: [SPARK-31742][TESTS] Increase the eventually time limit for Mino kdc in tests to fix flakiness

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28562: URL: https://github.com/apache/spark/pull/28562#issuecomment-629958185 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629957757 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28562: [SPARK-31742][TESTS] Increase the eventually time limit for Mino kdc in tests to fix flakiness

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28562: URL: https://github.com/apache/spark/pull/28562#issuecomment-629958185 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] yaooqinn commented on a change in pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-17 Thread GitBox
yaooqinn commented on a change in pull request #28511: URL: https://github.com/apache/spark/pull/28511#discussion_r426380145 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/execution/benchmark/InsertIntoHiveTableBenchmark.scala ## @@ -0,0 +1,144 @@ +/* + * Licensed

[GitHub] [spark] yaooqinn commented on a change in pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-17 Thread GitBox
yaooqinn commented on a change in pull request #28511: URL: https://github.com/apache/spark/pull/28511#discussion_r426379977 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/execution/benchmark/InsertIntoHiveTableBenchmark.scala ## @@ -0,0 +1,144 @@ +/* + * Licensed

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629957755 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629957755 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629957600 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28562: [SPARK-31742][TESTS] Increase the eventually time limit for Mino kdc in tests to fix flakiness

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28562: URL: https://github.com/apache/spark/pull/28562#issuecomment-629891408 **[Test build #122772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122772/testReport)** for PR 28562 at commit [`8bc6df2`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629900457 **[Test build #122775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122775/testReport)** for PR 27066 at commit [`7f76539`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629957600 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27066: [SPARK-31317][SQL] Add withFields method to Column

2020-05-17 Thread GitBox
SparkQA commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-629957411 **[Test build #122775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122775/testReport)** for PR 27066 at commit [`7f76539`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #28562: [SPARK-31742][TESTS] Increase the eventually time limit for Mino kdc in tests to fix flakiness

2020-05-17 Thread GitBox
SparkQA commented on pull request #28562: URL: https://github.com/apache/spark/pull/28562#issuecomment-629957428 **[Test build #122772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122772/testReport)** for PR 28562 at commit [`8bc6df2`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
SparkQA commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629957300 **[Test build #122788 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122788/testReport)** for PR 28565 at commit [`49fa2a8`](https://github.com

[GitHub] [spark] HyukjinKwon closed pull request #28566: [SPARK-31746][YARN][TESTS] Show the actual error message in LocalityPlacementStrategySuite

2020-05-17 Thread GitBox
HyukjinKwon closed pull request #28566: URL: https://github.com/apache/spark/pull/28566 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] HyukjinKwon commented on pull request #28566: [SPARK-31746][YARN][TESTS] Show the actual error message in LocalityPlacementStrategySuite

2020-05-17 Thread GitBox
HyukjinKwon commented on pull request #28566: URL: https://github.com/apache/spark/pull/28566#issuecomment-629956109 Merged to master and branch-3.0. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HyukjinKwon commented on pull request #28566: [SPARK-31746][YARN][TESTS] Show the actual error message in LocalityPlacementStrategySuite

2020-05-17 Thread GitBox
HyukjinKwon commented on pull request #28566: URL: https://github.com/apache/spark/pull/28566#issuecomment-629955913 I am going to merge this, see https://github.com/apache/spark/pull/28463#issuecomment-629955825. This is an

[GitHub] [spark] HyukjinKwon commented on pull request #28463: [SPARK-31399][CORE][test-hadoop3.2][test-java11] Support indylambda Scala closure in ClosureCleaner

2020-05-17 Thread GitBox
HyukjinKwon commented on pull request #28463: URL: https://github.com/apache/spark/pull/28463#issuecomment-629955825 `LocalityPlacementStrategySuite` was failed again. Potentially related. I am going to merge https://github.com/apache/spark/pull/28566 together. ---

[GitHub] [spark] maropu commented on pull request #28565: [SPARK-31102][SQL][3.0] Spark-sql fails to parse when contains comment

2020-05-17 Thread GitBox
maropu commented on pull request #28565: URL: https://github.com/apache/spark/pull/28565#issuecomment-629955864 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28463: [SPARK-31399][CORE][test-hadoop3.2][test-java11] Support indylambda Scala closure in ClosureCleaner

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28463: URL: https://github.com/apache/spark/pull/28463#issuecomment-629955676 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28463: [SPARK-31399][CORE][test-hadoop3.2][test-java11] Support indylambda Scala closure in ClosureCleaner

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28463: URL: https://github.com/apache/spark/pull/28463#issuecomment-629955676 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] cloud-fan closed pull request #28463: [SPARK-31399][CORE][test-hadoop3.2][test-java11] Support indylambda Scala closure in ClosureCleaner

2020-05-17 Thread GitBox
cloud-fan closed pull request #28463: URL: https://github.com/apache/spark/pull/28463 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] SparkQA commented on pull request #28463: [SPARK-31399][CORE][test-hadoop3.2][test-java11] Support indylambda Scala closure in ClosureCleaner

2020-05-17 Thread GitBox
SparkQA commented on pull request #28463: URL: https://github.com/apache/spark/pull/28463#issuecomment-629955235 **[Test build #122781 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122781/testReport)** for PR 28463 at commit [`978e60e`](https://github.co

[GitHub] [spark] cloud-fan commented on pull request #28463: [SPARK-31399][CORE][test-hadoop3.2][test-java11] Support indylambda Scala closure in ClosureCleaner

2020-05-17 Thread GitBox
cloud-fan commented on pull request #28463: URL: https://github.com/apache/spark/pull/28463#issuecomment-629955260 We don't have many critical changes after the last success build: https://github.com/apache/spark/pull/28463#issuecomment-624694820 The failed flaky tests are unrelated

[GitHub] [spark] SparkQA removed a comment on pull request #28463: [SPARK-31399][CORE][test-hadoop3.2][test-java11] Support indylambda Scala closure in ClosureCleaner

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28463: URL: https://github.com/apache/spark/pull/28463#issuecomment-629923433 **[Test build #122781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122781/testReport)** for PR 28463 at commit [`978e60e`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28561: [SPARK-31740][K8S][TESTS] Use github URL instead of a broken link

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28561: URL: https://github.com/apache/spark/pull/28561#issuecomment-629954597 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28561: [SPARK-31740][K8S][TESTS] Use github URL instead of a broken link

2020-05-17 Thread GitBox
SparkQA commented on pull request #28561: URL: https://github.com/apache/spark/pull/28561#issuecomment-629954432 **[Test build #122786 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122786/testReport)** for PR 28561 at commit [`77c2e14`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28561: [SPARK-31740][K8S][TESTS] Use github URL instead of a broken link

2020-05-17 Thread GitBox
SparkQA removed a comment on pull request #28561: URL: https://github.com/apache/spark/pull/28561#issuecomment-629949398 **[Test build #122786 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122786/testReport)** for PR 28561 at commit [`77c2e14`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28561: [SPARK-31740][K8S][TESTS] Use github URL instead of a broken link

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28561: URL: https://github.com/apache/spark/pull/28561#issuecomment-629954597 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #28558: [SPARK-31738][SQL][DOCS] Describe 'L' and 'M' month pattern letters

2020-05-17 Thread GitBox
cloud-fan commented on a change in pull request #28558: URL: https://github.com/apache/spark/pull/28558#discussion_r426375094 ## File path: docs/sql-ref-datetime-pattern.md ## @@ -76,6 +76,57 @@ The count of pattern letters determines the format. - Year: The count of letters

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28523: [SPARK-31706][SQL] add back the support of streaming update mode

2020-05-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28523: URL: https://github.com/apache/spark/pull/28523#issuecomment-629951647 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28523: [SPARK-31706][SQL] add back the support of streaming update mode

2020-05-17 Thread GitBox
AmplabJenkins commented on pull request #28523: URL: https://github.com/apache/spark/pull/28523#issuecomment-629951647 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] holdenk commented on a change in pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-17 Thread GitBox
holdenk commented on a change in pull request #28370: URL: https://github.com/apache/spark/pull/28370#discussion_r426374454 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1829,7 +1901,58 @@ private[spark] class BlockManager( data.dispo

[GitHub] [spark] SparkQA commented on pull request #28523: [SPARK-31706][SQL] add back the support of streaming update mode

2020-05-17 Thread GitBox
SparkQA commented on pull request #28523: URL: https://github.com/apache/spark/pull/28523#issuecomment-629951351 **[Test build #122787 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122787/testReport)** for PR 28523 at commit [`1955f01`](https://github.com

[GitHub] [spark] dongjoon-hyun closed pull request #28561: [SPARK-31740][K8S][TESTS] Use github URL instead of a broken link

2020-05-17 Thread GitBox
dongjoon-hyun closed pull request #28561: URL: https://github.com/apache/spark/pull/28561 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] holdenk commented on a change in pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-17 Thread GitBox
holdenk commented on a change in pull request #28370: URL: https://github.com/apache/spark/pull/28370#discussion_r426373154 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1829,7 +1901,58 @@ private[spark] class BlockManager( data.dispo

[GitHub] [spark] holdenk commented on a change in pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-17 Thread GitBox
holdenk commented on a change in pull request #28370: URL: https://github.com/apache/spark/pull/28370#discussion_r426372989 ## File path: core/src/test/scala/org/apache/spark/storage/BlockManagerDecommissionSuite.scala ## @@ -0,0 +1,106 @@ +/* + * Licensed to the Apache Softwa

  1   2   3   4   5   >