[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655143930 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

2020-07-07 Thread GitBox
dongjoon-hyun commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655161606 Thanks, @HeartSaVioR . @HyukjinKwon is also working on the Spark private list toward GitHub Action migration.

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655030684 **[Test build #125243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125243/testReport)** for PR 28986 at commit

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655162279 **[Test build #125243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125243/testReport)** for PR 28986 at commit

[GitHub] [spark] sarutak opened a new pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

2020-07-07 Thread GitBox
sarutak opened a new pull request #29029: URL: https://github.com/apache/spark/pull/29029 ### What changes were proposed in this pull request? This PR fixes a bug in `EvaluatePython`. `makeFromJava` in `EvaluatePython` create a type conversion function for some Java/Scala types.

[GitHub] [spark] maropu commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
maropu commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655178646 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] maropu commented on a change in pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

2020-07-07 Thread GitBox
maropu commented on a change in pull request #29029: URL: https://github.com/apache/spark/pull/29029#discussion_r451188931 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/python/EvaluatePython.scala ## @@ -198,7 +198,7 @@ object EvaluatePython {

[GitHub] [spark] maropu commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-07 Thread GitBox
maropu commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451194966 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/UDAQuerySuite.scala ## @@ -354,6 +367,12 @@ abstract class UDAQuerySuite

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

2020-07-07 Thread GitBox
dongjoon-hyun commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451200309 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] frankyin-factual commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-07 Thread GitBox
frankyin-factual commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655199003 @viirya @maropu Rebased with the current master. This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon commented on pull request #28912: [SPARK-32057][SQL][test-hive1.2][test-hadoop2.7] ExecuteStatement: cancel and close should not transiently ERROR

2020-07-07 Thread GitBox
HyukjinKwon commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-655209291 Merged to master and branch-3.0. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon closed pull request #28912: [SPARK-32057][SQL][test-hive1.2][test-hadoop2.7] ExecuteStatement: cancel and close should not transiently ERROR

2020-07-07 Thread GitBox
HyukjinKwon closed pull request #28912: URL: https://github.com/apache/spark/pull/28912 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] maropu commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-07 Thread GitBox
maropu commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451215944 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -678,6 +678,9 @@ object MapObjects {

[GitHub] [spark] maropu commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-07 Thread GitBox
maropu commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451215944 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -678,6 +678,9 @@ object MapObjects {

[GitHub] [spark] HeartSaVioR commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-07 Thread GitBox
HeartSaVioR commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655213867 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
HeartSaVioR commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655214166 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29023: local_connect_and_auth takes 2 arguments, 3 given

2020-07-07 Thread GitBox
HyukjinKwon commented on a change in pull request #29023: URL: https://github.com/apache/spark/pull/29023#discussion_r451220383 ## File path: python/pyspark/rdd.py ## @@ -141,7 +141,9 @@ def _parse_memory(s): def _load_from_socket(sock_info, serializer): -(sockfile,

[GitHub] [spark] HeartSaVioR commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-07 Thread GitBox
HeartSaVioR commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655213773 Thanks for the update. There's a case it goes up closer to 10x but not really 10x, which seems that 10x is safe one to apply.

[GitHub] [spark] HyukjinKwon commented on pull request #29023: local_connect_and_auth takes 2 arguments, 3 given

2020-07-07 Thread GitBox
HyukjinKwon commented on pull request #29023: URL: https://github.com/apache/spark/pull/29023#issuecomment-655213664 Thanks @dongjoon-hyun for cc'ing me. @Matzz can you show how you tested it? This is an automated message

[GitHub] [spark] SparkQA commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
SparkQA commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655220755 **[Test build #125272 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125272/testReport)** for PR 26935 at commit

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-07 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655220852 **[Test build #125273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125273/testReport)** for PR 28898 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-655221228 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655220786 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655221184 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655220786 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655214574 **[Test build #125272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125272/testReport)** for PR 26935 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655220794 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655221184 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

2020-07-07 Thread GitBox
SparkQA commented on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-655220909 **[Test build #125274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125274/testReport)** for PR 28647 at commit

[GitHub] [spark] leoluan2009 commented on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

2020-07-07 Thread GitBox
leoluan2009 commented on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-655221201 @wangyum @maropu should we support the global config for timeout? This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655237406 **[Test build #125264 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125264/testReport)** for PR 28986 at commit

[GitHub] [spark] wangyum commented on pull request #28991: [SPARK-26533][SQL][test-hive1.2][test-hadoop2.7] Support query auto timeout cancel on thriftserver

2020-07-07 Thread GitBox
wangyum commented on pull request #28991: URL: https://github.com/apache/spark/pull/28991#issuecomment-655237430 Yes. This will be useful for user to manage queries with SLA. @maropu @juliuszsompolski What do you think?

[GitHub] [spark] HeartSaVioR commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
HeartSaVioR commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655236672 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun closed pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

2020-07-07 Thread GitBox
dongjoon-hyun closed pull request #29027: URL: https://github.com/apache/spark/pull/29027 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655239961 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

2020-07-07 Thread GitBox
dongjoon-hyun commented on pull request #29027: URL: https://github.com/apache/spark/pull/29027#issuecomment-655240181 Merged to branch-3.0. Thank you, @viirya and @maropu . All UTs (including R) already passed in the current running Jenkins.

[GitHub] [spark] AmplabJenkins commented on pull request #29033: [SPARK-30703][SQL][FOLLOWUP] Update SqlBase.g4 invalid comment

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29033: URL: https://github.com/apache/spark/pull/29033#issuecomment-655240120 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
maropu commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655247394 Could you update the doc, too? https://github.com/apache/spark/blob/master/docs/sql-ref-literals.md#numeric-literal cc: @huaxingao

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655180245 **[Test build #125265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125265/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655257219 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655257219 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #25290: [SPARK-28551][SQL]Add a Checker Rule when CTAS SQL with LOCATION

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #25290: URL: https://github.com/apache/spark/pull/25290#issuecomment-655257280 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655266066 **[Test build #125291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125291/testReport)** for PR 27983 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655266127 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655258914 **[Test build #125291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125291/testReport)** for PR 27983 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

2020-07-07 Thread GitBox
HyukjinKwon commented on a change in pull request #29031: URL: https://github.com/apache/spark/pull/29031#discussion_r451267070 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1224,6 +1224,15 @@ object SQLConf { .booleanConf

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655266121 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655266121 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655271080 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655271080 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655275929 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-07 Thread GitBox
viirya commented on a change in pull request #29026: URL: https://github.com/apache/spark/pull/29026#discussion_r451275938 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Sum.scala ## @@ -58,39 +58,50 @@ case class Sum(child:

[GitHub] [spark] SparkQA removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655268405 **[Test build #125294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125294/testReport)** for PR 27983 at commit

[GitHub] [spark] viirya commented on a change in pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-07 Thread GitBox
viirya commented on a change in pull request #29026: URL: https://github.com/apache/spark/pull/29026#discussion_r451274175 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Sum.scala ## @@ -58,39 +58,50 @@ case class Sum(child:

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655275925 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-654563669 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655146156 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] sarutak commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

2020-07-07 Thread GitBox
sarutak commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-655146938 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655168079 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655168079 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655174556 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655167692 **[Test build #125263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125263/testReport)** for PR 28986 at commit

[GitHub] [spark] maropu commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-07 Thread GitBox
maropu commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451192558 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -678,6 +678,9 @@ object MapObjects {

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-07 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655184146 **[Test build #125246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125246/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655194334 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

2020-07-07 Thread GitBox
dongjoon-hyun commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r451201726 ## File path: pom.xml ## @@ -202,6 +202,9 @@ 0.15.1 org.fusesource.leveldbjni + + +0.5.0-beta Review comment:

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655194334 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

2020-07-07 Thread GitBox
dongjoon-hyun commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r451201889 ## File path: pom.xml ## @@ -3059,13 +3062,28 @@ 2.7.1 2.4 + Review comment: indentation?

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

2020-07-07 Thread GitBox
dongjoon-hyun commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r451201726 ## File path: pom.xml ## @@ -202,6 +202,9 @@ 0.15.1 org.fusesource.leveldbjni + + +0.5.0-beta Review comment:

[GitHub] [spark] frankyin-factual commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-07 Thread GitBox
frankyin-factual commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r451223742 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasingSuite.scala ## @@ -493,6 +491,156 @@

[GitHub] [spark] srowen commented on pull request #28971: [WIP][SPARK-29292][SPARK-30010][CORE] Let core compile for Scala 2.13

2020-07-07 Thread GitBox
srowen commented on pull request #28971: URL: https://github.com/apache/spark/pull/28971#issuecomment-655226094 Weird. I've seen the same test failure twice here, but it does not fail the normal 2.12 build for me locally. The order of test suite output seems ... intermingled? Kind of

[GitHub] [spark] srowen commented on pull request #28971: [WIP][SPARK-29292][SPARK-30010][CORE] Let core compile for Scala 2.13

2020-07-07 Thread GitBox
srowen commented on pull request #28971: URL: https://github.com/apache/spark/pull/28971#issuecomment-655226128 Jenkins retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655238461 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-655242039 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

2020-07-07 Thread GitBox
SparkQA commented on pull request #29027: URL: https://github.com/apache/spark/pull/29027#issuecomment-655243134 **[Test build #125245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125245/testReport)** for PR 29027 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655248805 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655248805 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-07 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655268405 **[Test build #125294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125294/testReport)** for PR 27983 at commit

[GitHub] [spark] LantaoJin edited a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

2020-07-07 Thread GitBox
LantaoJin edited a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-655272794 In the case I given in the description. If I add a LIMIT in the SQL ``` SELECT * FROM skewData1 AS data1 INNER JOIN ( SELECT skewData2.key2,

[GitHub] [spark] gengliangwang commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-07-07 Thread GitBox
gengliangwang commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-655278687 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-07 Thread GitBox
HyukjinKwon commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-655278572 If we're going to treat `void` as Hive legacy, let's don't support it at all and make the direction to deprecate and remove `NullType` away. If we'll still care and

[GitHub] [spark] ulysses-you commented on pull request #29033: [SPARK-30703][SQL][FOLLOWUP] Update SqlBase.g4 invalid comment

2020-07-07 Thread GitBox
ulysses-you commented on pull request #29033: URL: https://github.com/apache/spark/pull/29033#issuecomment-655278730 thanks for merging! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-07 Thread GitBox
SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655281050 **[Test build #125253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125253/testReport)** for PR 28998 at commit

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655281081 **[Test build #125287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125287/testReport)** for PR 29022 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655281107 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon edited a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-07 Thread GitBox
HyukjinKwon edited a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-655277714 Re: https://github.com/apache/spark/pull/28833#discussion_r448165084 Sorry I read the comments just now. So the decision here is we allow to parse `void` as

[GitHub] [spark] SparkQA removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655112434 **[Test build #125253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125253/testReport)** for PR 28998 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655281107 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] cloud-fan commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

2020-07-07 Thread GitBox
cloud-fan commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451280565 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTable.scala ## @@ -78,10 +92,44 @@ class InMemoryTable(

[GitHub] [spark] SparkQA removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655256843 **[Test build #125287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125287/testReport)** for PR 29022 at commit

[GitHub] [spark] HeartSaVioR commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-07 Thread GitBox
HeartSaVioR commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r451140973 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/SymmetricHashJoinStateManager.scala ## @@ -259,6 +269,9 @@

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

2020-07-07 Thread GitBox

[GitHub] [spark] viirya commented on a change in pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

2020-07-07 Thread GitBox
viirya commented on a change in pull request #29026: URL: https://github.com/apache/spark/pull/29026#discussion_r451145695 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Sum.scala ## @@ -58,39 +58,50 @@ case class Sum(child:

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-07 Thread GitBox
SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655137323 **[Test build #125257 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125257/testReport)** for PR 28975 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655137361 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655129657 **[Test build #125257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125257/testReport)** for PR 28975 at commit

[GitHub] [spark] SparkQA commented on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

2020-07-07 Thread GitBox
SparkQA commented on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-655137842 **[Test build #125226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125226/testReport)** for PR 29012 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655137371 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29012: [SPARK-31710][SQL][FOLLOWUP] Allow cast numeric to timestamp by default

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #29012: URL: https://github.com/apache/spark/pull/29012#issuecomment-654884556 **[Test build #125226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125226/testReport)** for PR 29012 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655141320 This is an automated message from the Apache Git Service. To respond to the message, please log on to

  1   2   3   4   5   6   7   8   9   10   >