[GitHub] [spark] SparkQA commented on pull request #30912: [SPARK-32968][SQL] Prune unnecessary columns from CsvToStructs

2020-12-28 Thread GitBox
SparkQA commented on pull request #30912: URL: https://github.com/apache/spark/pull/30912#issuecomment-751622345 **[Test build #133433 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133433/testReport)** for PR 30912 at commit [`55fb78f`](https://github.com

[GitHub] [spark] cloud-fan commented on a change in pull request #30923: [SPARK-33909][SQL] Check rand functions seed is legal at analyer side

2020-12-28 Thread GitBox
cloud-fan commented on a change in pull request #30923: URL: https://github.com/apache/spark/pull/30923#discussion_r549251683 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala ## @@ -215,6 +215,10 @@ trait CheckAnalysis extend

[GitHub] [spark] SparkQA commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

2020-12-28 Thread GitBox
SparkQA commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751622626 **[Test build #133434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133434/testReport)** for PR 30841 at commit [`a495f6d`](https://github.com

[GitHub] [spark] cloud-fan commented on a change in pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
cloud-fan commented on a change in pull request #30942: URL: https://github.com/apache/spark/pull/30942#discussion_r549251997 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala ## @@ -505,7 +505,12 @@ class SparkSqlAstBuilder extends AstB

[GitHub] [spark] dongjoon-hyun commented on pull request #30941: [SPARK-33923][SQL][TESTS] Fix some tests with AQE enabled

2020-12-28 Thread GitBox
dongjoon-hyun commented on pull request #30941: URL: https://github.com/apache/spark/pull/30941#issuecomment-751623252 This PR is changing test cases only and Jenkins passed Scala/Java/Python tests already. Merged to master/3.1. -

[GitHub] [spark] dongjoon-hyun closed pull request #30941: [SPARK-33923][SQL][TESTS] Fix some tests with AQE enabled

2020-12-28 Thread GitBox
dongjoon-hyun closed pull request #30941: URL: https://github.com/apache/spark/pull/30941 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-751623610 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133435/ -

[GitHub] [spark] StefanXiepj commented on a change in pull request #30785: SPARK-33755: Allow creating orc table when row format separator is defined

2020-12-28 Thread GitBox
StefanXiepj commented on a change in pull request #30785: URL: https://github.com/apache/spark/pull/30785#discussion_r549252522 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/HiveOrcSourceSuite.scala ## @@ -153,4 +153,18 @@ class HiveOrcSourceSuite extends

[GitHub] [spark] StefanXiepj closed pull request #30785: SPARK-33755: Allow creating orc table when row format separator is defined

2020-12-28 Thread GitBox
StefanXiepj closed pull request #30785: URL: https://github.com/apache/spark/pull/30785 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-12-28 Thread GitBox
SparkQA commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-751623594 **[Test build #133435 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133435/testReport)** for PR 28422 at commit [`b7d94f7`](https://github.co

[GitHub] [spark] cloud-fan commented on a change in pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
cloud-fan commented on a change in pull request #30905: URL: https://github.com/apache/spark/pull/30905#discussion_r549253006 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -756,6 +756,52 @@ trait String2TrimEx

[GitHub] [spark] turboFei commented on a change in pull request #29982: [SPARK-33100][SQL] Ignore a semicolon inside a bracketed comment in spark-sql

2020-12-28 Thread GitBox
turboFei commented on a change in pull request #29982: URL: https://github.com/apache/spark/pull/29982#discussion_r549253131 ## File path: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala ## @@ -573,4 +573,16 @@ class CliSuite extends

[GitHub] [spark] cloud-fan commented on a change in pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
cloud-fan commented on a change in pull request #30905: URL: https://github.com/apache/spark/pull/30905#discussion_r549253255 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -756,6 +756,52 @@ trait String2TrimEx

[GitHub] [spark] turboFei commented on pull request #29982: [SPARK-33100][SQL] Ignore a semicolon inside a bracketed comment in spark-sql

2020-12-28 Thread GitBox
turboFei commented on pull request #29982: URL: https://github.com/apache/spark/pull/29982#issuecomment-751624262 test passed, gentle ping @maropu This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
AngersZh commented on a change in pull request #30942: URL: https://github.com/apache/spark/pull/30942#discussion_r549253481 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala ## @@ -505,7 +505,12 @@ class SparkSqlAstBuilder extends A

[GitHub] [spark] cloud-fan commented on a change in pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
cloud-fan commented on a change in pull request #30905: URL: https://github.com/apache/spark/pull/30905#discussion_r549253565 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -756,6 +756,52 @@ trait String2TrimEx

[GitHub] [spark] cloud-fan commented on a change in pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
cloud-fan commented on a change in pull request #30905: URL: https://github.com/apache/spark/pull/30905#discussion_r549253565 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -756,6 +756,52 @@ trait String2TrimEx

[GitHub] [spark] AmplabJenkins commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-751625093 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38026/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29982: [SPARK-33100][SQL] Ignore a semicolon inside a bracketed comment in spark-sql

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29982: URL: https://github.com/apache/spark/pull/29982#issuecomment-751621035 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38018/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30827: [SPARK-33827][SS] Unload inactive state store as soon as possible

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30827: URL: https://github.com/apache/spark/pull/30827#issuecomment-751621032 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133424/ -

[GitHub] [spark] SparkQA removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-751622016 **[Test build #133435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133435/testReport)** for PR 28422 at commit [`b7d94f7`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-751623610 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30928: [SPARK-33912][SQL] Refactor DependencyUtils ivy property parameter

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30928: URL: https://github.com/apache/spark/pull/30928#issuecomment-751621031 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38023/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30944: [SPARK-33907][SQL][3.1][FOLLOWUP] Add test for corrupt record column

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30944: URL: https://github.com/apache/spark/pull/30944#issuecomment-751604685 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133429/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30943: [SPARK-30789][SQL] Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30943: URL: https://github.com/apache/spark/pull/30943#issuecomment-751621034 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38020/

[GitHub] [spark] SparkQA commented on pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
SparkQA commented on pull request #30942: URL: https://github.com/apache/spark/pull/30942#issuecomment-751625398 **[Test build #133421 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133421/testReport)** for PR 30942 at commit [`79e78f3`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30942: URL: https://github.com/apache/spark/pull/30942#issuecomment-751565754 **[Test build #133421 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133421/testReport)** for PR 30942 at commit [`79e78f3`](https://gi

[GitHub] [spark] viirya commented on pull request #30827: [SPARK-33827][SS] Unload inactive state store as soon as possible

2020-12-28 Thread GitBox
viirya commented on pull request #30827: URL: https://github.com/apache/spark/pull/30827#issuecomment-751625629 Thanks guys! This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [spark] viirya commented on pull request #30944: [SPARK-33907][SQL][3.1][FOLLOWUP] Add test for corrupt record column

2020-12-28 Thread GitBox
viirya commented on pull request #30944: URL: https://github.com/apache/spark/pull/30944#issuecomment-751625919 Thanks @dongjoon-hyun @HyukjinKwon This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] AmplabJenkins commented on pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30942: URL: https://github.com/apache/spark/pull/30942#issuecomment-751625971 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133421/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30944: [SPARK-33907][SQL][3.1][FOLLOWUP] Add test for corrupt record column

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30944: URL: https://github.com/apache/spark/pull/30944#issuecomment-751626188 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38022/ -

[GitHub] [spark] SparkQA commented on pull request #30944: [SPARK-33907][SQL][3.1][FOLLOWUP] Add test for corrupt record column

2020-12-28 Thread GitBox
SparkQA commented on pull request #30944: URL: https://github.com/apache/spark/pull/30944#issuecomment-751626176 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38022/ ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30942: URL: https://github.com/apache/spark/pull/30942#issuecomment-751625971 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133421/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30944: [SPARK-33907][SQL][3.1][FOLLOWUP] Add test for corrupt record column

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30944: URL: https://github.com/apache/spark/pull/30944#issuecomment-751626188 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38022/

[GitHub] [spark] ulysses-you commented on a change in pull request #30923: [SPARK-33909][SQL] Check rand functions seed is legal at analyer side

2020-12-28 Thread GitBox
ulysses-you commented on a change in pull request #30923: URL: https://github.com/apache/spark/pull/30923#discussion_r549256759 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala ## @@ -215,6 +215,10 @@ trait CheckAnalysis exte

[GitHub] [spark] AngersZhuuuu commented on pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
AngersZh commented on pull request #30942: URL: https://github.com/apache/spark/pull/30942#issuecomment-751628889 The code has been modified to make it easier for it to add other possible default parameters in specified Hive serde mode. FYI @cloud-fan -

[GitHub] [spark] Ngone51 commented on pull request #30941: [SPARK-33923][SQL][TESTS] Fix some tests with AQE enabled

2020-12-28 Thread GitBox
Ngone51 commented on pull request #30941: URL: https://github.com/apache/spark/pull/30941#issuecomment-751628871 thanks all! This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [spark] SparkQA commented on pull request #30941: [SPARK-33923][SQL][TESTS] Fix some tests with AQE enabled

2020-12-28 Thread GitBox
SparkQA commented on pull request #30941: URL: https://github.com/apache/spark/pull/30941#issuecomment-751628925 **[Test build #133422 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133422/testReport)** for PR 30941 at commit [`d6be7c4`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30941: [SPARK-33923][SQL][TESTS] Fix some tests with AQE enabled

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30941: URL: https://github.com/apache/spark/pull/30941#issuecomment-751566077 **[Test build #133422 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133422/testReport)** for PR 30941 at commit [`d6be7c4`](https://gi

[GitHub] [spark] cloud-fan commented on pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
cloud-fan commented on pull request #30942: URL: https://github.com/apache/spark/pull/30942#issuecomment-751629073 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] cloud-fan closed pull request #30942: [SPARK-32685][SQL] When specify serde, default filed.delim is '\t'

2020-12-28 Thread GitBox
cloud-fan closed pull request #30942: URL: https://github.com/apache/spark/pull/30942 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] SparkQA commented on pull request #30912: [SPARK-32968][SQL] Prune unnecessary columns from CsvToStructs

2020-12-28 Thread GitBox
SparkQA commented on pull request #30912: URL: https://github.com/apache/spark/pull/30912#issuecomment-751629279 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38021/ ---

[GitHub] [spark] beliefer commented on a change in pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
beliefer commented on a change in pull request #30905: URL: https://github.com/apache/spark/pull/30905#discussion_r549260063 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -756,6 +756,52 @@ trait String2TrimExp

[GitHub] [spark] beliefer commented on a change in pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
beliefer commented on a change in pull request #30905: URL: https://github.com/apache/spark/pull/30905#discussion_r549261519 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -756,6 +756,52 @@ trait String2TrimExp

[GitHub] [spark] ScrapCodes commented on pull request #30472: [SPARK-32221][k8s] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-12-28 Thread GitBox
ScrapCodes commented on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-751632890 Hi @dongjoon-hyun, I am sorry I was not well. This is an automated message from the Apache Git Service. To re

[GitHub] [spark] HyukjinKwon opened a new pull request #30945: [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile

2020-12-28 Thread GitBox
HyukjinKwon opened a new pull request #30945: URL: https://github.com/apache/spark/pull/30945 ### What changes were proposed in this pull request? This is kind of a followup of https://github.com/apache/spark/pull/24033. The first and last usage of that argument `SecurityManager` w

[GitHub] [spark] HyukjinKwon commented on pull request #30945: [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile

2020-12-28 Thread GitBox
HyukjinKwon commented on pull request #30945: URL: https://github.com/apache/spark/pull/30945#issuecomment-751634700 cc @vanzin, @gaborgsomogyi, @skonto FYI This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] MaxGekk commented on a change in pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-28 Thread GitBox
MaxGekk commented on a change in pull request #30935: URL: https://github.com/apache/spark/pull/30935#discussion_r549265253 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/AlterTableRenamePartitionSuiteBase.scala ## @@ -17,8 +17,149 @@ package o

[GitHub] [spark] SparkQA commented on pull request #30924: [SPARK-33804][CORE] Fix compilation warnings about 'view bounds are deprecated'

2020-12-28 Thread GitBox
SparkQA commented on pull request #30924: URL: https://github.com/apache/spark/pull/30924#issuecomment-751635996 **[Test build #133426 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133426/testReport)** for PR 30924 at commit [`8e626f8`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

2020-12-28 Thread GitBox
SparkQA commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751636556 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38025/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30941: [SPARK-33923][SQL][TESTS] Fix some tests with AQE enabled

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30941: URL: https://github.com/apache/spark/pull/30941#issuecomment-751637943 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133422/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30912: [SPARK-32968][SQL] Prune unnecessary columns from CsvToStructs

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30912: URL: https://github.com/apache/spark/pull/30912#issuecomment-751637946 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38021/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30924: [SPARK-33804][CORE] Fix compilation warnings about 'view bounds are deprecated'

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30924: URL: https://github.com/apache/spark/pull/30924#issuecomment-751637944 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133426/ -

[GitHub] [spark] MaxGekk commented on a change in pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-28 Thread GitBox
MaxGekk commented on a change in pull request #30935: URL: https://github.com/apache/spark/pull/30935#discussion_r549268524 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/AlterTableRenamePartitionSuiteBase.scala ## @@ -17,8 +17,149 @@ package o

[GitHub] [spark] SparkQA commented on pull request #30945: [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile

2020-12-28 Thread GitBox
SparkQA commented on pull request #30945: URL: https://github.com/apache/spark/pull/30945#issuecomment-751639051 **[Test build #133436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133436/testReport)** for PR 30945 at commit [`56e7707`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30923: [SPARK-33909][SQL] Check rand functions seed is legal at analyer side

2020-12-28 Thread GitBox
SparkQA commented on pull request #30923: URL: https://github.com/apache/spark/pull/30923#issuecomment-751639068 **[Test build #133438 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133438/testReport)** for PR 30923 at commit [`28b4d21`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
SparkQA commented on pull request #30905: URL: https://github.com/apache/spark/pull/30905#issuecomment-751639091 **[Test build #133439 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133439/testReport)** for PR 30905 at commit [`7d32023`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-28 Thread GitBox
SparkQA commented on pull request #30935: URL: https://github.com/apache/spark/pull/30935#issuecomment-751639130 **[Test build #133437 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133437/testReport)** for PR 30935 at commit [`e81ab1f`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #30945: [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30945: URL: https://github.com/apache/spark/pull/30945#issuecomment-751639631 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38027/ -

[GitHub] [spark] SparkQA commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

2020-12-28 Thread GitBox
SparkQA commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751639925 **[Test build #133434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133434/testReport)** for PR 30841 at commit [`a495f6d`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751640090 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133434/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30945: [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30945: URL: https://github.com/apache/spark/pull/30945#issuecomment-751641410 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133436/ -

[GitHub] [spark] SparkQA commented on pull request #30945: [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile

2020-12-28 Thread GitBox
SparkQA commented on pull request #30945: URL: https://github.com/apache/spark/pull/30945#issuecomment-751641396 **[Test build #133436 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133436/testReport)** for PR 30945 at commit [`56e7707`](https://github.co

[GitHub] [spark] cloud-fan commented on a change in pull request #30915: [SPARK-33899][SQL] Fix assert failure in v1 SHOW TABLES/VIEWS on `spark_catalog`

2020-12-28 Thread GitBox
cloud-fan commented on a change in pull request #30915: URL: https://github.com/apache/spark/pull/30915#discussion_r549271216 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowTablesSuite.scala ## @@ -100,6 +100,17 @@ trait ShowTablesSuiteBase

[GitHub] [spark] MaxGekk commented on a change in pull request #30915: [SPARK-33899][SQL] Fix assert failure in v1 SHOW TABLES/VIEWS on `spark_catalog`

2020-12-28 Thread GitBox
MaxGekk commented on a change in pull request #30915: URL: https://github.com/apache/spark/pull/30915#discussion_r549271323 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowTablesSuite.scala ## @@ -100,6 +100,17 @@ trait ShowTablesSuiteBase e

[GitHub] [spark] cloud-fan commented on pull request #30915: [SPARK-33899][SQL] Fix assert failure in v1 SHOW TABLES/VIEWS on `spark_catalog`

2020-12-28 Thread GitBox
cloud-fan commented on pull request #30915: URL: https://github.com/apache/spark/pull/30915#issuecomment-751641664 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] cloud-fan closed pull request #30915: [SPARK-33899][SQL] Fix assert failure in v1 SHOW TABLES/VIEWS on `spark_catalog`

2020-12-28 Thread GitBox
cloud-fan closed pull request #30915: URL: https://github.com/apache/spark/pull/30915 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] SparkQA removed a comment on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751622626 **[Test build #133434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133434/testReport)** for PR 30841 at commit [`a495f6d`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751640090 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133434/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30924: [SPARK-33804][CORE] Fix compilation warnings about 'view bounds are deprecated'

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30924: URL: https://github.com/apache/spark/pull/30924#issuecomment-751637944 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133426/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30912: [SPARK-32968][SQL] Prune unnecessary columns from CsvToStructs

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30912: URL: https://github.com/apache/spark/pull/30912#issuecomment-751637946 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38021/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30941: [SPARK-33923][SQL][TESTS] Fix some tests with AQE enabled

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30941: URL: https://github.com/apache/spark/pull/30941#issuecomment-751637943 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133422/ -

[GitHub] [spark] SparkQA removed a comment on pull request #30924: [SPARK-33804][CORE] Fix compilation warnings about 'view bounds are deprecated'

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30924: URL: https://github.com/apache/spark/pull/30924#issuecomment-75156 **[Test build #133426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133426/testReport)** for PR 30924 at commit [`8e626f8`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30945: [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30945: URL: https://github.com/apache/spark/pull/30945#issuecomment-751639051 **[Test build #133436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133436/testReport)** for PR 30945 at commit [`56e7707`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30945: [SPARK-33925][CORE] Remove unused SecurityManager in Utils.fetchFile

2020-12-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30945: URL: https://github.com/apache/spark/pull/30945#issuecomment-751639631 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AngersZhuuuu opened a new pull request #30946: [SPARK-32684][SQL] Script transform hive serde mode null value keep same with hive as '\\N'

2020-12-28 Thread GitBox
AngersZh opened a new pull request #30946: URL: https://github.com/apache/spark/pull/30946 ### What changes were proposed in this pull request? In hive script transform serde mode, NULL format default is `\\N` ``` String nullString = tbl.getProperty( serdeConstants.SERIAL

[GitHub] [spark] AngersZhuuuu commented on pull request #30946: [SPARK-32684][SQL] Script transform hive serde mode null value keep same with hive as '\\N'

2020-12-28 Thread GitBox
AngersZh commented on pull request #30946: URL: https://github.com/apache/spark/pull/30946#issuecomment-751643600 FYI @maropu @cloud-fan @HyukjinKwon This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] AngersZhuuuu edited a comment on pull request #29087: [SPARK-28227][SQL] Support TRANSFORM with aggregation

2020-12-28 Thread GitBox
AngersZh edited a comment on pull request #29087: URL: https://github.com/apache/spark/pull/29087#issuecomment-751614832 also FYI @Alfozan @cloud-fan This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support GROUP BY use Separate columns and CUBE/ROLLUP

2020-12-28 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-751644388 **[Test build #133440 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133440/testReport)** for PR 30144 at commit [`c1c551c`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30472: [SPARK-32221][k8s] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-12-28 Thread GitBox
SparkQA commented on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-751644392 **[Test build #133442 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133442/testReport)** for PR 30472 at commit [`38288f1`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30946: [SPARK-32684][SQL] Script transform hive serde mode null value keep same with hive as '\\N'

2020-12-28 Thread GitBox
SparkQA commented on pull request #30946: URL: https://github.com/apache/spark/pull/30946#issuecomment-751645324 **[Test build #133441 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133441/testReport)** for PR 30946 at commit [`983a3e2`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30943: [SPARK-30789][SQL] Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-28 Thread GitBox
SparkQA commented on pull request #30943: URL: https://github.com/apache/spark/pull/30943#issuecomment-751645526 **[Test build #133430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133430/testReport)** for PR 30943 at commit [`c82bb15`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30943: [SPARK-30789][SQL] Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30943: URL: https://github.com/apache/spark/pull/30943#issuecomment-751605734 **[Test build #133430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133430/testReport)** for PR 30943 at commit [`c82bb15`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

2020-12-28 Thread GitBox
SparkQA commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751645925 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38025/ ---

[GitHub] [spark] MaxGekk commented on pull request #30919: [SPARK-33904][SQL] Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

2020-12-28 Thread GitBox
MaxGekk commented on pull request #30919: URL: https://github.com/apache/spark/pull/30919#issuecomment-751646048 @cloud-fan @HyukjinKwon Could you review this PR, please. This is an automated message from the Apache Git Servi

[GitHub] [spark] SparkQA commented on pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
SparkQA commented on pull request #30905: URL: https://github.com/apache/spark/pull/30905#issuecomment-751646126 **[Test build #133439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133439/testReport)** for PR 30905 at commit [`7d32023`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30905: URL: https://github.com/apache/spark/pull/30905#issuecomment-751639091 **[Test build #133439 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133439/testReport)** for PR 30905 at commit [`7d32023`](https://gi

[GitHub] [spark] saikocat commented on pull request #30902: [SPARK-33888][SQL] JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

2020-12-28 Thread GitBox
saikocat commented on pull request #30902: URL: https://github.com/apache/spark/pull/30902#issuecomment-751647327 @cloud-fan I have addressed the code review comments. Took awhile cos of a bug in metadata builder not being build. I will use the metadata field to store a key `logicalt

[GitHub] [spark] SparkQA commented on pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-28 Thread GitBox
SparkQA commented on pull request #30935: URL: https://github.com/apache/spark/pull/30935#issuecomment-751647947 **[Test build #133437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133437/testReport)** for PR 30935 at commit [`e81ab1f`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30935: URL: https://github.com/apache/spark/pull/30935#issuecomment-751639130 **[Test build #133437 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133437/testReport)** for PR 30935 at commit [`e81ab1f`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30472: [SPARK-32221][k8s] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-12-28 Thread GitBox
SparkQA commented on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-751648508 **[Test build #133442 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133442/testReport)** for PR 30472 at commit [`38288f1`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30472: [SPARK-32221][k8s] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-12-28 Thread GitBox
SparkQA removed a comment on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-751644392 **[Test build #133442 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/133442/testReport)** for PR 30472 at commit [`38288f1`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
SparkQA commented on pull request #30905: URL: https://github.com/apache/spark/pull/30905#issuecomment-751652975 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38030/ -

[GitHub] [spark] SparkQA commented on pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-28 Thread GitBox
SparkQA commented on pull request #30935: URL: https://github.com/apache/spark/pull/30935#issuecomment-751653279 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38028/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30912: [SPARK-32968][SQL] Prune unnecessary columns from CsvToStructs

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30912: URL: https://github.com/apache/spark/pull/30912#issuecomment-751656052 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38024/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30905: [SPARK-33890][SQL] Improve the implement of trim/trimleft/trimright

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30905: URL: https://github.com/apache/spark/pull/30905#issuecomment-751656047 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133439/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30841: URL: https://github.com/apache/spark/pull/30841#issuecomment-751656046 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38025/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30943: [SPARK-30789][SQL] Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30943: URL: https://github.com/apache/spark/pull/30943#issuecomment-751656048 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133430/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30472: [SPARK-32221][k8s] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-751656050 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133442/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30935: [SPARK-33859][SQL] Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-28 Thread GitBox
AmplabJenkins commented on pull request #30935: URL: https://github.com/apache/spark/pull/30935#issuecomment-751656049 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/133437/ -

  1   2   3   4   5   >