[GitHub] [spark] gengliangwang opened a new pull request #31982: [SPARK-34881][SQL] New SQL Function: TRY_CAST

2021-03-28 Thread GitBox
gengliangwang opened a new pull request #31982: URL: https://github.com/apache/spark/pull/31982 ### What changes were proposed in this pull request? Add a new SQL function `try_cast`. `try_cast` is identical to `AnsiCast` (or `Cast` when `spark.sql.ansi.enabled` is

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-808897476 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136612/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31967: [SPAKR-34819][SQL]MapType supports orderable semantics

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31967: URL: https://github.com/apache/spark/pull/31967#issuecomment-808897475 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41196/

[GitHub] [spark] AmplabJenkins commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-808897476 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136612/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31967: [SPAKR-34819][SQL]MapType supports orderable semantics

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31967: URL: https://github.com/apache/spark/pull/31967#issuecomment-808897475 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41196/ --

[GitHub] [spark] SparkQA commented on pull request #31967: [SPAKR-34819][SQL]MapType supports orderable semantics

2021-03-28 Thread GitBox
SparkQA commented on pull request #31967: URL: https://github.com/apache/spark/pull/31967#issuecomment-808896113 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41196/ -- This is an automated message from the

[GitHub] [spark] srowen commented on pull request #31965: [SPARK-34843][SQL] Calculate more precise partition stride in JDBCRelation

2021-03-28 Thread GitBox
srowen commented on pull request #31965: URL: https://github.com/apache/spark/pull/31965#issuecomment-808896053 I also don't see any other instances quite like this. OK to merge soon if there are no objections. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA commented on pull request #31967: [SPAKR-34819][SQL]MapType supports orderable semantics

2021-03-28 Thread GitBox
SparkQA commented on pull request #31967: URL: https://github.com/apache/spark/pull/31967#issuecomment-808895217 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41196/ -- This is an automated message from the Apache

[GitHub] [spark] wangyum commented on a change in pull request #31980: [SPARK-34807][SQL] Transpose Window nodes with Project between them

2021-03-28 Thread GitBox
wangyum commented on a change in pull request #31980: URL: https://github.com/apache/spark/pull/31980#discussion_r602877162 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -991,13 +991,23 @@ object TransposeWindow

[GitHub] [spark] wangyum commented on a change in pull request #31677: [SPARK-34565][SQL] Collapse Window nodes with Project between them

2021-03-28 Thread GitBox
wangyum commented on a change in pull request #31677: URL: https://github.com/apache/spark/pull/31677#discussion_r602877074 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -913,14 +913,27 @@ object

[GitHub] [spark] SparkQA removed a comment on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-808865653 **[Test build #136612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136612/testReport)** for PR 31179 at commit

[GitHub] [spark] SparkQA commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

2021-03-28 Thread GitBox
SparkQA commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-808893689 **[Test build #136612 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136612/testReport)** for PR 31179 at commit

[GitHub] [spark] SparkQA commented on pull request #31967: [SPAKR-34819][SQL]MapType supports orderable semantics

2021-03-28 Thread GitBox
SparkQA commented on pull request #31967: URL: https://github.com/apache/spark/pull/31967#issuecomment-808890727 **[Test build #136614 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136614/testReport)** for PR 31967 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808890389 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136609/

[GitHub] [spark] AmplabJenkins commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808890389 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136609/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808860917 **[Test build #136609 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136609/testReport)** for PR 31451 at commit

[GitHub] [spark] SparkQA commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808886782 **[Test build #136609 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136609/testReport)** for PR 31451 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808884077 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136611/

[GitHub] [spark] AmplabJenkins commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808884077 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136611/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808865639 **[Test build #136611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136611/testReport)** for PR 31451 at commit

[GitHub] [spark] SparkQA commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808883966 **[Test build #136611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136611/testReport)** for PR 31451 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808879057 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136610/

[GitHub] [spark] AmplabJenkins commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808879057 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136610/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808865311 **[Test build #136610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136610/testReport)** for PR 31204 at commit

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808878883 **[Test build #136610 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136610/testReport)** for PR 31204 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30542: [SPARK-33594][SQL] Forbid binary type as partition column

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #30542: URL: https://github.com/apache/spark/pull/30542#issuecomment-808877247 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #30542: [SPARK-33594][SQL] Forbid binary type as partition column

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #30542: URL: https://github.com/apache/spark/pull/30542#issuecomment-808877247 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA removed a comment on pull request #30542: [SPARK-33594][SQL] Forbid binary type as partition column

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #30542: URL: https://github.com/apache/spark/pull/30542#issuecomment-808865686 **[Test build #136613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136613/testReport)** for PR 30542 at commit

[GitHub] [spark] SparkQA commented on pull request #30542: [SPARK-33594][SQL] Forbid binary type as partition column

2021-03-28 Thread GitBox
SparkQA commented on pull request #30542: URL: https://github.com/apache/spark/pull/30542#issuecomment-808876018 **[Test build #136613 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136613/testReport)** for PR 30542 at commit

[GitHub] [spark] SparkQA commented on pull request #30542: [SPARK-33594][SQL] Forbid binary type as partition column

2021-03-28 Thread GitBox
SparkQA commented on pull request #30542: URL: https://github.com/apache/spark/pull/30542#issuecomment-808873474 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41195/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808871371 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41193/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808871040 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808871042 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41192/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31677: [SPARK-34565][SQL] Collapse Window nodes with Project between them

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31677: URL: https://github.com/apache/spark/pull/31677#issuecomment-808871043 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136605/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-808871039 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41194/

[GitHub] [spark] SparkQA removed a comment on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808859608 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [spark] SparkQA commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808871367 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41193/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808871371 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41193/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31677: [SPARK-34565][SQL] Collapse Window nodes with Project between them

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31677: URL: https://github.com/apache/spark/pull/31677#issuecomment-808871043 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136605/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808871041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808871042 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41192/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-808871039 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41194/ --

[GitHub] [spark] SparkQA commented on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
SparkQA commented on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808870767 **[Test build #136607 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136607/testReport)** for PR 31979 at commit

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808870522 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41192/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808870494 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41193/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #30542: [SPARK-33594][SQL] Forbid binary type as partition column

2021-03-28 Thread GitBox
SparkQA commented on pull request #30542: URL: https://github.com/apache/spark/pull/30542#issuecomment-808870459 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41195/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
SparkQA commented on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808870465 **[Test build #136606 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136606/testReport)** for PR 31979 at commit

[GitHub] [spark] SparkQA commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

2021-03-28 Thread GitBox
SparkQA commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-808869217 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41194/ --

[GitHub] [spark] SparkQA removed a comment on pull request #31677: [SPARK-34565][SQL] Collapse Window nodes with Project between them

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #31677: URL: https://github.com/apache/spark/pull/31677#issuecomment-808842815 **[Test build #136605 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136605/testReport)** for PR 31677 at commit

[GitHub] [spark] SparkQA commented on pull request #31677: [SPARK-34565][SQL] Collapse Window nodes with Project between them

2021-03-28 Thread GitBox
SparkQA commented on pull request #31677: URL: https://github.com/apache/spark/pull/31677#issuecomment-808867075 **[Test build #136605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136605/testReport)** for PR 31677 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31980: [SPARK-34807][SQL] Transpose Window nodes with Project between them

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31980: URL: https://github.com/apache/spark/pull/31980#issuecomment-808866755 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136604/

[GitHub] [spark] AmplabJenkins commented on pull request #31980: [SPARK-34807][SQL] Transpose Window nodes with Project between them

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31980: URL: https://github.com/apache/spark/pull/31980#issuecomment-808866755 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136604/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31980: [SPARK-34807][SQL] Transpose Window nodes with Project between them

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #31980: URL: https://github.com/apache/spark/pull/31980#issuecomment-808842775 **[Test build #136604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136604/testReport)** for PR 31980 at commit

[GitHub] [spark] SparkQA commented on pull request #31980: [SPARK-34807][SQL] Transpose Window nodes with Project between them

2021-03-28 Thread GitBox
SparkQA commented on pull request #31980: URL: https://github.com/apache/spark/pull/31980#issuecomment-808866569 **[Test build #136604 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136604/testReport)** for PR 31980 at commit

[GitHub] [spark] SparkQA commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808865899 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41191/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808865903 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41191/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808865903 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41191/

[GitHub] [spark] SparkQA commented on pull request #30542: [SPARK-33594][SQL] Forbid binary type as partition column

2021-03-28 Thread GitBox
SparkQA commented on pull request #30542: URL: https://github.com/apache/spark/pull/30542#issuecomment-808865686 **[Test build #136613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136613/testReport)** for PR 30542 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808865295 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41189/

[GitHub] [spark] SparkQA commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808865639 **[Test build #136611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136611/testReport)** for PR 31451 at commit

[GitHub] [spark] SparkQA commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

2021-03-28 Thread GitBox
SparkQA commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-808865653 **[Test build #136612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136612/testReport)** for PR 31179 at commit

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808865496 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41192/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808865311 **[Test build #136610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136610/testReport)** for PR 31204 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808865295 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41189/ --

[GitHub] [spark] SparkQA commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808865170 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41191/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
SparkQA commented on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808864583 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41189/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
SparkQA commented on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808863775 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41189/ -- This is an automated message from the Apache

[GitHub] [spark] AngersZhuuuu commented on pull request #30542: [SPARK-33594][SQL] Forbid binary type as partition column

2021-03-28 Thread GitBox
AngersZh commented on pull request #30542: URL: https://github.com/apache/spark/pull/30542#issuecomment-808861443 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #31451: [WIP][SPARK-34338][SQL] Report metrics from Datasource v2 scan

2021-03-28 Thread GitBox
SparkQA commented on pull request #31451: URL: https://github.com/apache/spark/pull/31451#issuecomment-808860917 **[Test build #136609 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136609/testReport)** for PR 31451 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860744 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136608/

[GitHub] [spark] SparkQA removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860449 **[Test build #136608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136608/testReport)** for PR 31204 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860744 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136608/ -- This

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860737 **[Test build #136608 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136608/testReport)** for PR 31204 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AngersZh commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860718 FYI @ron8hu Have rebase to current master's code. Ping @srowen Can you also take a look at this pr? -- This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AmplabJenkins removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860401 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41190/

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860449 **[Test build #136608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136608/testReport)** for PR 31204 at commit

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860398 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41190/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-03-28 Thread GitBox
AmplabJenkins commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-808860401 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41190/ --

[GitHub] [spark] SparkQA commented on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
SparkQA commented on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808859905 **[Test build #136607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136607/testReport)** for PR 31979 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
AngersZh commented on a change in pull request #31979: URL: https://github.com/apache/spark/pull/31979#discussion_r602844652 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -528,4 +530,65 @@ class

[GitHub] [spark] SparkQA commented on pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
SparkQA commented on pull request #31979: URL: https://github.com/apache/spark/pull/31979#issuecomment-808859608 **[Test build #136606 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136606/testReport)** for PR 31979 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
AngersZh commented on a change in pull request #31979: URL: https://github.com/apache/spark/pull/31979#discussion_r602843043 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala ## @@ -647,6 +668,40 @@ private[hive] trait HiveInspectors {

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
AngersZh commented on a change in pull request #31979: URL: https://github.com/apache/spark/pull/31979#discussion_r602840162 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala ## @@ -512,6 +527,12 @@ private[hive] trait HiveInspectors {

[GitHub] [spark] MaxGekk commented on a change in pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
MaxGekk commented on a change in pull request #31979: URL: https://github.com/apache/spark/pull/31979#discussion_r602838532 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala ## @@ -647,6 +668,40 @@ private[hive] trait HiveInspectors {

[GitHub] [spark] MaxGekk commented on a change in pull request #31979: [SPARK-34879][SQL][test-hive1.2] HiveInspector support DayTimeIntervalType and YearMonthIntervalType

2021-03-28 Thread GitBox
MaxGekk commented on a change in pull request #31979: URL: https://github.com/apache/spark/pull/31979#discussion_r602837428 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala ## @@ -512,6 +527,12 @@ private[hive] trait HiveInspectors {

<    1   2   3