[GitHub] [spark] AmplabJenkins removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-761523959 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134135/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-761523959 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134135/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-01-15 Thread GitBox
SparkQA removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-761408215 **[Test build #134135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134135/testReport)** for PR 31204 at commit [`8d170ed`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-01-15 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-761523766 **[Test build #134135 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134135/testReport)** for PR 31204 at commit [`8d170ed`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning

2021-01-15 Thread GitBox
SparkQA commented on pull request #31205: URL: https://github.com/apache/spark/pull/31205#issuecomment-761523516 **[Test build #134138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134138/testReport)** for PR 31205 at commit [`d08ad4e`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30974: [SPARK-33939][SQL] Make Column.named UnresolvedExtractValue use UnresolvedAlias to assign name

2021-01-15 Thread GitBox
SparkQA commented on pull request #30974: URL: https://github.com/apache/spark/pull/30974#issuecomment-761523029 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38720/ -

[GitHub] [spark] wangyum opened a new pull request #31205: [SPARK-34119][SQL] Keep necessary stats after partition pruning

2021-01-15 Thread GitBox
wangyum opened a new pull request #31205: URL: https://github.com/apache/spark/pull/31205 ### What changes were proposed in this pull request? This pr keep necessary stats after partition pruning. ### Why are the changes needed? Improve query performance. Please see the

[GitHub] [spark] SparkQA commented on pull request #30974: [SPARK-33939][SQL] Make Column.named UnresolvedExtractValue use UnresolvedAlias to assign name

2021-01-15 Thread GitBox
SparkQA commented on pull request #30974: URL: https://github.com/apache/spark/pull/30974#issuecomment-761518865 **[Test build #134137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134137/testReport)** for PR 30974 at commit [`2f1a3dc`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31133: [SPARK-26836][SQL] Supporting Avro schema evolution for partitioned Hive tables

2021-01-15 Thread GitBox
SparkQA commented on pull request #31133: URL: https://github.com/apache/spark/pull/31133#issuecomment-761518286 **[Test build #134136 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134136/testReport)** for PR 31133 at commit [`8dc2c08`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30974: [SPARK-33939][SQL] Make Column.named UnresolvedExtractValue use UnresolvedAlias to assign name

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #30974: URL: https://github.com/apache/spark/pull/30974#issuecomment-761117961 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134111/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-761517541 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38718/

[GitHub] [spark] AmplabJenkins commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-761517541 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38718/ -

[GitHub] [spark] attilapiros commented on a change in pull request #31133: [SPARK-26836][SQL] Supporting Avro schema evolution for partitioned Hive tables

2021-01-15 Thread GitBox
attilapiros commented on a change in pull request #31133: URL: https://github.com/apache/spark/pull/31133#discussion_r558813362 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala ## @@ -1883,6 +1883,60 @@ class HiveDDLSuite } }

[GitHub] [spark] attilapiros commented on a change in pull request #31133: [SPARK-26836][SQL] Supporting Avro schema evolution for partitioned Hive tables

2021-01-15 Thread GitBox
attilapiros commented on a change in pull request #31133: URL: https://github.com/apache/spark/pull/31133#discussion_r558813362 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala ## @@ -1883,6 +1883,60 @@ class HiveDDLSuite } }

[GitHub] [spark] mohan3d removed a comment on pull request #31191: [SPARK-34123][Web UI] optimize spark history summary page loading

2021-01-15 Thread GitBox
mohan3d removed a comment on pull request #31191: URL: https://github.com/apache/spark/pull/31191#issuecomment-761462944 @srowen Can you please help re-testing? failed for non-related issue to the update. This is an automate

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761467287 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38717/

[GitHub] [spark] AmplabJenkins commented on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761467287 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38717/ -

[GitHub] [spark] mohan3d removed a comment on pull request #31191: [SPARK-34123][Web UI] optimize spark history summary page loading

2021-01-15 Thread GitBox
mohan3d removed a comment on pull request #31191: URL: https://github.com/apache/spark/pull/31191#issuecomment-761463647 Jenkins, retest this please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] mohan3d commented on pull request #31191: [SPARK-34123][Web UI] optimize spark history summary page loading

2021-01-15 Thread GitBox
mohan3d commented on pull request #31191: URL: https://github.com/apache/spark/pull/31191#issuecomment-761463647 Jenkins, retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] mohan3d commented on pull request #31191: [SPARK-34123][Web UI] optimize spark history summary page loading

2021-01-15 Thread GitBox
mohan3d commented on pull request #31191: URL: https://github.com/apache/spark/pull/31191#issuecomment-761462944 @srowen Can you please help re-testing? failed for non-related issue to the update. This is an automated messag

[GitHub] [spark] SparkQA commented on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
SparkQA commented on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761447967 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38717/ ---

[GitHub] [spark] viirya commented on a change in pull request #31199: [SPARK-34130][SQL] Impove preformace for char varchar padding and length check with StaticInvoke

2021-01-15 Thread GitBox
viirya commented on a change in pull request #31199: URL: https://github.com/apache/spark/pull/31199#discussion_r558809533 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/CharVarcharUtils.scala ## @@ -161,9 +162,20 @@ object CharVarcharUtils extend

[GitHub] [spark] dongjoon-hyun closed pull request #31177: [SPARK-34110][BUILD] Upgrade Zookeeper to 3.6.2

2021-01-15 Thread GitBox
dongjoon-hyun closed pull request #31177: URL: https://github.com/apache/spark/pull/31177 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #31177: [SPARK-34110][BUILD] Upgrade Zookeeper to 3.6.2

2021-01-15 Thread GitBox
dongjoon-hyun commented on pull request #31177: URL: https://github.com/apache/spark/pull/31177#issuecomment-761429848 Let's merge this and test for Apache Spark 3.2.0 timeframe. Merged to master for Apache Spark 3.2.0. Th

[GitHub] [spark] dongjoon-hyun commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
dongjoon-hyun commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761425432 FYI, the first commit already passed with Jenkins here. And, the second commit is an empty commit to retriever Jenkins. - https://github.com/apache/spark/pull/31194#issu

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

2021-01-15 Thread GitBox
SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-761408215 **[Test build #134135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134135/testReport)** for PR 31204 at commit [`8d170ed`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761398600 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134134/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761398600 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134134/ -

[GitHub] [spark] SparkQA commented on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
SparkQA commented on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761392583 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38717/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
SparkQA removed a comment on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761340775 **[Test build #134134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134134/testReport)** for PR 31053 at commit [`9c32d18`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
SparkQA commented on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761388396 **[Test build #134134 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134134/testReport)** for PR 31053 at commit [`9c32d18`](https://github.co

[GitHub] [spark] AngersZhuuuu opened a new pull request #31204: [SPARK-26399][SQL] Add new stage-level REST APIs and parameters

2021-01-15 Thread GitBox
AngersZh opened a new pull request #31204: URL: https://github.com/apache/spark/pull/31204 ### What changes were proposed in this pull request? ### Why are the changes needed? More flexable restful API ### Does this PR introduce _any_ user-facing change?

[GitHub] [spark] mohan3d commented on a change in pull request #31191: [SPARK-34123][Web UI] optimize spark history summary page loading

2021-01-15 Thread GitBox
mohan3d commented on a change in pull request #31191: URL: https://github.com/apache/spark/pull/31191#discussion_r558802536 ## File path: core/src/main/resources/org/apache/spark/ui/static/historypage-template.html ## @@ -75,26 +75,6 @@ - {{#applications}} -

[GitHub] [spark] SparkQA commented on pull request #31053: [SPARK-32165][SQL] Ensure Spark only initiates SharedState once across SparkSessions

2021-01-15 Thread GitBox
SparkQA commented on pull request #31053: URL: https://github.com/apache/spark/pull/31053#issuecomment-761340775 **[Test build #134134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134134/testReport)** for PR 31053 at commit [`9c32d18`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31203: URL: https://github.com/apache/spark/pull/31203#issuecomment-761298920 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761298773 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761298774 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] yaooqinn commented on pull request #31185: [SPARK-34111][BUILD] Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-15 Thread GitBox
yaooqinn commented on pull request #31185: URL: https://github.com/apache/spark/pull/31185#issuecomment-761327336 yes, I checked and saw the `servlet-api` gone away, we don't need this PR anymore @dongjoon-hyun. This is

[GitHub] [spark] AmplabJenkins commented on pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31203: URL: https://github.com/apache/spark/pull/31203#issuecomment-761326656 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134130/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761326663 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134132/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761326658 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134131/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
SparkQA removed a comment on pull request #31203: URL: https://github.com/apache/spark/pull/31203#issuecomment-761277723 **[Test build #134130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134130/testReport)** for PR 31203 at commit [`062b7bc`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
SparkQA commented on pull request #31203: URL: https://github.com/apache/spark/pull/31203#issuecomment-761315300 **[Test build #134130 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134130/testReport)** for PR 31203 at commit [`062b7bc`](https://github.co

[GitHub] [spark] yaooqinn commented on a change in pull request #31199: [SPARK-34130][SQL] Impove preformace for char varchar padding and length check with StaticInvoke

2021-01-15 Thread GitBox
yaooqinn commented on a change in pull request #31199: URL: https://github.com/apache/spark/pull/31199#discussion_r558799699 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/CharVarcharUtils.scala ## @@ -200,69 +212,60 @@ object CharVarcharUtils ext

[GitHub] [spark] yaooqinn commented on a change in pull request #31199: [SPARK-34130][SQL] Impove preformace for char varchar padding and length check with StaticInvoke

2021-01-15 Thread GitBox
yaooqinn commented on a change in pull request #31199: URL: https://github.com/apache/spark/pull/31199#discussion_r558799699 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/CharVarcharUtils.scala ## @@ -200,69 +212,60 @@ object CharVarcharUtils ext

[GitHub] [spark] yaooqinn commented on a change in pull request #31199: [SPARK-34130][SQL] Impove preformace for char varchar padding and length check with StaticInvoke

2021-01-15 Thread GitBox
yaooqinn commented on a change in pull request #31199: URL: https://github.com/apache/spark/pull/31199#discussion_r558799511 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/CharVarcharUtils.scala ## @@ -161,9 +162,20 @@ object CharVarcharUtils exte

[GitHub] [spark] yaooqinn commented on a change in pull request #31199: [SPARK-34130][SQL] Impove preformace for char varchar padding and length check with StaticInvoke

2021-01-15 Thread GitBox
yaooqinn commented on a change in pull request #31199: URL: https://github.com/apache/spark/pull/31199#discussion_r558799350 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/util/CharVarcharCodegenUtils.java ## @@ -0,0 +1,40 @@ +/* + * Licensed to the Apa

[GitHub] [spark] yaooqinn commented on a change in pull request #31012: [SPARK-34083][SQL] Using TPCDS original definitions for char/varchar columns

2021-01-15 Thread GitBox
yaooqinn commented on a change in pull request #31012: URL: https://github.com/apache/spark/pull/31012#discussion_r558798965 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/util/CharVarcharCodegenUtils.java ## @@ -0,0 +1,40 @@ +/* + * Licensed to the Apa

[GitHub] [spark] SparkQA removed a comment on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
SparkQA removed a comment on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761290721 **[Test build #134132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134132/testReport)** for PR 31194 at commit [`2b94425`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
SparkQA commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761303608 **[Test build #134132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134132/testReport)** for PR 31194 at commit [`2b94425`](https://github.co

[GitHub] [spark] huaxingao commented on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
huaxingao commented on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761303055 Thank you very much everyone! This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [spark] WeichenXu123 edited a comment on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
WeichenXu123 edited a comment on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761302619 Merged to apache/spark master/3.1 Thanks! This is an automated message from the Apache Git Servic

[GitHub] [spark] WeichenXu123 commented on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
WeichenXu123 commented on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761302619 Merged to apache/spark master/3.1.1 Thanks! This is an automated message from the Apache Git Service. To

[GitHub] [spark] WeichenXu123 closed pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
WeichenXu123 closed pull request #31160: URL: https://github.com/apache/spark/pull/31160 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [spark] SparkQA removed a comment on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
SparkQA removed a comment on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761277759 **[Test build #134131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134131/testReport)** for PR 31201 at commit [`8ae6b7f`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
SparkQA commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761301104 **[Test build #134131 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134131/testReport)** for PR 31201 at commit [`8ae6b7f`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
SparkQA commented on pull request #31203: URL: https://github.com/apache/spark/pull/31203#issuecomment-761298911 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38713/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31203: URL: https://github.com/apache/spark/pull/31203#issuecomment-761298920 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38713/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761298774 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38714/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761298773 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38715/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30657: [WIP][SPARK-33696][SQL] Upgrade built-in Hive to 2.3.8

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #30657: URL: https://github.com/apache/spark/pull/30657#issuecomment-761298775 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] MrPowers commented on a change in pull request #31073: [SPARK-33995][SQL] Expose make_interval as a Scala function

2021-01-15 Thread GitBox
MrPowers commented on a change in pull request #31073: URL: https://github.com/apache/spark/pull/31073#discussion_r558776410 ## File path: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ## @@ -2841,6 +2841,31 @@ object functions { // DateTime functions

[GitHub] [spark] SparkQA commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
SparkQA commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761297179 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38715/ ---

[GitHub] [spark] ueshin commented on a change in pull request #30985: [SPARK-33730][PYTHON] Standardize warning types

2021-01-15 Thread GitBox
ueshin commented on a change in pull request #30985: URL: https://github.com/apache/spark/pull/30985#discussion_r558770714 ## File path: python/pyspark/worker.py ## @@ -500,7 +501,12 @@ def main(infile, outfile): except (resource.error, OSError, ValueError) as e:

[GitHub] [spark] SparkQA commented on pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
SparkQA commented on pull request #31203: URL: https://github.com/apache/spark/pull/31203#issuecomment-761295942 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38713/ -

[GitHub] [spark] SparkQA commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
SparkQA commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761295061 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38715/ -

[GitHub] [spark] SparkQA removed a comment on pull request #30657: [WIP][SPARK-33696][SQL] Upgrade built-in Hive to 2.3.8

2021-01-15 Thread GitBox
SparkQA removed a comment on pull request #30657: URL: https://github.com/apache/spark/pull/30657#issuecomment-761292563 **[Test build #134133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134133/testReport)** for PR 30657 at commit [`bb418bb`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30657: [WIP][SPARK-33696][SQL] Upgrade built-in Hive to 2.3.8

2021-01-15 Thread GitBox
SparkQA commented on pull request #30657: URL: https://github.com/apache/spark/pull/30657#issuecomment-761293951 **[Test build #134133 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134133/testReport)** for PR 30657 at commit [`bb418bb`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30657: [WIP][SPARK-33696][SQL] Upgrade built-in Hive to 2.3.8

2021-01-15 Thread GitBox
SparkQA commented on pull request #30657: URL: https://github.com/apache/spark/pull/30657#issuecomment-761292563 **[Test build #134133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134133/testReport)** for PR 30657 at commit [`bb418bb`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
SparkQA commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761290721 **[Test build #134132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134132/testReport)** for PR 31194 at commit [`2b94425`](https://github.com

[GitHub] [spark] HeartSaVioR commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
HeartSaVioR commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761284117 Just triggered Jenkins/GA. Once one of them passes I'll merge this. This is an automated message from the Ap

[GitHub] [spark] HeartSaVioR commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
HeartSaVioR commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761283950 retest this, please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] dongjoon-hyun closed pull request #31200: [SPARK-34132][DOCS][R] Update Roxygen version references to 7.1.1

2021-01-15 Thread GitBox
dongjoon-hyun closed pull request #31200: URL: https://github.com/apache/spark/pull/31200 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #31197: [SPARK-34060][SQL][FOLLOWUP] Preserve serializability of canonicalized CatalogTable

2021-01-15 Thread GitBox
dongjoon-hyun commented on pull request #31197: URL: https://github.com/apache/spark/pull/31197#issuecomment-761280056 Thank you, @MaxGekk . Merged to master/3.1/3.0. This is an automated message from the Apache Git Service.

[GitHub] [spark] dongjoon-hyun closed pull request #31197: [SPARK-34060][SQL][FOLLOWUP] Preserve serializability of canonicalized CatalogTable

2021-01-15 Thread GitBox
dongjoon-hyun closed pull request #31197: URL: https://github.com/apache/spark/pull/31197 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] sunchao commented on a change in pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
sunchao commented on a change in pull request #31203: URL: https://github.com/apache/spark/pull/31203#discussion_r558728151 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala ## @@ -107,12 +107,17 @@ private[hive] object IsolatedC

[GitHub] [spark] SparkQA commented on pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
SparkQA commented on pull request #31203: URL: https://github.com/apache/spark/pull/31203#issuecomment-761277723 **[Test build #134130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134130/testReport)** for PR 31203 at commit [`062b7bc`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
SparkQA commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761277759 **[Test build #134131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134131/testReport)** for PR 31201 at commit [`8ae6b7f`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761276140 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38711/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761276139 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761276139 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761276140 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38711/ -

[GitHub] [spark] xkrogen commented on a change in pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
xkrogen commented on a change in pull request #31203: URL: https://github.com/apache/spark/pull/31203#discussion_r558714139 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala ## @@ -107,12 +107,17 @@ private[hive] object IsolatedC

[GitHub] [spark] SparkQA removed a comment on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
SparkQA removed a comment on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761239012 **[Test build #134129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134129/testReport)** for PR 31160 at commit [`b5d5f49`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
SparkQA commented on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761268950 **[Test build #134129 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134129/testReport)** for PR 31160 at commit [`b5d5f49`](https://github.co

[GitHub] [spark] HeartSaVioR commented on pull request #31194: [SPARK-34125][CORE][2.4] Make EventLoggingListener.codecMap thread-safe

2021-01-15 Thread GitBox
HeartSaVioR commented on pull request #31194: URL: https://github.com/apache/spark/pull/31194#issuecomment-761267789 Yes, we changed it already in Spark 3.0, but as a part of commit and we haven't realized it should be fixed in 2.4.x as well. --

[GitHub] [spark] SparkQA commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
SparkQA commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761267701 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38711/ ---

[GitHub] [spark] xkrogen commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
xkrogen commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761266145 cc @dbtsai @viirya @gengliangwang @cloud-fan This is an automated message from the Apache Git Service. To respo

[GitHub] [spark] SparkQA commented on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
SparkQA commented on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761262469 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38712/ ---

[GitHub] [spark] sunchao opened a new pull request #31203: [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version check

2021-01-15 Thread GitBox
sunchao opened a new pull request #31203: URL: https://github.com/apache/spark/pull/31203 ### What changes were proposed in this pull request? 1. Add back Maven enforcer for duplicate dependencies check 2. Strict check on Hadoop versions which support shaded client in

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31133: [SPARK-26836][SQL] Supporting Avro schema evolution for partitioned Hive tables

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31133: URL: https://github.com/apache/spark/pull/31133#issuecomment-761257759 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38709/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761257757 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134128/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31185: [SPARK-34111][BUILD] Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-15 Thread GitBox
AmplabJenkins removed a comment on pull request #31185: URL: https://github.com/apache/spark/pull/31185#issuecomment-761257758 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134109/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31185: [SPARK-34111][BUILD] Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31185: URL: https://github.com/apache/spark/pull/31185#issuecomment-761257758 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134109/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31133: [SPARK-26836][SQL] Supporting Avro schema evolution for partitioned Hive tables

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31133: URL: https://github.com/apache/spark/pull/31133#issuecomment-761257759 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/38709/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
AmplabJenkins commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761257757 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134128/ -

[GitHub] [spark] SparkQA commented on pull request #31201: [SPARK-34133][AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching and enhance error messages

2021-01-15 Thread GitBox
SparkQA commented on pull request #31201: URL: https://github.com/apache/spark/pull/31201#issuecomment-761255368 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38711/ -

[GitHub] [spark] SparkQA commented on pull request #31160: [SPARK-34080][ML][PYTHON] Add UnivariateFeatureSelector

2021-01-15 Thread GitBox
SparkQA commented on pull request #31160: URL: https://github.com/apache/spark/pull/31160#issuecomment-761250723 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38712/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31185: [SPARK-34111][BUILD] Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-15 Thread GitBox
SparkQA removed a comment on pull request #31185: URL: https://github.com/apache/spark/pull/31185#issuecomment-760988874 **[Test build #134109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134109/testReport)** for PR 31185 at commit [`f8f12a0`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31185: [SPARK-34111][BUILD] Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-15 Thread GitBox
SparkQA commented on pull request #31185: URL: https://github.com/apache/spark/pull/31185#issuecomment-761247076 **[Test build #134109 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134109/testReport)** for PR 31185 at commit [`f8f12a0`](https://github.co

  1   2   3   4   5   6   >