[GitHub] [spark] AmplabJenkins commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

AmplabJenkins commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655206965 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655206381 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] agrawaldevesh opened a new pull request #29032: [WIP] Plumb whether a worker would also be decommissioned along with executor

agrawaldevesh opened a new pull request #29032: URL: https://github.com/apache/spark/pull/29032 ### What changes were proposed in this pull request? This PR is a giant plumbing PR that plumbs a DecommissionInfo along with the DecommissionExecutor message. ### Why are the

[GitHub] [spark] AmplabJenkins commented on pull request #29032: [WIP] Plumb whether a worker would also be decommissioned along with executor

AmplabJenkins commented on pull request #29032: URL: https://github.com/apache/spark/pull/29032#issuecomment-655206610 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655206381 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

SparkQA commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655205717 **[Test build #125237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125237/testReport)** for PR 28979 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

SparkQA removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-654986241 **[Test build #125237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125237/testReport)** for PR 28979 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

SparkQA removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-654986192 **[Test build #125236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125236/testReport)** for PR 29022 at commit

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655204951 **[Test build #125236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125236/testReport)** for PR 29022 at commit

[GitHub] [spark] viirya commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

viirya commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r451209981 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasingSuite.scala ## @@ -493,6 +491,156 @@ class

[GitHub] [spark] viirya commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

viirya commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r451209212 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasingSuite.scala ## @@ -493,6 +491,156 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655200336 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

maropu commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451208355 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655200336 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

dongjoon-hyun commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451207610 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] viirya commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

viirya commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451207755 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655200055 **[Test build #125268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125268/testReport)** for PR 28898 at commit

[GitHub] [spark] ulysses-you commented on pull request #28808: [SPARK-31975][SQL] Show AnalysisException when WindowFunction is used without WindowExpression

ulysses-you commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-655200059 thanks for merging! thanks all! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] maropu commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

maropu commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-65529 Looks okay. cc: @viirya @dongjoon-hyun This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

dongjoon-hyun commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451207610 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] erikerlandson commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

erikerlandson commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451206954 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -678,6 +678,9 @@ object MapObjects

[GitHub] [spark] maropu commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

maropu commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451206786 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] frankyin-factual commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

frankyin-factual commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655199003 @viirya @maropu Rebased with the current master. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

AmplabJenkins removed a comment on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-655197943 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] erikerlandson commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

erikerlandson commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451205658 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -678,6 +678,9 @@ object MapObjects

[GitHub] [spark] AmplabJenkins commented on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

AmplabJenkins commented on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-655198271 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] maryannxue commented on a change in pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

maryannxue commented on a change in pull request #29031: URL: https://github.com/apache/spark/pull/29031#discussion_r451205755 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/RemoveRedundantProjects.scala ## @@ -0,0 +1,78 @@ +/* + * Licensed to the Apache

[GitHub] [spark] maryannxue commented on a change in pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

maryannxue commented on a change in pull request #29031: URL: https://github.com/apache/spark/pull/29031#discussion_r451205382 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2935,6 +2944,8 @@ class SQLConf extends Serializable

[GitHub] [spark] AmplabJenkins commented on pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

AmplabJenkins commented on pull request #29031: URL: https://github.com/apache/spark/pull/29031#issuecomment-655197943 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] viirya commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

viirya commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451204846 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] allisonwang-db opened a new pull request #29031: [SPARK-32216][SQL] Remove redundant ProjectExec

allisonwang-db opened a new pull request #29031: URL: https://github.com/apache/spark/pull/29031 ### What changes were proposed in this pull request? This PR added a physical rule to remove redundant project nodes. A `ProjectExec` is redundant when 1. It has the same output

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

dongjoon-hyun commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451203379 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] viirya commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

viirya commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451202576 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] maropu commented on a change in pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

maropu commented on a change in pull request #28676: URL: https://github.com/apache/spark/pull/28676#discussion_r451202429 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/joins/BroadcastJoinSuite.scala ## @@ -415,6 +417,192 @@ abstract class

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

dongjoon-hyun commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r451202038 ## File path: pom.xml ## @@ -3059,13 +3062,28 @@ 2.7.1 2.4 + + + org.apache.hadoop +

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

dongjoon-hyun commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r451201726 ## File path: pom.xml ## @@ -202,6 +202,9 @@ 0.15.1 org.fusesource.leveldbjni + + +0.5.0-beta Review comment:

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

AmplabJenkins removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655194334 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

dongjoon-hyun commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r451201889 ## File path: pom.xml ## @@ -3059,13 +3062,28 @@ 2.7.1 2.4 + Review comment: indentation?

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

dongjoon-hyun commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r451201726 ## File path: pom.xml ## @@ -202,6 +202,9 @@ 0.15.1 org.fusesource.leveldbjni + + +0.5.0-beta Review comment:

[GitHub] [spark] AmplabJenkins commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

AmplabJenkins commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655194334 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

SparkQA commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655193968 **[Test build #125267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125267/testReport)** for PR 28859 at commit

[GitHub] [spark] maropu commented on a change in pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

maropu commented on a change in pull request #28676: URL: https://github.com/apache/spark/pull/28676#discussion_r451200682 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoinExec.scala ## @@ -60,6 +62,66 @@ case class

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

dongjoon-hyun commented on a change in pull request #29027: URL: https://github.com/apache/spark/pull/29027#discussion_r451200309 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -132,9 +134,12 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655192099 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655192099 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

HeartSaVioR commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655191991 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655189867 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655191653 **[Test build #125266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125266/testReport)** for PR 28969 at commit

[GitHub] [spark] maropu commented on a change in pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

maropu commented on a change in pull request #28676: URL: https://github.com/apache/spark/pull/28676#discussion_r451198766 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoinExec.scala ## @@ -60,6 +62,66 @@ case class

[GitHub] [spark] maropu commented on a change in pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

maropu commented on a change in pull request #28676: URL: https://github.com/apache/spark/pull/28676#discussion_r451198827 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoinExec.scala ## @@ -60,6 +62,66 @@ case class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

AmplabJenkins removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655190097 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

AmplabJenkins removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655190088 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

AmplabJenkins commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655190088 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655189857 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655189857 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

SparkQA removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655089669 **[Test build #125250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125250/testReport)** for PR 28859 at commit

[GitHub] [spark] SparkQA commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

SparkQA commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655189423 **[Test build #125250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125250/testReport)** for PR 28859 at commit

[GitHub] [spark] maropu commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

maropu commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655189284 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

SparkQA removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655089566 **[Test build #125247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125247/testReport)** for PR 28969 at commit

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655188665 **[Test build #125247 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125247/testReport)** for PR 28969 at commit

[GitHub] [spark] maropu commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

maropu commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451194966 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/UDAQuerySuite.scala ## @@ -354,6 +367,12 @@ abstract class UDAQuerySuite

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655184887 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

AmplabJenkins commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-655185232 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

AmplabJenkins removed a comment on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-655185232 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

maropu commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451193484 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/udaf.scala ## @@ -517,3 +519,18 @@ case class ScalaAggregator[IN, BUF,

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655184881 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655184881 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

SparkQA removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655059872 **[Test build #125246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125246/testReport)** for PR 29020 at commit

[GitHub] [spark] maropu commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

maropu commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451192824 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -678,6 +678,9 @@ object MapObjects {

[GitHub] [spark] maropu commented on a change in pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

maropu commented on a change in pull request #28983: URL: https://github.com/apache/spark/pull/28983#discussion_r451192558 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -678,6 +678,9 @@ object MapObjects {

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655184146 **[Test build #125246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125246/testReport)** for PR 29020 at commit

[GitHub] [spark] maropu commented on pull request #29027: [SPARK-32163][SQL][3.0] Nested pruning should work even with cosmetic variations

maropu commented on pull request #29027: URL: https://github.com/apache/spark/pull/29027#issuecomment-655183464 Thanks for the backport, @viirya . This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

AmplabJenkins removed a comment on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-655183548 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

AmplabJenkins commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-655183548 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

SparkQA commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-655182927 **[Test build #125233 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125233/testReport)** for PR 28988 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

SparkQA removed a comment on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654952432 **[Test build #125233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125233/testReport)** for PR 28988 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

SparkQA removed a comment on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-654952244 **[Test build #125232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125232/testReport)** for PR 28996 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655181300 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

SparkQA commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-655182001 **[Test build #125232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125232/testReport)** for PR 28996 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

AmplabJenkins removed a comment on pull request #29030: URL: https://github.com/apache/spark/pull/29030#issuecomment-655179673 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655181300 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655180245 **[Test build #125265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125265/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

AmplabJenkins commented on pull request #29030: URL: https://github.com/apache/spark/pull/29030#issuecomment-655180725 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

AmplabJenkins commented on pull request #29030: URL: https://github.com/apache/spark/pull/29030#issuecomment-655179673 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] bharatviswa504 opened a new pull request #29030: SPARK-32093. Add hadoop-ozone-filesystem jar to ozone profile.

bharatviswa504 opened a new pull request #29030: URL: https://github.com/apache/spark/pull/29030 ### What changes were proposed in this pull request? Add ozone profile, so that ozone file system jar is packaged in spark tarball. ### Why are the changes needed? This

[GitHub] [spark] maropu commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

maropu commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655178646 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] maropu commented on a change in pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

maropu commented on a change in pull request #29029: URL: https://github.com/apache/spark/pull/29029#discussion_r451188931 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/python/EvaluatePython.scala ## @@ -198,7 +198,7 @@ object EvaluatePython {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655174556 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655167692 **[Test build #125263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125263/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655174548 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655174548 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on a change in pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

maropu commented on a change in pull request #29029: URL: https://github.com/apache/spark/pull/29029#discussion_r451185171 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/python/EvaluatePython.scala ## @@ -198,7 +198,7 @@ object EvaluatePython {

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655174525 **[Test build #125263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125263/testReport)** for PR 28986 at commit

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29010: [SPARK-32192][SQL] Print column name when throws ClassCastException

dongjoon-hyun commented on a change in pull request #29010: URL: https://github.com/apache/spark/pull/29010#discussion_r451180805 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala ## @@ -20,6 +20,7 @@ package org.apache.spark.sql.hive import

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655170151 **[Test build #125264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125264/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655168079 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655168079 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655167692 **[Test build #125263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125263/testReport)** for PR 28986 at commit

[GitHub] [spark] ueshin commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

ueshin commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655167474 Jenkins, retest this please. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

dongjoon-hyun commented on a change in pull request #29029: URL: https://github.com/apache/spark/pull/29029#discussion_r451176660 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/python/EvaluatePython.scala ## @@ -198,7 +198,7 @@ object EvaluatePython {

<    1   2   3   4   5   6   7   8   9   10   >