[GitHub] [spark] AmplabJenkins removed a comment on pull request #32202: [SPARK-28098][SQL]Supporting non-partitioned Hive tables with subdirectories

AmplabJenkins removed a comment on pull request #32202: URL: https://github.com/apache/spark/pull/32202#issuecomment-823182821 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42212/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32239: [SPARK-34639][SQL][3.1] RelationalGroupedDataset.alias should not create UnresolvedAlias

AmplabJenkins removed a comment on pull request #32239: URL: https://github.com/apache/spark/pull/32239#issuecomment-823182820 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42209/

[GitHub] [spark] AmplabJenkins commented on pull request #32254: [SPARK-35143][ML] Removes the default number of partitions used for parallelize functions

AmplabJenkins commented on pull request #32254: URL: https://github.com/apache/spark/pull/32254#issuecomment-823183029 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins commented on pull request #32239: [SPARK-34639][SQL][3.1] RelationalGroupedDataset.alias should not create UnresolvedAlias

AmplabJenkins commented on pull request #32239: URL: https://github.com/apache/spark/pull/32239#issuecomment-823182820 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42209/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32202: [SPARK-28098][SQL]Supporting non-partitioned Hive tables with subdirectories

AmplabJenkins commented on pull request #32202: URL: https://github.com/apache/spark/pull/32202#issuecomment-823182821 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42212/ --

[GitHub] [spark] SparkQA commented on pull request #32202: [SPARK-28098][SQL]Supporting non-partitioned Hive tables with subdirectories

SparkQA commented on pull request #32202: URL: https://github.com/apache/spark/pull/32202#issuecomment-823181612 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42212/ --

[GitHub] [spark] luhenry commented on pull request #32253: Accelerate fallback BLAS with dev.ludovic.netlib

luhenry commented on pull request #32253: URL: https://github.com/apache/spark/pull/32253#issuecomment-823181385 I'm adding support for JDK 8 with [v1.0.11](https://github.com/luhenry/netlib/tree/v1.0.11) (Benchmarks at https://github.com/luhenry/netlib/actions/runs/766849718) -- This

[GitHub] [spark] SparkQA commented on pull request #32239: [SPARK-34639][SQL][3.1] RelationalGroupedDataset.alias should not create UnresolvedAlias

SparkQA commented on pull request #32239: URL: https://github.com/apache/spark/pull/32239#issuecomment-823178924 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AngersZhuuuu commented on pull request #32001: [SPARK-34902][SQL] Support cast between LongType & DayTimeIntervalType and IntegerType & YearMonthIntervalType

AngersZh commented on pull request #32001: URL: https://github.com/apache/spark/pull/32001#issuecomment-823172232 PG not support similar `cast` 

[GitHub] [spark] AngersZhuuuu commented on pull request #31010: [SPARK-33976][SQL][DOCS] Add a SQL doc page for a TRANSFORM clause

AngersZh commented on pull request #31010: URL: https://github.com/apache/spark/pull/31010#issuecomment-823167454 @cloud-fan @maropu @srowen Thanks for your review, I will raise a new pr for master branch soon. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] cloud-fan closed pull request #31010: [SPARK-33976][SQL][DOCS] Add a SQL doc page for a TRANSFORM clause

cloud-fan closed pull request #31010: URL: https://github.com/apache/spark/pull/31010 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] cloud-fan commented on pull request #31010: [SPARK-33976][SQL][DOCS] Add a SQL doc page for a TRANSFORM clause

cloud-fan commented on pull request #31010: URL: https://github.com/apache/spark/pull/31010#issuecomment-823166555 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] ChenDou2021 opened a new pull request #32254: [SPARK-35143][ML] Removes the default number of partitions used for parallelize functions

ChenDou2021 opened a new pull request #32254: URL: https://github.com/apache/spark/pull/32254 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ###

[GitHub] [spark] MaxGekk closed pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

MaxGekk closed pull request #32250: URL: https://github.com/apache/spark/pull/32250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] MaxGekk commented on pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

MaxGekk commented on pull request #32250: URL: https://github.com/apache/spark/pull/32250#issuecomment-823159245 +1, LGTM. Merging to master. Thank you, @AngersZh. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

AmplabJenkins removed a comment on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823158491 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42211/

[GitHub] [spark] SparkQA commented on pull request #32202: [SPARK-28098][SQL]Supporting non-partitioned Hive tables with subdirectories

SparkQA commented on pull request #32202: URL: https://github.com/apache/spark/pull/32202#issuecomment-823158600 **[Test build #137684 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137684/testReport)** for PR 32202 at commit

[GitHub] [spark] SparkQA commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

SparkQA commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823158464 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42211/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

AmplabJenkins commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823158491 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42211/ --

[GitHub] [spark] maropu commented on pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

maropu commented on pull request #32249: URL: https://github.com/apache/spark/pull/32249#issuecomment-823157605 Looks fine if the failure fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32228: [SPARK-34035][SQL] Refactor ScriptTransformation to remove input parameter and replace it by child.output

AngersZh commented on a change in pull request #32228: URL: https://github.com/apache/spark/pull/32228#discussion_r616546346 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -772,9 +772,6 @@ object ColumnPruning

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

AmplabJenkins removed a comment on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823156676 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42210/

[GitHub] [spark] AmplabJenkins commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

AmplabJenkins commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823156676 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42210/ --

[GitHub] [spark] SparkQA commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

SparkQA commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823156542 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42210/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

AmplabJenkins commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823155907 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137683/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

SparkQA removed a comment on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823151934 **[Test build #137683 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137683/testReport)** for PR 31638 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

AmplabJenkins removed a comment on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823155907 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137683/

[GitHub] [spark] SparkQA commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

SparkQA commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823155869 **[Test build #137683 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137683/testReport)** for PR 31638 at commit

[GitHub] [spark] maropu commented on a change in pull request #32228: [SPARK-34035][SQL] Refactor ScriptTransformation to remove input parameter and replace it by child.output

maropu commented on a change in pull request #32228: URL: https://github.com/apache/spark/pull/32228#discussion_r616541698 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -772,9 +772,6 @@ object ColumnPruning extends

[GitHub] [spark] SparkQA removed a comment on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

SparkQA removed a comment on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823149624 **[Test build #137682 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137682/testReport)** for PR 31638 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

AmplabJenkins removed a comment on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823153961 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137682/

[GitHub] [spark] AmplabJenkins commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

AmplabJenkins commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823153961 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137682/ -- This

[GitHub] [spark] SparkQA commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

SparkQA commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823153925 **[Test build #137682 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137682/testReport)** for PR 31638 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

AmplabJenkins removed a comment on pull request #32249: URL: https://github.com/apache/spark/pull/32249#issuecomment-823153165 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137678/

[GitHub] [spark] AngersZhuuuu removed a comment on pull request #32252: [SPARK-35094][SQL]Spark from_json(JsonToStruct) function return wrong value in permissive mode

AngersZh removed a comment on pull request #32252: URL: https://github.com/apache/spark/pull/32252#issuecomment-823140972 test this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AmplabJenkins commented on pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

AmplabJenkins commented on pull request #32249: URL: https://github.com/apache/spark/pull/32249#issuecomment-823153165 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137678/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

SparkQA removed a comment on pull request #32249: URL: https://github.com/apache/spark/pull/32249#issuecomment-823067877 **[Test build #137678 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137678/testReport)** for PR 32249 at commit

[GitHub] [spark] SparkQA commented on pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

SparkQA commented on pull request #32249: URL: https://github.com/apache/spark/pull/32249#issuecomment-823152508 **[Test build #137678 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137678/testReport)** for PR 32249 at commit

[GitHub] [spark] SparkQA commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

SparkQA commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823151934 **[Test build #137683 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137683/testReport)** for PR 31638 at commit

[GitHub] [spark] attilapiros commented on pull request #32202: [SPARK-28098][SQL]Supporting non-partitioned Hive tables with subdirectories

attilapiros commented on pull request #32202: URL: https://github.com/apache/spark/pull/32202#issuecomment-823151771 cc @peter-toth -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] xuanyuanking commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

xuanyuanking commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823151538 @HeartSaVioR Agree. Updated has done. Let's fix the regression in this PR first. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #31638: [SPARK-34526][SS] Ignore the error when checking the path in FileStreamSink.hasMetadata

SparkQA commented on pull request #31638: URL: https://github.com/apache/spark/pull/31638#issuecomment-823149624 **[Test build #137682 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137682/testReport)** for PR 31638 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31974: [SPARK-34877][CORE][YARN]Add the code change for adding the Spark AM log link in spark UI

AmplabJenkins removed a comment on pull request #31974: URL: https://github.com/apache/spark/pull/31974#issuecomment-823038348 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42197/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

AmplabJenkins removed a comment on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-823148566 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137674/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

AmplabJenkins removed a comment on pull request #32250: URL: https://github.com/apache/spark/pull/32250#issuecomment-823148559 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #32239: [SPARK-34639][SQL][3.1] RelationalGroupedDataset.alias should not create UnresolvedAlias

SparkQA commented on pull request #32239: URL: https://github.com/apache/spark/pull/32239#issuecomment-823149091 **[Test build #137681 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137681/testReport)** for PR 32239 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32228: [SPARK-34035][SQL] Refactor ScriptTransformation to remove input parameter and replace it by child.output

AmplabJenkins removed a comment on pull request #32228: URL: https://github.com/apache/spark/pull/32228#issuecomment-823148562 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42208/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31974: [SPARK-34877][CORE][YARN]Add the code change for adding the Spark AM log link in spark UI

AmplabJenkins removed a comment on pull request #31974: URL: https://github.com/apache/spark/pull/31974#issuecomment-823148563 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137669/

[GitHub] [spark] AmplabJenkins commented on pull request #32228: [SPARK-34035][SQL] Refactor ScriptTransformation to remove input parameter and replace it by child.output

AmplabJenkins commented on pull request #32228: URL: https://github.com/apache/spark/pull/32228#issuecomment-823148562 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42208/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31974: [SPARK-34877][CORE][YARN]Add the code change for adding the Spark AM log link in spark UI

AmplabJenkins commented on pull request #31974: URL: https://github.com/apache/spark/pull/31974#issuecomment-823148563 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137669/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32252: [SPARK-35094][SQL]Spark from_json(JsonToStruct) function return wrong value in permissive mode

AmplabJenkins commented on pull request #32252: URL: https://github.com/apache/spark/pull/32252#issuecomment-823148728 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins commented on pull request #32253: Accelerate fallback BLAS with dev.ludovic.netlib

AmplabJenkins commented on pull request #32253: URL: https://github.com/apache/spark/pull/32253#issuecomment-823148693 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins commented on pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

AmplabJenkins commented on pull request #32250: URL: https://github.com/apache/spark/pull/32250#issuecomment-823148560 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

AmplabJenkins commented on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-823148566 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137674/ -- This

[GitHub] [spark] Peng-Lei commented on pull request #32252: [SPARK-35094][SQL]Spark from_json(JsonToStruct) function return wrong value in permissive mode

Peng-Lei commented on pull request #32252: URL: https://github.com/apache/spark/pull/32252#issuecomment-823147189 > pls change UT to `[SPARK-35094][SQL] xxx` @AngersZh done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] Peng-Lei commented on pull request #32252: [SPARK-35094][SQL]Spark from_json(JsonToStruct) function return wrong value in permissive mode

Peng-Lei commented on pull request #32252: URL: https://github.com/apache/spark/pull/32252#issuecomment-823146691 @MaxGekk Hi, could you please help to review on this ? thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] SparkQA commented on pull request #32228: [SPARK-34035][SQL] Refactor ScriptTransformation to remove input parameter and replace it by child.output

SparkQA commented on pull request #32228: URL: https://github.com/apache/spark/pull/32228#issuecomment-823145628 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA removed a comment on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

SparkQA removed a comment on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-823027790 **[Test build #137674 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137674/testReport)** for PR 32146 at commit

[GitHub] [spark] luhenry opened a new pull request #32253: Accelerate fallback BLAS with dev.ludovic.netlib

luhenry opened a new pull request #32253: URL: https://github.com/apache/spark/pull/32253 ### What changes were proposed in this pull request? Following https://github.com/apache/spark/pull/30810, I've continued looking for ways to accelerate the usage of BLAS in Spark.

[GitHub] [spark] SparkQA commented on pull request #32146: [SPARK-34990][SQL][TESTS] Add ParquetEncryptionSuite

SparkQA commented on pull request #32146: URL: https://github.com/apache/spark/pull/32146#issuecomment-823142674 **[Test build #137674 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137674/testReport)** for PR 32146 at commit

[GitHub] [spark] SparkQA commented on pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

SparkQA commented on pull request #32250: URL: https://github.com/apache/spark/pull/32250#issuecomment-823142553 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AngersZhuuuu commented on pull request #32252: fix spark-35094

AngersZh commented on pull request #32252: URL: https://github.com/apache/spark/pull/32252#issuecomment-823140902 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] LuciferYang commented on pull request #32227: [SPARK-35132][BUILD][CORE] Upgrade netty-all to 4.1.63.Final

LuciferYang commented on pull request #32227: URL: https://github.com/apache/spark/pull/32227#issuecomment-823137116 @dongjoon-hyun @HyukjinKwon @srowen All test passed now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] xuanyuanking commented on pull request #31989: [SPARK-34891][SS] Introduce state store manager for session window in streaming query

xuanyuanking commented on pull request #31989: URL: https://github.com/apache/spark/pull/31989#issuecomment-823135370 @viirya Sorry for the late. Just back from the work on open-sourcing RocksDBStateStore. Since the design has been published. I can back to this now. I'm +1 for the

[GitHub] [spark] SparkQA removed a comment on pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

SparkQA removed a comment on pull request #32250: URL: https://github.com/apache/spark/pull/32250#issuecomment-823109907 **[Test build #137679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137679/testReport)** for PR 32250 at commit

[GitHub] [spark] SparkQA commented on pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

SparkQA commented on pull request #32250: URL: https://github.com/apache/spark/pull/32250#issuecomment-823134873 **[Test build #137679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137679/testReport)** for PR 32250 at commit

[GitHub] [spark] Peng-Lei opened a new pull request #32252: fix spark-35094

Peng-Lei opened a new pull request #32252: URL: https://github.com/apache/spark/pull/32252 ### What changes were proposed in this pull request? In https://issues.apache.org/jira/browse/SPARK-35094, When use spark from_json(JsonToStruct) function in permissive mode to handle the case of

[GitHub] [spark] SparkQA removed a comment on pull request #31974: [SPARK-34877][CORE][YARN]Add the code change for adding the Spark AM log link in spark UI

SparkQA removed a comment on pull request #31974: URL: https://github.com/apache/spark/pull/31974#issuecomment-822997550 **[Test build #137669 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137669/testReport)** for PR 31974 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32072: [SPARK-34974][SQL] Improve subquery decorrelation framework

SparkQA removed a comment on pull request #32072: URL: https://github.com/apache/spark/pull/32072#issuecomment-822956888 **[Test build #137667 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137667/testReport)** for PR 32072 at commit

[GitHub] [spark] Peng-Lei closed pull request #32251: [SPARK-35094][SQL]Spark from_json(JsonToStruct) function return wrong value in permissive mode

Peng-Lei closed pull request #32251: URL: https://github.com/apache/spark/pull/32251 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] Peng-Lei opened a new pull request #32251: [SPARK-35094][SQL]Spark from_json(JsonToStruct) function return wrong value in permissive mode

Peng-Lei opened a new pull request #32251: URL: https://github.com/apache/spark/pull/32251 ### Why are the changes needed? In https://issues.apache.org/jira/browse/SPARK-35094, When use spark from_json(JsonToStruct) function in permissive mode to handle the case of contains incorrect

[GitHub] [spark] SparkQA commented on pull request #31974: [SPARK-34877][CORE][YARN]Add the code change for adding the Spark AM log link in spark UI

SparkQA commented on pull request #31974: URL: https://github.com/apache/spark/pull/31974#issuecomment-823125287 **[Test build #137669 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137669/testReport)** for PR 31974 at commit

[GitHub] [spark] cloud-fan closed pull request #32072: [SPARK-34974][SQL] Improve subquery decorrelation framework

cloud-fan closed pull request #32072: URL: https://github.com/apache/spark/pull/32072 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] cloud-fan commented on pull request #32072: [SPARK-34974][SQL] Improve subquery decorrelation framework

cloud-fan commented on pull request #32072: URL: https://github.com/apache/spark/pull/32072#issuecomment-823124078 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins commented on pull request #32072: [SPARK-34974][SQL] Improve subquery decorrelation framework

AmplabJenkins commented on pull request #32072: URL: https://github.com/apache/spark/pull/32072#issuecomment-823123266 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137667/ -- This

[GitHub] [spark] kyoty commented on a change in pull request #32223: [WIP][SPARK-35127][UI] When we switch between different stage-detail pages, the entry item in the newly-opened page may be blank.

kyoty commented on a change in pull request #32223: URL: https://github.com/apache/spark/pull/32223#discussion_r616504336 ## File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js ## @@ -747,6 +747,7 @@ $(document).ready(function () {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32227: [SPARK-35132][BUILD][CORE] Upgrade netty-all to 4.1.63.Final

AmplabJenkins removed a comment on pull request #32227: URL: https://github.com/apache/spark/pull/32227#issuecomment-823116070 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137671/

[GitHub] [spark] SparkQA commented on pull request #32072: [SPARK-34974][SQL] Improve subquery decorrelation framework

SparkQA commented on pull request #32072: URL: https://github.com/apache/spark/pull/32072#issuecomment-823121699 **[Test build #137667 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137667/testReport)** for PR 32072 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

AmplabJenkins removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-823120150 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137675/

[GitHub] [spark] AmplabJenkins commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

AmplabJenkins commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-823120150 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137675/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

SparkQA removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-823027862 **[Test build #137675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137675/testReport)** for PR 32031 at commit

[GitHub] [spark] SparkQA commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-823119110 **[Test build #137675 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137675/testReport)** for PR 32031 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32227: [SPARK-35132][BUILD][CORE] Upgrade netty-all to 4.1.63.Final

AmplabJenkins commented on pull request #32227: URL: https://github.com/apache/spark/pull/32227#issuecomment-823116070 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137671/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32227: [SPARK-35132][BUILD][CORE] Upgrade netty-all to 4.1.63.Final

SparkQA removed a comment on pull request #32227: URL: https://github.com/apache/spark/pull/32227#issuecomment-823005681 **[Test build #137671 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137671/testReport)** for PR 32227 at commit

[GitHub] [spark] SparkQA commented on pull request #32227: [SPARK-35132][BUILD][CORE] Upgrade netty-all to 4.1.63.Final

SparkQA commented on pull request #32227: URL: https://github.com/apache/spark/pull/32227#issuecomment-823114352 **[Test build #137671 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137671/testReport)** for PR 32227 at commit

[GitHub] [spark] SparkQA commented on pull request #32228: [SPARK-34035][SQL] Refactor ScriptTransformation to remove input parameter and replace it by child.output

SparkQA commented on pull request #32228: URL: https://github.com/apache/spark/pull/32228#issuecomment-823112474 **[Test build #137680 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137680/testReport)** for PR 32228 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

AmplabJenkins removed a comment on pull request #32249: URL: https://github.com/apache/spark/pull/32249#issuecomment-823111207 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42206/

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32228: [SPARK-34035][SQL] Refactor ScriptTransformation to remove input parameter and replace it by child.output

AngersZh commented on a change in pull request #32228: URL: https://github.com/apache/spark/pull/32228#discussion_r616490950 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/ScriptTransformation.scala ## @@ -17,24 +17,22 @@ package

[GitHub] [spark] AmplabJenkins commented on pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

AmplabJenkins commented on pull request #32249: URL: https://github.com/apache/spark/pull/32249#issuecomment-823111207 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42206/ --

[GitHub] [spark] SparkQA commented on pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

SparkQA commented on pull request #32249: URL: https://github.com/apache/spark/pull/32249#issuecomment-82372 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32247: [WIP][SPARK-35075] Add traversal pruning for subquery related rules

AmplabJenkins removed a comment on pull request #32247: URL: https://github.com/apache/spark/pull/32247#issuecomment-823109084 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42201/

[GitHub] [spark] SparkQA commented on pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

SparkQA commented on pull request #32250: URL: https://github.com/apache/spark/pull/32250#issuecomment-823109907 **[Test build #137679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137679/testReport)** for PR 32250 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

AmplabJenkins removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-823109088 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42203/

[GitHub] [spark] AmplabJenkins commented on pull request #32247: [WIP][SPARK-35075] Add traversal pruning for subquery related rules

AmplabJenkins commented on pull request #32247: URL: https://github.com/apache/spark/pull/32247#issuecomment-823109084 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42201/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

AmplabJenkins commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-823109088 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42203/ --

[GitHub] [spark] AngersZhuuuu commented on pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

AngersZh commented on pull request #32250: URL: https://github.com/apache/spark/pull/32250#issuecomment-823106068 FYI @MaxGekk You mean add UT like this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AngersZhuuuu opened a new pull request #32250: [SPARK-35068][SQL] Add tests for ANSI intervals to HiveThriftBinaryServerSuite

AngersZh opened a new pull request #32250: URL: https://github.com/apache/spark/pull/32250 ### What changes were proposed in this pull request? After the PR https://github.com/apache/spark/pull/32209, this should be possible now. We can add test case for ANSI intervals to

[GitHub] [spark] gaborgsomogyi commented on pull request #31944: [SPARK-34854][SQL][SS] Expose source metrics via progress report and add Kafka use-case to report delay.

gaborgsomogyi commented on pull request #31944: URL: https://github.com/apache/spark/pull/31944#issuecomment-823098027 I see that that the comments are resolved but no changes pushed. Are you still working on this, doing some tests or just forgotten? -- This is an automated message from

[GitHub] [spark] cloud-fan commented on a change in pull request #32249: [SPARK-35145][SQL] CurrentOrigin should support nested invoking

cloud-fan commented on a change in pull request #32249: URL: https://github.com/apache/spark/pull/32249#discussion_r616475114 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala ## @@ -74,8 +74,11 @@ object CurrentOrigin { }

[GitHub] [spark] c21 commented on a change in pull request #32242: [SPARK-35141][SQL] Support two level of hash maps for final hash aggregation

c21 commented on a change in pull request #32242: URL: https://github.com/apache/spark/pull/32242#discussion_r616468793 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala ## @@ -128,6 +128,16 @@ case class HashAggregateExec(

<    1   2   3   4   5   6   >