[GitHub] [spark] AmplabJenkins removed a comment on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786109716 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-786109723 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135468/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31650: [SPARK-34152][SQL][FOLLOWUP] Do not uncache the temp view if it doesn't exist

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31650: URL: https://github.com/apache/spark/pull/31650#issuecomment-786109719 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40050/

[GitHub] [spark] srowen commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
srowen commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-786109892 Note to self, if we merge this, we need to update the docs about zinc on spark-website too. This is an

[GitHub] [spark] AmplabJenkins commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786109717 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-786109720 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40051/

[GitHub] [spark] AmplabJenkins commented on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-786109723 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135468/

[GitHub] [spark] AmplabJenkins commented on pull request #31650: [SPARK-34152][SQL][FOLLOWUP] Do not uncache the temp view if it doesn't exist

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31650: URL: https://github.com/apache/spark/pull/31650#issuecomment-786109719 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40050/

[GitHub] [spark] imback82 commented on a change in pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-25 Thread GitBox
imback82 commented on a change in pull request #31273: URL: https://github.com/apache/spark/pull/31273#discussion_r583065179 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala ## @@ -111,12 +111,11 @@ case class CreateViewCommand(

[GitHub] [spark] MaxGekk commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
MaxGekk commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786105325 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] imback82 opened a new pull request #31652: [SPARK-34546][SQL] AlterViewAs.query should be analyzed during the analysis phase

2021-02-25 Thread GitBox
imback82 opened a new pull request #31652: URL: https://github.com/apache/spark/pull/31652 ### What changes were proposed in this pull request? `AlterViewAs.query` is currently analyzed in the physical operator `AlterViewAsCommand`, but it should be analyzed during the

[GitHub] [spark] SparkQA commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
SparkQA commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-786098342 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40051/

[GitHub] [spark] SparkQA removed a comment on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
SparkQA removed a comment on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-785910926 **[Test build #135468 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135468/testReport)** for PR 31644 at commit

[GitHub] [spark] SparkQA commented on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
SparkQA commented on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-786097768 **[Test build #135468 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135468/testReport)** for PR 31644 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
SparkQA removed a comment on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786049196 **[Test build #135474 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135474/testReport)** for PR 31651 at commit

[GitHub] [spark] SparkQA commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
SparkQA commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786095834 **[Test build #135474 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135474/testReport)** for PR 31651 at commit

[GitHub] [spark] viirya commented on pull request #31595: [SPARK-34474][SQL] Remove unnecessary Union under Distinct/Deduplicate

2021-02-25 Thread GitBox
viirya commented on pull request #31595: URL: https://github.com/apache/spark/pull/31595#issuecomment-786092508 Hi @dongjoon-hyun, you have a required change, any more comment? Thanks. This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
SparkQA commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786083971 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40054/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786081531 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40052/

[GitHub] [spark] AmplabJenkins commented on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786081531 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40052/

[GitHub] [spark] SparkQA commented on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
SparkQA commented on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786081491 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40052/

[GitHub] [spark] SparkQA commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
SparkQA commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-786079457 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40051/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31535: [SPARK-34415][ML] Randomization in hyperparameter optimization

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31535: URL: https://github.com/apache/spark/pull/31535#issuecomment-786071414 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40053/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786071413 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135472/

[GitHub] [spark] AmplabJenkins commented on pull request #31535: [SPARK-34415][ML] Randomization in hyperparameter optimization

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31535: URL: https://github.com/apache/spark/pull/31535#issuecomment-786071414 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40053/

[GitHub] [spark] AmplabJenkins commented on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786071413 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135472/

[GitHub] [spark] SparkQA removed a comment on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
SparkQA removed a comment on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786045165 **[Test build #135472 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135472/testReport)** for PR 31600 at commit

[GitHub] [spark] SparkQA commented on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
SparkQA commented on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786068019 **[Test build #135472 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135472/testReport)** for PR 31600 at commit

[GitHub] [spark] SparkQA commented on pull request #31535: [SPARK-34415][ML] Randomization in hyperparameter optimization

2021-02-25 Thread GitBox
SparkQA commented on pull request #31535: URL: https://github.com/apache/spark/pull/31535#issuecomment-786064893 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40053/

[GitHub] [spark] SparkQA commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
SparkQA commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786064386 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40054/

[GitHub] [spark] SparkQA commented on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
SparkQA commented on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786061900 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40052/

[GitHub] [spark] SparkQA commented on pull request #31535: [SPARK-34415][ML] Randomization in hyperparameter optimization

2021-02-25 Thread GitBox
SparkQA commented on pull request #31535: URL: https://github.com/apache/spark/pull/31535#issuecomment-786061733 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40053/

[GitHub] [spark] SparkQA commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
SparkQA commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786049196 **[Test build #135474 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135474/testReport)** for PR 31651 at commit

[GitHub] [spark] MaxGekk commented on pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
MaxGekk commented on pull request #31651: URL: https://github.com/apache/spark/pull/31651#issuecomment-786048100 @dongjoon-hyun @HyukjinKwon Could you review this PR. It fixes similar issue as https://github.com/apache/spark/pull/30615 which you have reviewed already.

[GitHub] [spark] SparkQA commented on pull request #31535: [SPARK-34415][ML] Randomization in hyperparameter optimization

2021-02-25 Thread GitBox
SparkQA commented on pull request #31535: URL: https://github.com/apache/spark/pull/31535#issuecomment-786046756 **[Test build #135473 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135473/testReport)** for PR 31535 at commit

[GitHub] [spark] SparkQA commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
SparkQA commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-786046621 **[Test build #135471 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135471/testReport)** for PR 31647 at commit

[GitHub] [spark] SparkQA commented on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
SparkQA commented on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786045165 **[Test build #135472 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135472/testReport)** for PR 31600 at commit

[GitHub] [spark] xkrogen commented on pull request #31642: [SPARK-33212][FOLLOWUP][test-maven][test-hadoop3.2][test-hadoop2.7] Add hadoop-yarn-server-web-proxy for Hadoop 3.x profile

2021-02-25 Thread GitBox
xkrogen commented on pull request #31642: URL: https://github.com/apache/spark/pull/31642#issuecomment-786035316 This seems like a decent workaround, but is it the right long-term fix? It seems like depending on the non-shaded JAR breaks the benefits of leveraging only the shaded

[GitHub] [spark] MaxGekk opened a new pull request #31651: [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`

2021-02-25 Thread GitBox
MaxGekk opened a new pull request #31651: URL: https://github.com/apache/spark/pull/31651 ### What changes were proposed in this pull request? Preprocess the partition spec passed to the V1 `ALTER TABLE .. SET LOCATION` implementation `AlterTableSetLocationCommand`, and normalize the

[GitHub] [spark] SparkQA commented on pull request #31650: [SPARK-34152][SQL][FOLLOWUP] Do not uncache the temp view if it doesn't exist

2021-02-25 Thread GitBox
SparkQA commented on pull request #31650: URL: https://github.com/apache/spark/pull/31650#issuecomment-786031217 **[Test build #135470 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135470/testReport)** for PR 31650 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-786029412 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135466/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-786029416 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40049/

[GitHub] [spark] srowen commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
srowen commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-786029864 It could be hard to reproduce zstd returning 0 bytes before EOF. If we can we'd mostly be testing what zstd tests already - the stream just never returns 0 bytes before done. If

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-786029413 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135467/

[GitHub] [spark] AmplabJenkins commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-786029416 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40049/

[GitHub] [spark] AmplabJenkins commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-786029413 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135467/

[GitHub] [spark] AmplabJenkins commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-786029412 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135466/

[GitHub] [spark] srowen commented on pull request #31535: [SPARK-34415][ML] Randomization in hyperparameter optimization

2021-02-25 Thread GitBox
srowen commented on pull request #31535: URL: https://github.com/apache/spark/pull/31535#issuecomment-786028771 Jenkins retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] srowen commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
srowen commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-786027937 Jenkins retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] Ngone51 commented on a change in pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for StreamExecution.logicalPlan

2021-02-25 Thread GitBox
Ngone51 commented on a change in pull request #31600: URL: https://github.com/apache/spark/pull/31600#discussion_r582967118 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala ## @@ -323,26 +323,28 @@ abstract class

[GitHub] [spark] Ngone51 commented on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for streaming query

2021-02-25 Thread GitBox
Ngone51 commented on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-786017148 Hi all, I realized that the issue actually only affect the `StreamExecution.logicalPlan`. (I have added the test for it). While for the

[GitHub] [spark] mridulm commented on pull request #31648: [SPARK-34541][core]Fixed an issue where data could not be cleaned up when unregisterShuffle.

2021-02-25 Thread GitBox
mridulm commented on pull request #31648: URL: https://github.com/apache/spark/pull/31648#issuecomment-786014481 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-02-25 Thread GitBox
SparkQA commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-786013576 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40049/

[GitHub] [spark] SparkQA removed a comment on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
SparkQA removed a comment on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785908602 **[Test build #135466 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135466/testReport)** for PR 31645 at commit

[GitHub] [spark] SparkQA commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
SparkQA commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-786011408 **[Test build #135466 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135466/testReport)** for PR 31645 at commit

[GitHub] [spark] mridulm commented on pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

2021-02-25 Thread GitBox
mridulm commented on pull request #31643: URL: https://github.com/apache/spark/pull/31643#issuecomment-786008067 Can we add a test to validate and ensure this does not happen in future ? This is an automated message from the

[GitHub] [spark] mridulm commented on pull request #31643: [SPARK-34534] Fix blockIds order when use FetchShuffleBlocks to fetch blocks

2021-02-25 Thread GitBox
mridulm commented on pull request #31643: URL: https://github.com/apache/spark/pull/31643#issuecomment-786007281 +CC @otterc This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #31650: [SPARK-34152][SQL][FOLLOWUP] Do not uncache the temp view if it doesn't exist

2021-02-25 Thread GitBox
cloud-fan commented on pull request #31650: URL: https://github.com/apache/spark/pull/31650#issuecomment-786004243 cc @imback82 @LuciferYang This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-25 Thread GitBox
cloud-fan commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-786003958 @LuciferYang thanks for reporting! I'm fixing it in https://github.com/apache/spark/pull/31650 This is an

[GitHub] [spark] cloud-fan opened a new pull request #31650: [SPARK-34152][SQL][FOLLOWUP] Do not uncache the temp view if it doesn't exist

2021-02-25 Thread GitBox
cloud-fan opened a new pull request #31650: URL: https://github.com/apache/spark/pull/31650 ### What changes were proposed in this pull request? This PR fixes a mistake in https://github.com/apache/spark/pull/31273. When CREATE OR REPLACE a temp view, we need to uncache the

[GitHub] [spark] SparkQA commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-02-25 Thread GitBox
SparkQA commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-786003477 **[Test build #135469 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135469/testReport)** for PR 31649 at commit

[GitHub] [spark] imback82 commented on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-25 Thread GitBox
imback82 commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-786003048 Thanks @LuciferYang, let me take a look. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] dongjoon-hyun commented on pull request #30939: [DO-NOT-MERGE][SPARK-33913][SPARK-33921][BUILD] Upgrade kafka to 2.7.0 and Upgrade Scala version to 2.12.12

2021-02-25 Thread GitBox
dongjoon-hyun commented on pull request #30939: URL: https://github.com/apache/spark/pull/30939#issuecomment-786001288 Thank you, @ijuma . This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
SparkQA removed a comment on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-785911903 **[Test build #135467 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135467/testReport)** for PR 31647 at commit

[GitHub] [spark] SparkQA commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
SparkQA commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-785997190 **[Test build #135467 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135467/testReport)** for PR 31647 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-785985617 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40048/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-785895471 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-785985617 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40048/

[GitHub] [spark] AmplabJenkins commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-785985616 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40046/

[GitHub] [spark] wangyum opened a new pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-02-25 Thread GitBox
wangyum opened a new pull request #31649: URL: https://github.com/apache/spark/pull/31649 ### What changes were proposed in this pull request? Parquet 1.12.0 release notes: https://github.com/apache/parquet-mr/blob/apache-parquet-1.12.0-rc2/CHANGES.md ### Why

[GitHub] [spark] SparkQA commented on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
SparkQA commented on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-785951234 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40048/

[GitHub] [spark] srowen commented on a change in pull request #31588: [SPARK-34470][ML] VectorSlicer utilize ordering if possible

2021-02-25 Thread GitBox
srowen commented on a change in pull request #31588: URL: https://github.com/apache/spark/pull/31588#discussion_r582891889 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/VectorSlicer.scala ## @@ -110,22 +110,21 @@ final class VectorSlicer @Since("1.5.0")

[GitHub] [spark] srowen commented on a change in pull request #31648: [SPARK-34541][core]Fixed an issue where data could not be cleaned up when unregisterShuffle.

2021-02-25 Thread GitBox
srowen commented on a change in pull request #31648: URL: https://github.com/apache/spark/pull/31648#discussion_r582890410 ## File path: core/src/main/scala/org/apache/spark/shuffle/sort/SortShuffleManager.scala ## @@ -154,7 +154,7 @@ private[spark] class

[GitHub] [spark] dongjoon-hyun commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
dongjoon-hyun commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785938343 In the JIRA, I found the following, but the reason for the version choice is missing. > So, I think it's nessary to upgrade zstd-jni version to 1.4.4-3 in spark2.4 for

[GitHub] [spark] AmplabJenkins commented on pull request #31648: [SPARK-34541][core]Fixed an issue where data could not be cleaned up when unregisterShuffle.

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31648: URL: https://github.com/apache/spark/pull/31648#issuecomment-785934560 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31646: [SPARK-34538][SQL] Hive Metastore support filter by not-in

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31646: URL: https://github.com/apache/spark/pull/31646#issuecomment-785934233 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785934234 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40047/

[GitHub] [spark] AmplabJenkins commented on pull request #31646: [SPARK-34538][SQL] Hive Metastore support filter by not-in

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31646: URL: https://github.com/apache/spark/pull/31646#issuecomment-785934236 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785934234 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40047/

[GitHub] [spark] SparkQA commented on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
SparkQA commented on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-785929975 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40048/

[GitHub] [spark] yikf commented on pull request #31648: [SPARK-34541][core]Fixed an issue where data could not be cleaned up when unregisterShuffle.

2021-02-25 Thread GitBox
yikf commented on pull request #31648: URL: https://github.com/apache/spark/pull/31648#issuecomment-785929222 gentle ping @srowen , thanks for taking a look. This is an automated message from the Apache Git Service. To

[GitHub] [spark] ulysses-you commented on a change in pull request #31646: [SPARK-34538][SQL] Hive Metastore support filter by not-in

2021-02-25 Thread GitBox
ulysses-you commented on a change in pull request #31646: URL: https://github.com/apache/spark/pull/31646#discussion_r582867343 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ## @@ -748,6 +748,10 @@ private[client] class Shim_v0_13

[GitHub] [spark] yikf commented on a change in pull request #31648: [SPARK-34541][core]Fixed an issue where data could not be cleaned up when unregisterShuffle.

2021-02-25 Thread GitBox
yikf commented on a change in pull request #31648: URL: https://github.com/apache/spark/pull/31648#discussion_r582866333 ## File path: core/src/main/scala/org/apache/spark/shuffle/sort/SortShuffleManager.scala ## @@ -154,7 +154,7 @@ private[spark] class

[GitHub] [spark] LuciferYang commented on a change in pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
LuciferYang commented on a change in pull request #31644: URL: https://github.com/apache/spark/pull/31644#discussion_r582859339 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/orc/OrcPartitionReaderFactory.scala ## @@ -98,8 +98,7 @@ case

[GitHub] [spark] SparkQA removed a comment on pull request #31646: [SPARK-34538][SQL] Hive Metastore support filter by not-in

2021-02-25 Thread GitBox
SparkQA removed a comment on pull request #31646: URL: https://github.com/apache/spark/pull/31646#issuecomment-785862257 **[Test build #135465 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135465/testReport)** for PR 31646 at commit

[GitHub] [spark] yikf commented on a change in pull request #31648: [SPARK-34541][core]Fixed an issue where data could not be cleaned up when unregisterShuffle.

2021-02-25 Thread GitBox
yikf commented on a change in pull request #31648: URL: https://github.com/apache/spark/pull/31648#discussion_r582860612 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/StringExpressionsSuite.scala ## @@ -28,7 +28,7 @@ class

[GitHub] [spark] yikf opened a new pull request #31648: [SPARK-34541][core]Fixed an issue where data could not be cleaned up when unregisterShuffle.

2021-02-25 Thread GitBox
yikf opened a new pull request #31648: URL: https://github.com/apache/spark/pull/31648 ### What changes were proposed in this pull request? Fixed an issue where data could not be cleaned up when unregisterShuffle. ### Why are the changes needed? While we use the old shuffle

[GitHub] [spark] LuciferYang commented on a change in pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
LuciferYang commented on a change in pull request #31644: URL: https://github.com/apache/spark/pull/31644#discussion_r582859339 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/orc/OrcPartitionReaderFactory.scala ## @@ -98,8 +98,7 @@ case

[GitHub] [spark] SparkQA commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
SparkQA commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785918153 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40047/

[GitHub] [spark] SparkQA commented on pull request #31646: [SPARK-34538][SQL] Hive Metastore support filter by not-in

2021-02-25 Thread GitBox
SparkQA commented on pull request #31646: URL: https://github.com/apache/spark/pull/31646#issuecomment-785917618 **[Test build #135465 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135465/testReport)** for PR 31646 at commit

[GitHub] [spark] SparkQA commented on pull request #31646: [SPARK-34538][SQL] Hive Metastore support filter by not-in

2021-02-25 Thread GitBox
SparkQA commented on pull request #31646: URL: https://github.com/apache/spark/pull/31646#issuecomment-785915416 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40045/

[GitHub] [spark] SparkQA commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
SparkQA commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-785911903 **[Test build #135467 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135467/testReport)** for PR 31647 at commit

[GitHub] [spark] SparkQA commented on pull request #31644: [SPARK-34535][SQL] Cleanup unused symbol in Orc related code

2021-02-25 Thread GitBox
SparkQA commented on pull request #31644: URL: https://github.com/apache/spark/pull/31644#issuecomment-785910926 **[Test build #135468 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135468/testReport)** for PR 31644 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
HyukjinKwon commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785909578 Yeah this one is fine. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
SparkQA commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785908602 **[Test build #135466 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135466/testReport)** for PR 31645 at commit

[GitHub] [spark] SparkQA commented on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
SparkQA commented on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785907816 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40047/

[GitHub] [spark] Yikun commented on a change in pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
Yikun commented on a change in pull request #31647: URL: https://github.com/apache/spark/pull/31647#discussion_r582843283 ## File path: pom.xml ## @@ -2534,7 +2534,6 @@ true true incremental -true Review comment: The

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31645: [SPARK-30228][BUILD][2.4] Update zstd-jni to 1.4.4-3

2021-02-25 Thread GitBox
AmplabJenkins removed a comment on pull request #31645: URL: https://github.com/apache/spark/pull/31645#issuecomment-785789507 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #31646: [SPARK-34538][SQL] Hive Metastore support filter by not-in

2021-02-25 Thread GitBox
SparkQA commented on pull request #31646: URL: https://github.com/apache/spark/pull/31646#issuecomment-785896966 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40045/

[GitHub] [spark] AmplabJenkins commented on pull request #31647: [SPARK-34539] [BUILD] [INFRA] Remove stand-alone version Zinc server.

2021-02-25 Thread GitBox
AmplabJenkins commented on pull request #31647: URL: https://github.com/apache/spark/pull/31647#issuecomment-785895471 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

<    1   2   3   4   5   6   >