[GitHub] [spark] beliefer opened a new pull request #32513: [SPARK-35378][SQL] Convert LeafRunnableCommand to LocalRelation when query with CTE

beliefer opened a new pull request #32513: URL: https://github.com/apache/spark/pull/32513 ### What changes were proposed in this pull request? Currently, Spark doesn't support `LeafRunnableCommand` as sub query. Because the `LeafRunnableCommand` always output `GenericInternalRow` and

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32510: [SPARK-35376][CORE] Fallback config should override defaultValue

AmplabJenkins removed a comment on pull request #32510: URL: https://github.com/apache/spark/pull/32510#issuecomment-839402590 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42937/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

AmplabJenkins removed a comment on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-839402591 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138407/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32511: [WIP][SPARK-XXXXX][SQL] Show explain strings for logical plans

AmplabJenkins removed a comment on pull request #32511: URL: https://github.com/apache/spark/pull/32511#issuecomment-839402593 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42936/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32506: [SPARK-35374][SQL] Add string-to-number conversion support to JacksonParser

AmplabJenkins removed a comment on pull request #32506: URL: https://github.com/apache/spark/pull/32506#issuecomment-839402592 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138406/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

AmplabJenkins removed a comment on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839402589 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138409/

[GitHub] [spark] AmplabJenkins commented on pull request #32506: [SPARK-35374][SQL] Add string-to-number conversion support to JacksonParser

AmplabJenkins commented on pull request #32506: URL: https://github.com/apache/spark/pull/32506#issuecomment-839402592 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138406/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

AmplabJenkins commented on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-839402591 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138407/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32510: [SPARK-35376][CORE] Fallback config should override defaultValue

AmplabJenkins commented on pull request #32510: URL: https://github.com/apache/spark/pull/32510#issuecomment-839402590 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42937/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32511: [WIP][SPARK-XXXXX][SQL] Show explain strings for logical plans

AmplabJenkins commented on pull request #32511: URL: https://github.com/apache/spark/pull/32511#issuecomment-839402593 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42936/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

AmplabJenkins commented on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839402589 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138409/ -- This

[GitHub] [spark] SparkQA commented on pull request #32510: [SPARK-35376][CORE] Fallback config should override defaultValue

SparkQA commented on pull request #32510: URL: https://github.com/apache/spark/pull/32510#issuecomment-839401304 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA removed a comment on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

SparkQA removed a comment on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-839231915 **[Test build #138407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138407/testReport)** for PR 32476 at commit

[GitHub] [spark] SparkQA commented on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

SparkQA commented on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-839398453 **[Test build #138407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138407/testReport)** for PR 32476 at commit

[GitHub] [spark] SparkQA commented on pull request #32511: [WIP][SPARK-XXXXX][SQL] Show explain strings for logical plans

SparkQA commented on pull request #32511: URL: https://github.com/apache/spark/pull/32511#issuecomment-839398303 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42936/ --

[GitHub] [spark] SparkQA removed a comment on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

SparkQA removed a comment on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839322016 **[Test build #138409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138409/testReport)** for PR 32509 at commit

[GitHub] [spark] SparkQA commented on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

SparkQA commented on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839396565 **[Test build #138409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138409/testReport)** for PR 32509 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32506: [SPARK-35374][SQL] Add string-to-number conversion support to JacksonParser

SparkQA removed a comment on pull request #32506: URL: https://github.com/apache/spark/pull/32506#issuecomment-839231723 **[Test build #138406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138406/testReport)** for PR 32506 at commit

[GitHub] [spark] SparkQA commented on pull request #32506: [SPARK-35374][SQL] Add string-to-number conversion support to JacksonParser

SparkQA commented on pull request #32506: URL: https://github.com/apache/spark/pull/32506#issuecomment-839395754 **[Test build #138406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138406/testReport)** for PR 32506 at commit

[GitHub] [spark] viirya commented on a change in pull request #32474: [SPARK-35347][SQL] Use MethodUtils for looking up methods in Invoke and StaticInvoke

viirya commented on a change in pull request #32474: URL: https://github.com/apache/spark/pull/32474#discussion_r630690560 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -147,30 +149,11 @@ trait InvokeLike

[GitHub] [spark] kiszk commented on a change in pull request #32457: [SPARK-35329][SQL] Split generated switch code into pieces in ExpandExec

kiszk commented on a change in pull request #32457: URL: https://github.com/apache/spark/pull/32457#discussion_r630690037 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/ExpandExec.scala ## @@ -180,40 +180,55 @@ case class ExpandExec( }

[GitHub] [spark] sarutak opened a new pull request #32512: [SPARK-35377][INFRA] Add JS linter to GA

sarutak opened a new pull request #32512: URL: https://github.com/apache/spark/pull/32512 ### What changes were proposed in this pull request? SPARK-35175 (#32274) added a linter for JS so let's add it to GA. ### Why are the changes needed? To JS code keep clean.

[GitHub] [spark] cloud-fan commented on a change in pull request #32474: [SPARK-35347][SQL] Use MethodUtils for looking up methods in Invoke and StaticInvoke

cloud-fan commented on a change in pull request #32474: URL: https://github.com/apache/spark/pull/32474#discussion_r630684354 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -147,30 +149,11 @@ trait InvokeLike

[GitHub] [spark] cloud-fan commented on a change in pull request #32507: [SPARK-35361][SQL] Improve performance for ApplyFunctionExpression

cloud-fan commented on a change in pull request #32507: URL: https://github.com/apache/spark/pull/32507#discussion_r630683577 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ApplyFunctionExpression.scala ## @@ -30,10 +30,11 @@ case class

[GitHub] [spark] fhygh commented on a change in pull request #32501: [SPARK-35359][SQL] Insert data with char/varchar datatype will fail when data length exceed length limitation

fhygh commented on a change in pull request #32501: URL: https://github.com/apache/spark/pull/32501#discussion_r630681959 ## File path: sql/core/src/test/scala/org/apache/spark/sql/CharVarcharTestSuite.scala ## @@ -805,6 +805,18 @@ class FileSourceCharVarcharTestSuite extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

AmplabJenkins removed a comment on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-839385196 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42934/

[GitHub] [spark] SparkQA commented on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

SparkQA commented on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-839385174 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42934/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

AmplabJenkins commented on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-839385196 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42934/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

AmplabJenkins removed a comment on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839381998 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42933/

[GitHub] [spark] SparkQA commented on pull request #32511: [WIP][SPARK-XXXXX][SQL] Show explain strings for logical plans

SparkQA commented on pull request #32511: URL: https://github.com/apache/spark/pull/32511#issuecomment-839382118 **[Test build #138414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138414/testReport)** for PR 32511 at commit

[GitHub] [spark] SparkQA commented on pull request #32510: [SPARK-35376][CORE] Fallback config should override defaultValue

SparkQA commented on pull request #32510: URL: https://github.com/apache/spark/pull/32510#issuecomment-839382143 **[Test build #138415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138415/testReport)** for PR 32510 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

AmplabJenkins commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839381998 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42933/ --

[GitHub] [spark] SparkQA commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

SparkQA commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839381984 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42933/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32399: [SPARK-35271][ML][PYSPARK] Fix: After CrossValidator/TrainValidationSplit fit raised error, some backgroud threads may still co

AmplabJenkins removed a comment on pull request #32399: URL: https://github.com/apache/spark/pull/32399#issuecomment-839381277 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42935/

[GitHub] [spark] AmplabJenkins commented on pull request #32399: [SPARK-35271][ML][PYSPARK] Fix: After CrossValidator/TrainValidationSplit fit raised error, some backgroud threads may still continue r

AmplabJenkins commented on pull request #32399: URL: https://github.com/apache/spark/pull/32399#issuecomment-839381277 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42935/ --

[GitHub] [spark] SparkQA commented on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

SparkQA commented on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-839380829 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42934/ -- This is an automated message from the Apache

[GitHub] [spark] shahidki31 edited a comment on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

shahidki31 edited a comment on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839377762 > @shahidki31 can you retrigger the test please? https://github.com/shahidki31/spark/actions/runs/832876763 Sure @HyukjinKwon Let me check -- This is an

[GitHub] [spark] SparkQA commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

SparkQA commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839377859 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42933/ -- This is an automated message from the Apache

[GitHub] [spark] shahidki31 removed a comment on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

shahidki31 removed a comment on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839377516 > https://github.com/shahidki31/spark/actions/runs/832876763 Sure @HyukjinKwon . Let me check -- This is an automated message from the Apache Git Service. To

[GitHub] [spark] shahidki31 commented on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

shahidki31 commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839377762 > @shahidki31 can you retrigger the test please? https://github.com/shahidki31/spark/actions/runs/832876763 Sure @HyukjinKwon Let me check -- This is an automated

[GitHub] [spark] shahidki31 commented on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

shahidki31 commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839377516 > https://github.com/shahidki31/spark/actions/runs/832876763 Sure @HyukjinKwon . Let me check -- This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] SparkQA commented on pull request #32399: [SPARK-35271][ML][PYSPARK] Fix: After CrossValidator/TrainValidationSplit fit raised error, some backgroud threads may still continue run or

SparkQA commented on pull request #32399: URL: https://github.com/apache/spark/pull/32399#issuecomment-839375651 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42935/ --

[GitHub] [spark] maropu commented on pull request #32511: [WIP][SPARK-XXXXX][SQL] Show explain strings for logical plans

maropu commented on pull request #32511: URL: https://github.com/apache/spark/pull/32511#issuecomment-839374823 > I think the same issue happens in df.explain(...). If I want to see the formatted result, I can't see the logical plan. @cloud-fan Does your comment above mean a fix

[GitHub] [spark] itholic commented on a change in pull request #32204: [SPARK-34494][SQL][DOCS] Move JSON data source options from Python and Scala into a single page

itholic commented on a change in pull request #32204: URL: https://github.com/apache/spark/pull/32204#discussion_r630662846 ## File path: python/pyspark/sql/readwriter.py ## @@ -233,114 +233,13 @@ def json(self, path, schema=None, primitivesAsString=None, prefersDecimal=None,

[GitHub] [spark] srowen commented on pull request #32508: [MINOR][DOCS] Avoid some python docs where first sentence has "e.g." or similar

srowen commented on pull request #32508: URL: https://github.com/apache/spark/pull/32508#issuecomment-839373124 BTW I realize the link I posted doesn't actually show the problem. It's here:

[GitHub] [spark] maropu opened a new pull request #32511: [WIP][SPARK-XXXXX][SQL] Show explain strings for logical plans

maropu opened a new pull request #32511: URL: https://github.com/apache/spark/pull/32511 ### What changes were proposed in this pull request? This PR proposes to print formatted strings for logical plans in the `formatted` mode, e.g., ``` scala> sql("""SELECT (SELECT

[GitHub] [spark] itholic commented on a change in pull request #32161: [SPARK-35025][SQL][PYTHON][DOCS] Move Parquet data source options from Python and Scala into a single page.

itholic commented on a change in pull request #32161: URL: https://github.com/apache/spark/pull/32161#discussion_r630663662 ## File path: python/pyspark/sql/readwriter.py ## @@ -416,53 +416,10 @@ def parquet(self, *paths, **options): Other Parameters

[GitHub] [spark] itholic commented on a change in pull request #32204: [SPARK-34494][SQL][DOCS] Move JSON data source options from Python and Scala into a single page

itholic commented on a change in pull request #32204: URL: https://github.com/apache/spark/pull/32204#discussion_r630662846 ## File path: python/pyspark/sql/readwriter.py ## @@ -233,114 +233,13 @@ def json(self, path, schema=None, primitivesAsString=None, prefersDecimal=None,

[GitHub] [spark] HyukjinKwon commented on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

HyukjinKwon commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839369117 cc @Ngone51 @mridulm @tgravescs FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [spark] HyukjinKwon commented on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

HyukjinKwon commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839368998 @shahidki31 can you retrigger the test please? https://github.com/shahidki31/spark/actions/runs/832876763 -- This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon removed a comment on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

HyukjinKwon removed a comment on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839368779 The tests seem failed. Would you please fixing them? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

HyukjinKwon commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839368779 The tests seem failed. Would you please fixing them? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] ulysses-you opened a new pull request #32510: [SPARK-35376][CORE] Fallback config should override defaultValue

ulysses-you opened a new pull request #32510: URL: https://github.com/apache/spark/pull/32510 ### What changes were proposed in this pull request? Override `defaultValue` and change `defaultValueString` to the valid value in `FallbackConfigEntry`. ### Why are the

[GitHub] [spark] HyukjinKwon commented on pull request #32508: [MINOR][DOCS] Avoid some python docs where first sentence has "e.g." or similar

HyukjinKwon commented on pull request #32508: URL: https://github.com/apache/spark/pull/32508#issuecomment-839367813 Merged to master and branch-3.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon closed pull request #32508: [MINOR][DOCS] Avoid some python docs where first sentence has "e.g." or similar

HyukjinKwon closed pull request #32508: URL: https://github.com/apache/spark/pull/32508 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] SparkQA commented on pull request #32399: [SPARK-35271][ML][PYSPARK] Fix: After CrossValidator/TrainValidationSplit fit raised error, some backgroud threads may still continue run or

SparkQA commented on pull request #32399: URL: https://github.com/apache/spark/pull/32399#issuecomment-839362651 **[Test build #138413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138413/testReport)** for PR 32399 at commit

[GitHub] [spark] SparkQA commented on pull request #32452: [SPARK-35243][SQL] Support columnar execution on ANSI interval types

SparkQA commented on pull request #32452: URL: https://github.com/apache/spark/pull/32452#issuecomment-839362618 **[Test build #138412 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138412/testReport)** for PR 32452 at commit

[GitHub] [spark] SparkQA commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

SparkQA commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839362554 **[Test build #138411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138411/testReport)** for PR 32473 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32494: [SPARK-35362][SQL] Update null count in the column stats for UNION operator stats estimation

AmplabJenkins removed a comment on pull request #32494: URL: https://github.com/apache/spark/pull/32494#issuecomment-839361260 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138400/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

AmplabJenkins removed a comment on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839361259 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42931/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

AmplabJenkins removed a comment on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839361258 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42932/

[GitHub] [spark] AmplabJenkins commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

AmplabJenkins commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839361258 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42932/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32494: [SPARK-35362][SQL] Update null count in the column stats for UNION operator stats estimation

AmplabJenkins commented on pull request #32494: URL: https://github.com/apache/spark/pull/32494#issuecomment-839361260 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138400/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

AmplabJenkins commented on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839361259 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42931/ --

[GitHub] [spark] HyukjinKwon closed pull request #32507: [SPARK-35361][SQL] Improve performance for ApplyFunctionExpression

HyukjinKwon closed pull request #32507: URL: https://github.com/apache/spark/pull/32507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] HyukjinKwon commented on pull request #32507: [SPARK-35361][SQL] Improve performance for ApplyFunctionExpression

HyukjinKwon commented on pull request #32507: URL: https://github.com/apache/spark/pull/32507#issuecomment-839359850 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

SparkQA commented on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839359549 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] HyukjinKwon commented on pull request #32502: [SPARK-35372][BUILD] Increase stack size for Scala compilation in Maven build

HyukjinKwon commented on pull request #32502: URL: https://github.com/apache/spark/pull/32502#issuecomment-839359364 Thanks guys! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] HyukjinKwon commented on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

HyukjinKwon commented on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839359024 The linter passed. Merged to master and branch-3.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] HyukjinKwon closed pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

HyukjinKwon closed pull request #32509: URL: https://github.com/apache/spark/pull/32509 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] SparkQA commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

SparkQA commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839357922 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42932/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32494: [SPARK-35362][SQL] Update null count in the column stats for UNION operator stats estimation

SparkQA removed a comment on pull request #32494: URL: https://github.com/apache/spark/pull/32494#issuecomment-839056599 **[Test build #138400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138400/testReport)** for PR 32494 at commit

[GitHub] [spark] SparkQA commented on pull request #32494: [SPARK-35362][SQL] Update null count in the column stats for UNION operator stats estimation

SparkQA commented on pull request #32494: URL: https://github.com/apache/spark/pull/32494#issuecomment-839356893 **[Test build #138400 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138400/testReport)** for PR 32494 at commit

[GitHub] [spark] SparkQA commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

SparkQA commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839355590 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42932/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32473: [SPARK-35345][SQL] Add Parquet tests to BloomFilterBenchmark

SparkQA commented on pull request #32473: URL: https://github.com/apache/spark/pull/32473#issuecomment-839322042 **[Test build #138410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138410/testReport)** for PR 32473 at commit

[GitHub] [spark] SparkQA commented on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

SparkQA commented on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839322016 **[Test build #138409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138409/testReport)** for PR 32509 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32439: [SPARK-35298][SQL] Migrate to transformWithPruning for rules in Optimizer.scala

AmplabJenkins removed a comment on pull request #32439: URL: https://github.com/apache/spark/pull/32439#issuecomment-839321728 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42930/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32498: [SPARK-35368][SQL] Update histogram statistics for RANGE operator for stats estimation

AmplabJenkins removed a comment on pull request #32498: URL: https://github.com/apache/spark/pull/32498#issuecomment-839321727 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138399/

[GitHub] [spark] AmplabJenkins commented on pull request #32439: [SPARK-35298][SQL] Migrate to transformWithPruning for rules in Optimizer.scala

AmplabJenkins commented on pull request #32439: URL: https://github.com/apache/spark/pull/32439#issuecomment-839321728 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42930/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32498: [SPARK-35368][SQL] Update histogram statistics for RANGE operator for stats estimation

AmplabJenkins commented on pull request #32498: URL: https://github.com/apache/spark/pull/32498#issuecomment-839321727 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138399/ -- This

[GitHub] [spark] SparkQA commented on pull request #32439: [SPARK-35298][SQL] Migrate to transformWithPruning for rules in Optimizer.scala

SparkQA commented on pull request #32439: URL: https://github.com/apache/spark/pull/32439#issuecomment-839310134 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] sarutak commented on pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for Python linter dependency in GA

sarutak commented on pull request #32509: URL: https://github.com/apache/spark/pull/32509#issuecomment-839308894 cc: @dongjoon-hyun @HyukjinKwon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] sarutak opened a new pull request #32509: [SPARK-35375][INFRA] Use Jinja2 < 3.0.0 for linter dependency in GA

sarutak opened a new pull request #32509: URL: https://github.com/apache/spark/pull/32509 ### What changes were proposed in this pull request? From a few hours ago, Python linter fails in GA. The latest Jinja 3.0.0 seems to cause this failure. https://pypi.org/project/Jinja2/

[GitHub] [spark] SparkQA removed a comment on pull request #32498: [SPARK-35368][SQL] Update histogram statistics for RANGE operator for stats estimation

SparkQA removed a comment on pull request #32498: URL: https://github.com/apache/spark/pull/32498#issuecomment-839051298 **[Test build #138399 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138399/testReport)** for PR 32498 at commit

[GitHub] [spark] SparkQA commented on pull request #32498: [SPARK-35368][SQL] Update histogram statistics for RANGE operator for stats estimation

SparkQA commented on pull request #32498: URL: https://github.com/apache/spark/pull/32498#issuecomment-839297647 **[Test build #138399 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138399/testReport)** for PR 32498 at commit

[GitHub] [spark] xinrong-databricks commented on pull request #32469: [SPARK-35338][PYTHON] Separate arithmetic operations into data type based structures

xinrong-databricks commented on pull request #32469: URL: https://github.com/apache/spark/pull/32469#issuecomment-839295829 Build and test failed for: ``` Exception occurred: File "/__w/spark/spark/python/docs/source/_templates/autosummary/class_with_docs.rst", line 26, in

[GitHub] [spark] SparkQA commented on pull request #32439: [SPARK-35298][SQL] Migrate to transformWithPruning for rules in Optimizer.scala

SparkQA commented on pull request #32439: URL: https://github.com/apache/spark/pull/32439#issuecomment-839275149 **[Test build #138408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138408/testReport)** for PR 32439 at commit

[GitHub] [spark] shahidki31 commented on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

shahidki31 commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839274801 @dongjoon-hyun I have updated the branch with master. Kindly review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

AmplabJenkins removed a comment on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-839274118 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138402/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32506: [SPARK-35374][SQL] Add string-to-number conversion support to JacksonParser

AmplabJenkins removed a comment on pull request #32506: URL: https://github.com/apache/spark/pull/32506#issuecomment-839274114 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42928/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32178: [DONOTMERGE] initial commit for skeleton ansible for jenkins worker config

AmplabJenkins removed a comment on pull request #32178: URL: https://github.com/apache/spark/pull/32178#issuecomment-839274113 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138397/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32507: [SPARK-35361][SQL] Improve performance for ApplyFunctionExpression

AmplabJenkins removed a comment on pull request #32507: URL: https://github.com/apache/spark/pull/32507#issuecomment-839274117 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138394/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

AmplabJenkins removed a comment on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-839274115 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42929/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

AmplabJenkins removed a comment on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839274116 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138398/

[GitHub] [spark] AmplabJenkins commented on pull request #32507: [SPARK-35361][SQL] Improve performance for ApplyFunctionExpression

AmplabJenkins commented on pull request #32507: URL: https://github.com/apache/spark/pull/32507#issuecomment-839274117 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138394/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32476: [SPARK-35349][SQL] Add code-gen for left/right outer sort merge join

AmplabJenkins commented on pull request #32476: URL: https://github.com/apache/spark/pull/32476#issuecomment-839274115 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42929/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32388: [SPARK-35258][SHUFFLE][YARN] Add new metrics to ExternalShuffleService for better monitoring

AmplabJenkins commented on pull request #32388: URL: https://github.com/apache/spark/pull/32388#issuecomment-839274118 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138402/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32178: [DONOTMERGE] initial commit for skeleton ansible for jenkins worker config

AmplabJenkins commented on pull request #32178: URL: https://github.com/apache/spark/pull/32178#issuecomment-839274113 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138397/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32504: [SPARK-35013][CORE] Don't allow to set spark.driver.cores=0

AmplabJenkins commented on pull request #32504: URL: https://github.com/apache/spark/pull/32504#issuecomment-839274116 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138398/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32506: [SPARK-35374][SQL] Add string-to-number conversion support to JacksonParser

AmplabJenkins commented on pull request #32506: URL: https://github.com/apache/spark/pull/32506#issuecomment-839274114 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42928/ --

<    1   2   3   4   5   6   7   8   >