[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817260075 **[Test build #137174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137174/testReport)** for PR 32037 at commit [`4a3cf60`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

AmplabJenkins removed a comment on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817257342 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41755/

[GitHub] [spark] AmplabJenkins commented on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

AmplabJenkins commented on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817257342 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41755/ -- T

[GitHub] [spark] SparkQA commented on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

SparkQA commented on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817257334 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

AmplabJenkins removed a comment on pull request #32089: URL: https://github.com/apache/spark/pull/32089#issuecomment-817257215 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137171/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31993: [SPARK-34897][SQL] Support reconcile schemas based on index after nested column pruning

AmplabJenkins removed a comment on pull request #31993: URL: https://github.com/apache/spark/pull/31993#issuecomment-817257211 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41754/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-817257213 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137172/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

AmplabJenkins removed a comment on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817257210 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins commented on pull request #31993: [SPARK-34897][SQL] Support reconcile schemas based on index after nested column pruning

AmplabJenkins commented on pull request #31993: URL: https://github.com/apache/spark/pull/31993#issuecomment-817257211 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41754/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-817257213 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137172/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

AmplabJenkins commented on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817257210 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For q

[GitHub] [spark] AmplabJenkins commented on pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

AmplabJenkins commented on pull request #32089: URL: https://github.com/apache/spark/pull/32089#issuecomment-817257215 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137171/ -- This

[GitHub] [spark] SparkQA commented on pull request #31993: [SPARK-34897][SQL] Support reconcile schemas based on index after nested column pruning

SparkQA commented on pull request #31993: URL: https://github.com/apache/spark/pull/31993#issuecomment-817256491 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41754/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

SparkQA commented on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817255972 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA commented on pull request #31993: [SPARK-34897][SQL] Support reconcile schemas based on index after nested column pruning

SparkQA commented on pull request #31993: URL: https://github.com/apache/spark/pull/31993#issuecomment-817255876 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41754/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

SparkQA removed a comment on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817252754 **[Test build #137177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137177/testReport)** for PR 32122 at commit [`d9d40af`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

SparkQA removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-817231288 **[Test build #137172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137172/testReport)** for PR 30144 at commit [`2ae3c16`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

SparkQA commented on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817254728 **[Test build #137177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137177/testReport)** for PR 32122 at commit [`d9d40af`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-817254435 **[Test build #137172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137172/testReport)** for PR 30144 at commit [`2ae3c16`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

SparkQA removed a comment on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817251407 **[Test build #137175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137175/testReport)** for PR 32122 at commit [`999f925`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

SparkQA commented on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817253704 **[Test build #137175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137175/testReport)** for PR 32122 at commit [`999f925`](https://github.co

[GitHub] [spark] wangyum commented on pull request #31993: [SPARK-34897][SQL] Support reconcile schemas based on index after nested column pruning

wangyum commented on pull request #31993: URL: https://github.com/apache/spark/pull/31993#issuecomment-817253696 > Sorry I may miss something. Why it's only a problem in nested column pruning but not column pruning? Nested column pruning removed the field: https://github.com/apac

[GitHub] [spark] SparkQA removed a comment on pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

SparkQA removed a comment on pull request #32089: URL: https://github.com/apache/spark/pull/32089#issuecomment-817231223 **[Test build #137171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137171/testReport)** for PR 32089 at commit [`b37fef0`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

SparkQA commented on pull request #32089: URL: https://github.com/apache/spark/pull/32089#issuecomment-817253121 **[Test build #137171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137171/testReport)** for PR 32089 at commit [`b37fef0`](https://github.co

[GitHub] [spark] Yikun commented on a change in pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

Yikun commented on a change in pull request #32122: URL: https://github.com/apache/spark/pull/32122#discussion_r611134480 ## File path: python/pyspark/sql/dataframe.py ## @@ -588,7 +588,7 @@ def withWatermark(self, eventTime, delayThreshold): Parameters

[GitHub] [spark] SparkQA commented on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

SparkQA commented on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817252754 **[Test build #137177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137177/testReport)** for PR 32122 at commit [`d9d40af`](https://github.com

[GitHub] [spark] Yikun commented on a change in pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

Yikun commented on a change in pull request #32122: URL: https://github.com/apache/spark/pull/32122#discussion_r611133213 ## File path: python/pyspark/sql/catalog.pyi ## @@ -53,7 +54,7 @@ class Catalog: def dropGlobalTempView(self, viewName: str) -> None: ... def regi

[GitHub] [spark] SparkQA commented on pull request #31993: [SPARK-34897][SQL] Support reconcile schemas based on index after nested column pruning

SparkQA commented on pull request #31993: URL: https://github.com/apache/spark/pull/31993#issuecomment-817251437 **[Test build #137176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137176/testReport)** for PR 31993 at commit [`e64eb75`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

SparkQA commented on pull request #32122: URL: https://github.com/apache/spark/pull/32122#issuecomment-817251407 **[Test build #137175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137175/testReport)** for PR 32122 at commit [`999f925`](https://github.com

[GitHub] [spark] Yikun opened a new pull request #32122: [SPARK-35019][PYTHON][SQL]Fix type hints mismatches in pyspark.sql.*

Yikun opened a new pull request #32122: URL: https://github.com/apache/spark/pull/32122 ### What changes were proposed in this pull request? Fix type hints mismatches in pyspark.sql.* ### Why are the changes needed? There were some mismatches in pyspark.sql.* ###

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

AmplabJenkins removed a comment on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817240908 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41752/

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817240903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] AmplabJenkins commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

AmplabJenkins commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817240908 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41752/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32107: [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function `sum`

AmplabJenkins removed a comment on pull request #32107: URL: https://github.com/apache/spark/pull/32107#issuecomment-817240614 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41751/

[GitHub] [spark] AmplabJenkins commented on pull request #32107: [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function `sum`

AmplabJenkins commented on pull request #32107: URL: https://github.com/apache/spark/pull/32107#issuecomment-817240614 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41751/ -- T

[GitHub] [spark] HyukjinKwon commented on pull request #32107: [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function `sum`

HyukjinKwon commented on pull request #32107: URL: https://github.com/apache/spark/pull/32107#issuecomment-817240370 cc @MaxGekk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [spark] SparkQA commented on pull request #32107: [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function `sum`

SparkQA commented on pull request #32107: URL: https://github.com/apache/spark/pull/32107#issuecomment-817240215 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41751/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #32107: [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function `sum`

SparkQA commented on pull request #32107: URL: https://github.com/apache/spark/pull/32107#issuecomment-817239800 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41751/ -- This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on pull request #32114: [Spark 35011][CORE] Avoid Block Manager registerations when StopExecutor msg is in-flight

HyukjinKwon commented on pull request #32114: URL: https://github.com/apache/spark/pull/32114#issuecomment-817237064 cc @Ngone51 FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] HyukjinKwon commented on pull request #32115: Migrate to `slash` syntax

HyukjinKwon commented on pull request #32115: URL: https://github.com/apache/spark/pull/32115#issuecomment-817236999 Thanks @gemelen for tracking and fixing SBT. BTW, I think it should be best to file a JIRA and link it to the PR. -- This is an automated message from the Apache Git Servi

[GitHub] [spark] yaooqinn commented on a change in pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

yaooqinn commented on a change in pull request #32121: URL: https://github.com/apache/spark/pull/32121#discussion_r69760 ## File path: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala ## @@ -122,6 +124,12 @@ p

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817236676 **[Test build #137174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137174/testReport)** for PR 32037 at commit [`4a3cf60`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32107: [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function `sum`

SparkQA commented on pull request #32107: URL: https://github.com/apache/spark/pull/32107#issuecomment-817236404 **[Test build #137173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137173/testReport)** for PR 32107 at commit [`7897af4`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-817236113 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41750/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

AmplabJenkins removed a comment on pull request #32089: URL: https://github.com/apache/spark/pull/32089#issuecomment-817236111 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41749/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

AmplabJenkins removed a comment on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817236110 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137170/ -

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-817236113 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41750/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

AmplabJenkins commented on pull request #32089: URL: https://github.com/apache/spark/pull/32089#issuecomment-817236111 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41749/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

AmplabJenkins commented on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817236110 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137170/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

SparkQA removed a comment on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817204223 **[Test build #137170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137170/testReport)** for PR 31966 at commit [`6c9d839`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

SparkQA commented on pull request #32089: URL: https://github.com/apache/spark/pull/32089#issuecomment-817234869 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-817234569 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41750/ -- This

[GitHub] [spark] SparkQA commented on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

SparkQA commented on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817233087 **[Test build #137170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137170/testReport)** for PR 31966 at commit [`6c9d839`](https://github.co

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32107: [SPARK-34716][SQL] Support ANSI SQL intervals by the aggregate function `sum`

HyukjinKwon commented on a change in pull request #32107: URL: https://github.com/apache/spark/pull/32107#discussion_r66008 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala ## @@ -17,10 +17,11 @@ package org.apache.spark.sql +im

[GitHub] [spark] HyukjinKwon closed pull request #32116: [SPARK-34972][PYTHON][TEST][FOLLOWUP] Fix pyspark.pandas doctests which could be flaky.

HyukjinKwon closed pull request #32116: URL: https://github.com/apache/spark/pull/32116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pl

[GitHub] [spark] HyukjinKwon commented on pull request #32116: [SPARK-34972][PYTHON][TEST][FOLLOWUP] Fix pyspark.pandas doctests which could be flaky.

HyukjinKwon commented on pull request #32116: URL: https://github.com/apache/spark/pull/32116#issuecomment-817232542 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [spark] HyukjinKwon closed pull request #32110: [SPARK-34630][PYTHON] Add typehint for pyspark.__version__

HyukjinKwon closed pull request #32110: URL: https://github.com/apache/spark/pull/32110 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pl

[GitHub] [spark] HyukjinKwon commented on pull request #32110: [SPARK-34630][PYTHON] Add typehint for pyspark.__version__

HyukjinKwon commented on pull request #32110: URL: https://github.com/apache/spark/pull/32110#issuecomment-817232419 Merged to master and branch-3.1. But @zero323 feel free to post-hoc review since you're the expert here :-) -- This is an automated message from the Apache Git Servi

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-817231288 **[Test build #137172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137172/testReport)** for PR 30144 at commit [`2ae3c16`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

SparkQA commented on pull request #32089: URL: https://github.com/apache/spark/pull/32089#issuecomment-817231223 **[Test build #137171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137171/testReport)** for PR 32089 at commit [`b37fef0`](https://github.com

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

AngersZh commented on a change in pull request #30144: URL: https://github.com/apache/spark/pull/30144#discussion_r62158 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/grouping.scala ## @@ -231,3 +235,34 @@ object GroupingID {

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

AngersZh commented on a change in pull request #32089: URL: https://github.com/apache/spark/pull/32089#discussion_r61590 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1816,7 +1816,13 @@ class Analyzer(override va

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32089: [SPARK-34986][SQL] Make an error msg clearer when ordinal numbers in group-by refer to agg funcs

AngersZh commented on a change in pull request #32089: URL: https://github.com/apache/spark/pull/32089#discussion_r61481 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryCompilationErrors.scala ## @@ -268,6 +268,15 @@ private[spark] object Que

[GitHub] [spark] github-actions[bot] commented on pull request #29862: [SPARK-32956][SQL] Ensure that the generated and existing headers are not duplicated in CSV DataSource

github-actions[bot] commented on pull request #29862: URL: https://github.com/apache/spark/pull/29862#issuecomment-817221835 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] github-actions[bot] commented on pull request #30243: [SPARK-33335][SQL] Support `has_all` func

github-actions[bot] commented on pull request #30243: URL: https://github.com/apache/spark/pull/30243#issuecomment-817221829 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] github-actions[bot] commented on pull request #29869: [SPARK-32994][CORE] Update external heavy accumulators before they entering into listener event loop

github-actions[bot] commented on pull request #29869: URL: https://github.com/apache/spark/pull/29869#issuecomment-817221832 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] sumeetgajjar commented on pull request #32114: [Spark 35011][CORE] Avoid Block Manager registerations when StopExecutor msg is in-flight

sumeetgajjar commented on pull request #32114: URL: https://github.com/apache/spark/pull/32114#issuecomment-817218035 I just realized I can now re-run the checks in my personal fork, instead of pushing empty commits. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] wangyum closed pull request #32109: [SPARK-35007][SQL] support numeric type

wangyum closed pull request #32109: URL: https://github.com/apache/spark/pull/32109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] AmplabJenkins commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

AmplabJenkins commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817205637 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137169/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

AmplabJenkins removed a comment on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817205637 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137169/ -

[GitHub] [spark] SparkQA removed a comment on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

SparkQA removed a comment on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817174451 **[Test build #137169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137169/testReport)** for PR 32037 at commit [`68fde39`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817205409 **[Test build #137169 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137169/testReport)** for PR 32037 at commit [`68fde39`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

SparkQA commented on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817208634 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

AmplabJenkins removed a comment on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817210148 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41748/

[GitHub] [spark] AmplabJenkins commented on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

AmplabJenkins commented on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817210148 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41748/ -- T

[GitHub] [spark] SparkQA commented on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

SparkQA commented on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817204223 **[Test build #137170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137170/testReport)** for PR 31966 at commit [`6c9d839`](https://github.com

[GitHub] [spark] viirya commented on pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

viirya commented on pull request #31966: URL: https://github.com/apache/spark/pull/31966#issuecomment-817201512 @maropu @dongjoon-hyun Thanks for your review and patience. I added test-sensitivity test. Once you have time, please take another look. Thanks. -- This is an automated message

[GitHub] [spark] viirya commented on a change in pull request #32059: [SPARK-34963][SQL] Fix nested column pruning for extracting case-insensitive struct field from array of struct

viirya commented on a change in pull request #32059: URL: https://github.com/apache/spark/pull/32059#discussion_r611092514 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ProjectionOverSchema.scala ## @@ -41,9 +41,14 @@ case class Projection

[GitHub] [spark] viirya commented on a change in pull request #31966: [SPARK-34638][SQL] Single field nested column prune on generator output

viirya commented on a change in pull request #31966: URL: https://github.com/apache/spark/pull/31966#discussion_r611092259 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -241,12 +262,69 @@ object GeneratorNest

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

AmplabJenkins removed a comment on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817182805 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41747/

[GitHub] [spark] AmplabJenkins commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

AmplabJenkins commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817182805 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41747/ -- T

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817180397 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Replace bigint with int for web_returns and store_returns in TPCDS tests to employ correct data type

SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-817174451 **[Test build #137169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137169/testReport)** for PR 32037 at commit [`68fde39`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32120: [SPARK-35016][SQL] Format ANSI intervals in Hive style

AmplabJenkins removed a comment on pull request #32120: URL: https://github.com/apache/spark/pull/32120#issuecomment-817144248 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137165/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32120: [SPARK-35016][SQL] Format ANSI intervals in Hive style

AmplabJenkins commented on pull request #32120: URL: https://github.com/apache/spark/pull/32120#issuecomment-817144248 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137165/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32120: [SPARK-35016][SQL] Format ANSI intervals in Hive style

SparkQA removed a comment on pull request #32120: URL: https://github.com/apache/spark/pull/32120#issuecomment-817099609 **[Test build #137165 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137165/testReport)** for PR 32120 at commit [`3daaf3d`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32120: [SPARK-35016][SQL] Format ANSI intervals in Hive style

SparkQA commented on pull request #32120: URL: https://github.com/apache/spark/pull/32120#issuecomment-817138057 **[Test build #137165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137165/testReport)** for PR 32120 at commit [`3daaf3d`](https://github.co

[GitHub] [spark] Yikun edited a comment on pull request #32118: [SPARK-35015][PYTHON] Add missing type hints of pyspark.sql.*

Yikun edited a comment on pull request #32118: URL: https://github.com/apache/spark/pull/32118#issuecomment-817128098 > Could you explain what is the use case for adding these? The annotating missing warning was found when I cleaunup the mypy error of spark pandas, see more in [SPAR

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

AmplabJenkins removed a comment on pull request #32121: URL: https://github.com/apache/spark/pull/32121#issuecomment-817128117 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41746/

[GitHub] [spark] AmplabJenkins commented on pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

AmplabJenkins commented on pull request #32121: URL: https://github.com/apache/spark/pull/32121#issuecomment-817128117 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41746/ -- T

[GitHub] [spark] Yikun commented on pull request #32118: [SPARK-35015][PYTHON] Add missing type hints of pyspark.sql.*

Yikun commented on pull request #32118: URL: https://github.com/apache/spark/pull/32118#issuecomment-817128098 > Could you explain what is the use case for adding these? The annotating missing warning was found when I cleaunup the mypy error of spark pandas, see more in [SPARK-34941

[GitHub] [spark] SparkQA commented on pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

SparkQA commented on pull request #32121: URL: https://github.com/apache/spark/pull/32121#issuecomment-817121758 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

AmplabJenkins removed a comment on pull request #32121: URL: https://github.com/apache/spark/pull/32121#issuecomment-817120417 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137168/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

AmplabJenkins commented on pull request #32121: URL: https://github.com/apache/spark/pull/32121#issuecomment-817120417 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/137168/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

SparkQA removed a comment on pull request #32121: URL: https://github.com/apache/spark/pull/32121#issuecomment-817113393 **[Test build #137168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137168/testReport)** for PR 32121 at commit [`1c6c93d`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

SparkQA commented on pull request #32121: URL: https://github.com/apache/spark/pull/32121#issuecomment-817118071 **[Test build #137168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137168/testReport)** for PR 32121 at commit [`1c6c93d`](https://github.co

[GitHub] [spark] MaxGekk commented on pull request #32099: [SPARK-34905][SQL][TESTS] Enable ANSI intervals in `SQLQueryTestSuite`/`ThriftServerQueryTestSuite`

MaxGekk commented on pull request #32099: URL: https://github.com/apache/spark/pull/32099#issuecomment-817114090 Waiting for https://github.com/apache/spark/pull/32120 and https://github.com/apache/spark/pull/32121 -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] SparkQA commented on pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

SparkQA commented on pull request #32121: URL: https://github.com/apache/spark/pull/32121#issuecomment-817113393 **[Test build #137168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/137168/testReport)** for PR 32121 at commit [`1c6c93d`](https://github.com

[GitHub] [spark] MaxGekk commented on a change in pull request #32121: [SPARK-35017][SQL] Transfer ANSI intervals via Hive Thrift server

MaxGekk commented on a change in pull request #32121: URL: https://github.com/apache/spark/pull/32121#discussion_r611024841 ## File path: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/SparkThriftServerProtocolVersionsSuite.scala ## @@ -458,5 +459,

[GitHub] [spark] zheniantoushipashi commented on pull request #32109: [SPARK-35007][SQL] support numeric type

zheniantoushipashi commented on pull request #32109: URL: https://github.com/apache/spark/pull/32109#issuecomment-817111500 > Then, please use Spark 3.x. In general, `branch-2.4` only accepts bug fixes. Please see Versioning Policy: http://spark.apache.org/versioning-policy.html ok

  1   2   >