[GitHub] [spark] maropu commented on a change in pull request #30363: [SPARK-33438][SQL] Eagerly init all SQLConf objects for command `set -v`

maropu commented on a change in pull request #30363: URL: https://github.com/apache/spark/pull/30363#discussion_r568350914 ## File path: core/src/main/scala/org/apache/spark/util/SparkConfRegisterLoader.scala ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [spark] SparkQA commented on pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

SparkQA commented on pull request #31413: URL: https://github.com/apache/spark/pull/31413#issuecomment-771398364 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39343/ ---

[GitHub] [spark] turboFei opened a new pull request #31431: [SPARK-34322][SQL] When refreshing a non-temporary view, also refresh its underlying tables

turboFei opened a new pull request #31431: URL: https://github.com/apache/spark/pull/31431 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this p

[GitHub] [spark] dongjoon-hyun commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

dongjoon-hyun commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771398197 Merged to master. This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] dongjoon-hyun closed pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

dongjoon-hyun closed pull request #31428: URL: https://github.com/apache/spark/pull/31428 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] c21 commented on a change in pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

c21 commented on a change in pull request #31413: URL: https://github.com/apache/spark/pull/31413#discussion_r568349714 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -591,20 +590,48 @@ case class FileSourceScanExec( lo

[GitHub] [spark] SparkQA commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

SparkQA commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-771396252 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39344/ ---

[GitHub] [spark] ScrapCodes commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

ScrapCodes commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771393970 Ok, +1 LGTM ! @dongjoon-hyun, Feel free to merge this. This is an automated message from the Apache Gi

[GitHub] [spark] williamhyun opened a new pull request #31430: Upgrade zstd-jni to 1.4.8-3

williamhyun opened a new pull request #31430: URL: https://github.com/apache/spark/pull/31430 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How

[GitHub] [spark] sunchao commented on a change in pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

sunchao commented on a change in pull request #31413: URL: https://github.com/apache/spark/pull/31413#discussion_r568345056 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -591,20 +590,48 @@ case class FileSourceScanExec(

[GitHub] [spark] sunchao commented on a change in pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

sunchao commented on a change in pull request #31413: URL: https://github.com/apache/spark/pull/31413#discussion_r568340201 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -591,20 +590,48 @@ case class FileSourceScanExec(

[GitHub] [spark] MaxGekk commented on pull request #31423: [SPARK-34314][SQL] Rebuild the file index after partition schema inferring

MaxGekk commented on pull request #31423: URL: https://github.com/apache/spark/pull/31423#issuecomment-771388471 @cloud-fan @HyukjinKwon Please, have a look at the bug fix. This is an automated message from the Apache Git Ser

[GitHub] [spark] SparkQA commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

SparkQA commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-771387968 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39344/ -

[GitHub] [spark] ScrapCodes commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

ScrapCodes commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771386988 Hi @dongjoon-hyun , Thank you for the PR. You mentioned due to a security issue, you would like add this config. Can you please describe the issue either here or if you think

[GitHub] [spark] SparkQA commented on pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

SparkQA commented on pull request #31413: URL: https://github.com/apache/spark/pull/31413#issuecomment-771385063 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39343/ -

[GitHub] [spark] SparkQA commented on pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

SparkQA commented on pull request #31429: URL: https://github.com/apache/spark/pull/31429#issuecomment-771384873 **[Test build #134761 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134761/testReport)** for PR 31429 at commit [`5758c77`](https://github.com

[GitHub] [spark] Ngone51 commented on a change in pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

Ngone51 commented on a change in pull request #31249: URL: https://github.com/apache/spark/pull/31249#discussion_r568340541 ## File path: core/src/main/scala/org/apache/spark/scheduler/HealthTracker.scala ## @@ -64,6 +65,7 @@ private[scheduler] class HealthTracker ( val EXCL

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31422: [SPARK-34313][SQL] Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to use UnresolvedTable to resolve the identifier

AmplabJenkins removed a comment on pull request #31422: URL: https://github.com/apache/spark/pull/31422#issuecomment-771383040 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39341/

[GitHub] [spark] Ngone51 commented on a change in pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

Ngone51 commented on a change in pull request #31249: URL: https://github.com/apache/spark/pull/31249#discussion_r568339020 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1942,6 +1950,15 @@ package object config { .timeConf(TimeUn

[GitHub] [spark] AmplabJenkins commented on pull request #31422: [SPARK-34313][SQL] Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to use UnresolvedTable to resolve the identifier

AmplabJenkins commented on pull request #31422: URL: https://github.com/apache/spark/pull/31422#issuecomment-771383040 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39341/ -

[GitHub] [spark] Ngone51 commented on a change in pull request #31249: [SPARK-34104][SPARK-34105][CORE][K8S] Maximum decommissioning time & allow decommissioning for excludes

Ngone51 commented on a change in pull request #31249: URL: https://github.com/apache/spark/pull/31249#discussion_r568339020 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1942,6 +1950,15 @@ package object config { .timeConf(TimeUn

[GitHub] [spark] dongjoon-hyun commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

dongjoon-hyun commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771381483 Could you review this, @holdenk ? This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA commented on pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

SparkQA commented on pull request #31429: URL: https://github.com/apache/spark/pull/31429#issuecomment-771369355 **[Test build #134759 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134759/testReport)** for PR 31429 at commit [`11a6e24`](https://github.com

[GitHub] [spark] ulysses-you commented on pull request #31372: [SPARK-34272][SQL] Pretty SQL should check NonSQLExpression

ulysses-you commented on pull request #31372: URL: https://github.com/apache/spark/pull/31372#issuecomment-771368146 > give NonSQLExpression a .sql method Seems it's no meaning for `NonSQLExpression` to do this, otherwise `NonSQLExpression` is just same with `Expression`. Maybe we ca

[GitHub] [spark] SparkQA commented on pull request #31422: [SPARK-34313][SQL] Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to use UnresolvedTable to resolve the identifier

SparkQA commented on pull request #31422: URL: https://github.com/apache/spark/pull/31422#issuecomment-771367390 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39341/ ---

[GitHub] [spark] SparkQA commented on pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

SparkQA commented on pull request #31413: URL: https://github.com/apache/spark/pull/31413#issuecomment-771366278 **[Test build #134757 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134757/testReport)** for PR 31413 at commit [`3d348a6`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

SparkQA commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-771366254 **[Test build #134758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134758/testReport)** for PR 31402 at commit [`5c4c256`](https://github.com

[GitHub] [spark] xuanyuanking commented on a change in pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

xuanyuanking commented on a change in pull request #31369: URL: https://github.com/apache/spark/pull/31369#discussion_r568326258 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -165,10 +165,18 @@ case class StateStore

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31421: [SPARK-33591][SQL][FOLLOWUP] Add legacy config for recognizing null partition spec values

AmplabJenkins removed a comment on pull request #31421: URL: https://github.com/apache/spark/pull/31421#issuecomment-771365472 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39342/

[GitHub] [spark] SparkQA commented on pull request #31204: [SPARK-26399][WEBUI][CORE] Add new stage-level REST APIs and parameters

SparkQA commented on pull request #31204: URL: https://github.com/apache/spark/pull/31204#issuecomment-771365500 **[Test build #134760 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134760/testReport)** for PR 31204 at commit [`9009b9a`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31421: [SPARK-33591][SQL][FOLLOWUP] Add legacy config for recognizing null partition spec values

SparkQA commented on pull request #31421: URL: https://github.com/apache/spark/pull/31421#issuecomment-771365439 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39342/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #31421: [SPARK-33591][SQL][FOLLOWUP] Add legacy config for recognizing null partition spec values

AmplabJenkins commented on pull request #31421: URL: https://github.com/apache/spark/pull/31421#issuecomment-771365472 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39342/ -

[GitHub] [spark] HyukjinKwon commented on a change in pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

HyukjinKwon commented on a change in pull request #31429: URL: https://github.com/apache/spark/pull/31429#discussion_r568326045 ## File path: python/pyspark/sql/tests/test_pandas_map.py ## @@ -112,6 +112,14 @@ def func(iterator): expected = df.collect() self.a

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31427: [SPARK-34209][SQL] Delegate table name validation to the session catalog

AmplabJenkins removed a comment on pull request #31427: URL: https://github.com/apache/spark/pull/31427#issuecomment-771270740 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

AmplabJenkins removed a comment on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-771359656 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39338/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

AmplabJenkins removed a comment on pull request #31286: URL: https://github.com/apache/spark/pull/31286#issuecomment-771359653 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39340/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

AmplabJenkins removed a comment on pull request #31316: URL: https://github.com/apache/spark/pull/31316#issuecomment-771359654 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39339/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

AmplabJenkins removed a comment on pull request #31429: URL: https://github.com/apache/spark/pull/31429#issuecomment-771359657 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39336/

[GitHub] [spark] AmplabJenkins commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

AmplabJenkins commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-771359656 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39338/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

AmplabJenkins commented on pull request #31429: URL: https://github.com/apache/spark/pull/31429#issuecomment-771359657 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39336/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

AmplabJenkins commented on pull request #31286: URL: https://github.com/apache/spark/pull/31286#issuecomment-771359653 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39340/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

AmplabJenkins commented on pull request #31316: URL: https://github.com/apache/spark/pull/31316#issuecomment-771359654 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39339/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31427: [SPARK-34209][SQL] Delegate table name validation to the session catalog

AmplabJenkins commented on pull request #31427: URL: https://github.com/apache/spark/pull/31427#issuecomment-771359661 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134749/ -

[GitHub] [spark] SparkQA commented on pull request #31422: [SPARK-34313][SQL] Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to use UnresolvedTable to resolve the identifier

SparkQA commented on pull request #31422: URL: https://github.com/apache/spark/pull/31422#issuecomment-771356296 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39341/ -

[GitHub] [spark] Ngone51 commented on a change in pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

Ngone51 commented on a change in pull request #31429: URL: https://github.com/apache/spark/pull/31429#discussion_r568318892 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1405,6 +1405,10 @@ class Analyzer(override val cat

[GitHub] [spark] c21 commented on a change in pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

c21 commented on a change in pull request #31413: URL: https://github.com/apache/spark/pull/31413#discussion_r568318526 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -591,20 +590,48 @@ case class FileSourceScanExec( lo

[GitHub] [spark] SparkQA commented on pull request #31421: [SPARK-33591][SQL][FOLLOWUP] Add legacy config for recognizing null partition spec values

SparkQA commented on pull request #31421: URL: https://github.com/apache/spark/pull/31421#issuecomment-771354453 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39342/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31427: [SPARK-34209][SQL] Delegate table name validation to the session catalog

SparkQA removed a comment on pull request #31427: URL: https://github.com/apache/spark/pull/31427#issuecomment-771248088 **[Test build #134749 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134749/testReport)** for PR 31427 at commit [`23964ff`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31427: [SPARK-34209][SQL] Delegate table name validation to the session catalog

SparkQA commented on pull request #31427: URL: https://github.com/apache/spark/pull/31427#issuecomment-771350989 **[Test build #134749 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134749/testReport)** for PR 31427 at commit [`23964ff`](https://github.co

[GitHub] [spark] beliefer commented on a change in pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

beliefer commented on a change in pull request #31402: URL: https://github.com/apache/spark/pull/31402#discussion_r568296396 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala ## @@ -511,14 +511,15 @@ case class Lag(

[GitHub] [spark] SparkQA commented on pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

SparkQA commented on pull request #31286: URL: https://github.com/apache/spark/pull/31286#issuecomment-771348877 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39340/ ---

[GitHub] [spark] SparkQA commented on pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

SparkQA commented on pull request #31316: URL: https://github.com/apache/spark/pull/31316#issuecomment-771346810 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39339/ ---

[GitHub] [spark] SparkQA commented on pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

SparkQA commented on pull request #31429: URL: https://github.com/apache/spark/pull/31429#issuecomment-771344977 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39336/ ---

[GitHub] [spark] SparkQA commented on pull request #31421: [SPARK-33591][SQL][FOLLOWUP] Add legacy config for recognizing null partition spec values

SparkQA commented on pull request #31421: URL: https://github.com/apache/spark/pull/31421#issuecomment-771341045 **[Test build #134756 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134756/testReport)** for PR 31421 at commit [`971ccbd`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31422: [SPARK-34313][SQL] Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to use UnresolvedTable to resolve the identifier

SparkQA commented on pull request #31422: URL: https://github.com/apache/spark/pull/31422#issuecomment-771341008 **[Test build #134755 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134755/testReport)** for PR 31422 at commit [`e0ccd1a`](https://github.com

[GitHub] [spark] gengliangwang commented on pull request #31421: [SPARK-33591][SQL][FOLLOWUP] Add legacy config for recognizing null partition spec values

gengliangwang commented on pull request #31421: URL: https://github.com/apache/spark/pull/31421#issuecomment-771340615 @MaxGekk Thanks for the suggestions. I have addressed all of them. This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

AmplabJenkins removed a comment on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771336468 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31426: [SPARK-34318][SQL] Dataset.colRegex should work with column names and qualifiers which contain newlines

AmplabJenkins removed a comment on pull request #31426: URL: https://github.com/apache/spark/pull/31426#issuecomment-771336472 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31421: [SPARK-33591][SQL][FOLLOWUP] Add legacy config for recognizing null partition spec values

AmplabJenkins removed a comment on pull request #31421: URL: https://github.com/apache/spark/pull/31421#issuecomment-771214976 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134741/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31423: [SPARK-34314][SQL] Rebuild the file index after partition schema inferring

AmplabJenkins removed a comment on pull request #31423: URL: https://github.com/apache/spark/pull/31423#issuecomment-771336470 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134748/ -

[GitHub] [spark] SparkQA commented on pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

SparkQA commented on pull request #31286: URL: https://github.com/apache/spark/pull/31286#issuecomment-771338055 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39340/ -

[GitHub] [spark] SparkQA commented on pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

SparkQA commented on pull request #31429: URL: https://github.com/apache/spark/pull/31429#issuecomment-771337955 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39336/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

AmplabJenkins commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771337280 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39337/ -

[GitHub] [spark] SparkQA commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

SparkQA commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771337052 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39337/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #31426: [SPARK-34318][SQL] Dataset.colRegex should work with column names and qualifiers which contain newlines

AmplabJenkins commented on pull request #31426: URL: https://github.com/apache/spark/pull/31426#issuecomment-771336472 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134747/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31423: [SPARK-34314][SQL] Rebuild the file index after partition schema inferring

AmplabJenkins commented on pull request #31423: URL: https://github.com/apache/spark/pull/31423#issuecomment-771336470 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134748/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

AmplabJenkins commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771336468 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134750/ -

[GitHub] [spark] SparkQA commented on pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

SparkQA commented on pull request #31316: URL: https://github.com/apache/spark/pull/31316#issuecomment-771335864 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39339/ -

[GitHub] [spark] SparkQA commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

SparkQA commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771334789 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39337/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31426: [SPARK-34318][SQL] Dataset.colRegex should work with column names and qualifiers which contain newlines

SparkQA removed a comment on pull request #31426: URL: https://github.com/apache/spark/pull/31426#issuecomment-77128 **[Test build #134747 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134747/testReport)** for PR 31426 at commit [`921f881`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31426: [SPARK-34318][SQL] Dataset.colRegex should work with column names and qualifiers which contain newlines

SparkQA commented on pull request #31426: URL: https://github.com/apache/spark/pull/31426#issuecomment-771331024 **[Test build #134747 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134747/testReport)** for PR 31426 at commit [`921f881`](https://github.co

[GitHub] [spark] ueshin commented on a change in pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

ueshin commented on a change in pull request #31429: URL: https://github.com/apache/spark/pull/31429#discussion_r568300148 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1405,6 +1405,10 @@ class Analyzer(override val cata

[GitHub] [spark] beliefer commented on a change in pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

beliefer commented on a change in pull request #31402: URL: https://github.com/apache/spark/pull/31402#discussion_r568300025 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -205,7 +205,7 @@ | org.apache.spark.sql.catalyst.expressions.Pars

[GitHub] [spark] beliefer commented on a change in pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

beliefer commented on a change in pull request #31402: URL: https://github.com/apache/spark/pull/31402#discussion_r568299145 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala ## @@ -528,6 +529,10 @@ abstract class RowNu

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

AngersZh commented on a change in pull request #31402: URL: https://github.com/apache/spark/pull/31402#discussion_r568298627 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -205,7 +205,7 @@ | org.apache.spark.sql.catalyst.expressions.

[GitHub] [spark] beliefer commented on a change in pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

beliefer commented on a change in pull request #31402: URL: https://github.com/apache/spark/pull/31402#discussion_r568296396 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala ## @@ -511,14 +511,15 @@ case class Lag(

[GitHub] [spark] Ngone51 commented on pull request #30751: [SPARK-32617][K8S][TESTS] Configure kubernetes client based on kubeconfig settings in kubernetes integration tests

Ngone51 commented on pull request #30751: URL: https://github.com/apache/spark/pull/30751#issuecomment-771328831 huh..I'm not familiar with this part..so please go on without block on me. This is an automated message from the

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

AngersZh commented on a change in pull request #31402: URL: https://github.com/apache/spark/pull/31402#discussion_r568298627 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -205,7 +205,7 @@ | org.apache.spark.sql.catalyst.expressions.

[GitHub] [spark] HyukjinKwon commented on pull request #30135: [SPARK-29250][BUILD] Upgrade to Hadoop 3.3.0

HyukjinKwon commented on pull request #30135: URL: https://github.com/apache/spark/pull/30135#issuecomment-771327635 👍 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] beliefer commented on a change in pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

beliefer commented on a change in pull request #31402: URL: https://github.com/apache/spark/pull/31402#discussion_r568297774 ## File path: sql/core/src/test/resources/sql-functions/sql-expression-schema.md ## @@ -205,7 +205,7 @@ | org.apache.spark.sql.catalyst.expressions.Pars

[GitHub] [spark] Ngone51 commented on pull request #30650: [SPARK-24818][CORE] Support delay scheduling for barrier execution

Ngone51 commented on pull request #30650: URL: https://github.com/apache/spark/pull/30650#issuecomment-771326460 > If there is insufficient resources to run the entire taskset at (some) highest locality level, and there is atleast one task that can be launched at that level - we will end u

[GitHub] [spark] beliefer commented on a change in pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

beliefer commented on a change in pull request #31402: URL: https://github.com/apache/spark/pull/31402#discussion_r568296396 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala ## @@ -511,14 +511,15 @@ case class Lag(

[GitHub] [spark] SparkQA removed a comment on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

SparkQA removed a comment on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771315438 **[Test build #134750 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134750/testReport)** for PR 31428 at commit [`ee9311b`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

SparkQA commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771322064 **[Test build #134750 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134750/testReport)** for PR 31428 at commit [`ee9311b`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

SparkQA commented on pull request #31316: URL: https://github.com/apache/spark/pull/31316#issuecomment-771321877 **[Test build #134752 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134752/testReport)** for PR 31316 at commit [`a6ba6d4`](https://github.com

[GitHub] [spark] HeartSaVioR commented on a change in pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

HeartSaVioR commented on a change in pull request #31369: URL: https://github.com/apache/spark/pull/31369#discussion_r568293221 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -165,10 +165,18 @@ case class StateStoreM

[GitHub] [spark] SparkQA commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

SparkQA commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-771320748 **[Test build #134751 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134751/testReport)** for PR 31402 at commit [`96037a8`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31423: [SPARK-34314][SQL] Rebuild the file index after partition schema inferring

AmplabJenkins removed a comment on pull request #31423: URL: https://github.com/apache/spark/pull/31423#issuecomment-771266963 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39334/

[GitHub] [spark] SparkQA removed a comment on pull request #31423: [SPARK-34314][SQL] Rebuild the file index after partition schema inferring

SparkQA removed a comment on pull request #31423: URL: https://github.com/apache/spark/pull/31423#issuecomment-771215978 **[Test build #134748 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134748/testReport)** for PR 31423 at commit [`36a4a7f`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31423: [SPARK-34314][SQL] Rebuild the file index after partition schema inferring

SparkQA commented on pull request #31423: URL: https://github.com/apache/spark/pull/31423#issuecomment-771320577 **[Test build #134748 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134748/testReport)** for PR 31423 at commit [`36a4a7f`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

SparkQA commented on pull request #31286: URL: https://github.com/apache/spark/pull/31286#issuecomment-771318932 **[Test build #134754 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134754/testReport)** for PR 31286 at commit [`19340d4`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

SparkQA commented on pull request #31429: URL: https://github.com/apache/spark/pull/31429#issuecomment-771318802 **[Test build #134753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134753/testReport)** for PR 31429 at commit [`0ab2b7a`](https://github.com

[GitHub] [spark] viirya commented on a change in pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

viirya commented on a change in pull request #31369: URL: https://github.com/apache/spark/pull/31369#discussion_r568291799 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -165,10 +165,18 @@ case class StateStoreMetric

[GitHub] [spark] HeartSaVioR commented on a change in pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

HeartSaVioR commented on a change in pull request #31369: URL: https://github.com/apache/spark/pull/31369#discussion_r568291356 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -165,10 +165,18 @@ case class StateStoreM

[GitHub] [spark] linhongliu-db commented on a change in pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

linhongliu-db commented on a change in pull request #31286: URL: https://github.com/apache/spark/pull/31286#discussion_r568291192 ## File path: sql/core/src/test/resources/sql-tests/inputs/postgreSQL/join.sql ## @@ -743,20 +743,20 @@ select * from a left join b on i = x and i =

[GitHub] [spark] Ngone51 commented on pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

Ngone51 commented on pull request #31429: URL: https://github.com/apache/spark/pull/31429#issuecomment-771317058 cc @d80tb7 @cloud-fan @HyukjinKwon Please take a look, thanks! This is an automated message from the Apache Git

[GitHub] [spark] Ngone51 opened a new pull request #31429: [SPARK-34319][SQL] Resolve duplicate attributes for FlatMapCoGroupsInPandas

Ngone51 opened a new pull request #31429: URL: https://github.com/apache/spark/pull/31429 ### What changes were proposed in this pull request? Resolve duplicate attributes for `FlatMapCoGroupsInPandas`. ### Why are the changes needed? When performing self

[GitHub] [spark] SparkQA commented on pull request #31428: [SPARK-34316][K8S] Support spark.kubernetes.executor.disableConfigMap

SparkQA commented on pull request #31428: URL: https://github.com/apache/spark/pull/31428#issuecomment-771315438 **[Test build #134750 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134750/testReport)** for PR 31428 at commit [`ee9311b`](https://github.com

[GitHub] [spark] xuanyuanking commented on a change in pull request #31369: [SPARK-34270][SS] Combine StateStoreMetrics should not override StateStoreCustomMetric

xuanyuanking commented on a change in pull request #31369: URL: https://github.com/apache/spark/pull/31369#discussion_r568288897 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -165,10 +165,18 @@ case class StateStore

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

AmplabJenkins removed a comment on pull request #31413: URL: https://github.com/apache/spark/pull/31413#issuecomment-771312662 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134746/ -

<    1   2   3   4   5   6   7   8   >