[GitHub] [spark] AmplabJenkins removed a comment on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

AmplabJenkins removed a comment on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879342571 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45492/

[GitHub] [spark] AmplabJenkins commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

AmplabJenkins commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879342571 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45492/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

AmplabJenkins commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879342573 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45491/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

AmplabJenkins commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879342572 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45493/ -- T

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879329554 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45492/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879328622 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45493/ -- This is an automated message from the A

[GitHub] [spark] SparkQA removed a comment on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

SparkQA removed a comment on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879137241 **[Test build #140974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140974/testReport)** for PR 33324 at commit [`aedb62c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

SparkQA commented on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879325577 **[Test build #140974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140974/testReport)** for PR 33324 at commit [`aedb62c`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

SparkQA commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879321198 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45491/ -- This is an automated message from the A

[GitHub] [spark] xkrogen commented on a change in pull request #33328: [SPARK-28266][SQL] convertToLogicalRelation should not interpret `path` property when reading Hive tables

xkrogen commented on a change in pull request #33328: URL: https://github.com/apache/spark/pull/33328#discussion_r669022583 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala ## @@ -363,4 +363,33 @@ class DataSourceWithHiveMetastore

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879316709 **[Test build #140980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140980/testReport)** for PR 33327 at commit [`f5ec2c7`](https://github.com

[GitHub] [spark] allisonwang-db commented on pull request #32488: [SPARK-35316][SQL] UnwrapCastInBinaryComparison support In/InSet predicate

allisonwang-db commented on pull request #32488: URL: https://github.com/apache/spark/pull/32488#issuecomment-879315179 Hi @cfmcgrady this check https://github.com/apache/spark/blob/fbf53dee37129a493a4e5d5a007625b35f44fbda/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimiz

[GitHub] [spark] viirya commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

viirya commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879314809 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [spark] SparkQA commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879313292 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45493/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879308629 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45492/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #33329: [WIP][SPARK-35917][SHUFFLE][CORE]Disable push-based shuffle feature to prevent it from being used

AmplabJenkins commented on pull request #33329: URL: https://github.com/apache/spark/pull/33329#issuecomment-879306799 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] AmplabJenkins commented on pull request #33328: [SPARK-28266][SQL] convertToLogicalRelation should not interpret `path` property when reading Hive tables

AmplabJenkins commented on pull request #33328: URL: https://github.com/apache/spark/pull/33328#issuecomment-879306828 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

AmplabJenkins removed a comment on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879306376 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140978/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

AmplabJenkins commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879306376 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140978/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA removed a comment on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879278639 **[Test build #140978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140978/testReport)** for PR 33327 at commit [`f5ec2c7`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879303777 **[Test build #140978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140978/testReport)** for PR 33327 at commit [`f5ec2c7`](https://github.co

[GitHub] [spark] ekoifman commented on a change in pull request #32872: [SPARK-35639][SQL] Make hasCoalescedPartition return true if something was actually coalesced

ekoifman commented on a change in pull request #32872: URL: https://github.com/apache/spark/pull/32872#discussion_r669006682 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CustomShuffleReaderExec.scala ## @@ -87,8 +87,15 @@ case class CustomShuff

[GitHub] [spark] ekoifman commented on a change in pull request #32872: [SPARK-35639][SQL] Make hasCoalescedPartition return true if something was actually coalesced

ekoifman commented on a change in pull request #32872: URL: https://github.com/apache/spark/pull/32872#discussion_r669006682 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CustomShuffleReaderExec.scala ## @@ -87,8 +87,15 @@ case class CustomShuff

[GitHub] [spark] SparkQA commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

SparkQA commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879301685 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45491/ -- This is an automated message from the Apache

[GitHub] [spark] otterc commented on pull request #33329: [WIP][SPARK-35917][SHUFFLE][CORE]Disable push-based shuffle feature to prevent it from being used

otterc commented on pull request #33329: URL: https://github.com/apache/spark/pull/33329#issuecomment-879299258 cc. @mridulm @Ngone51 @Victsm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] otterc opened a new pull request #33329: [WIP][SPARK-35917][SHUFFLE][CORE]Disable push-based shuffle feature to prevent it from being used

otterc opened a new pull request #33329: URL: https://github.com/apache/spark/pull/33329 This is WIP because #33118 (comment) What changes were proposed in this pull request? Push-based shuffle is partially merged in apache master but some of the tasks are still incomplete. Since

[GitHub] [spark] shardulm94 opened a new pull request #33328: [SPARK-28266][SQL] convertToLogicalRelation should not interpret `path` property when reading Hive tables

shardulm94 opened a new pull request #33328: URL: https://github.com/apache/spark/pull/33328 ### What changes were proposed in this pull request? For non-datasource Hive tables, e.g. tables written outside of Spark (through Hive or Trino), we have certain optimzations in Spar

[GitHub] [spark] SparkQA commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879278682 **[Test build #140979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140979/testReport)** for PR 33326 at commit [`3c8f119`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879278639 **[Test build #140978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140978/testReport)** for PR 33327 at commit [`f5ec2c7`](https://github.com

[GitHub] [spark] viirya commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

viirya commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879278151 cc @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [spark] viirya commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

viirya commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879278086 cc @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [spark] viirya opened a new pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

viirya opened a new pull request #33326: URL: https://github.com/apache/spark/pull/33326 ### What changes were proposed in this pull request? This patch proposes to check data after adding data to topic in `KafkaSourceStressSuite`. ### Why are the changes needed?

[GitHub] [spark] viirya opened a new pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

viirya opened a new pull request #33327: URL: https://github.com/apache/spark/pull/33327 ### What changes were proposed in this pull request? This patch proposes to check data after adding data to topic in `KafkaSourceStressSuite`. ### Why are the changes needed?

[GitHub] [spark] sunchao commented on pull request #32875: [WIP][SPARK-35703] Remove HashClusteredDistribution and relax constraint for bucket join

sunchao commented on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-879273740 Thanks @rdblue for taking a look. Yes IMO these two are correlated, and I've just updated the "Why are the changes needed?" section above to clarify the motivation. Let me know

[GitHub] [spark] AmplabJenkins commented on pull request #33310: [SPARK-36105][SQL] OptimizeLocalShuffleReader support reading data of multiple mappers in one task

AmplabJenkins commented on pull request #33310: URL: https://github.com/apache/spark/pull/33310#issuecomment-879272271 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] SparkQA commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

SparkQA commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879271462 **[Test build #140977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140977/testReport)** for PR 33309 at commit [`db1d67c`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879268378 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45490/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

AmplabJenkins removed a comment on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879268376 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140973/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

AmplabJenkins commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879268378 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45490/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

AmplabJenkins commented on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879268376 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140973/ -- This

[GitHub] [spark] mridulm commented on pull request #33303: [SPARK-32920][CORE][SHUFFLE][FOLLOW-UP] Fix to run push-based shuffle tests in DAGSchedulerSuite in ad-hoc manner

mridulm commented on pull request #33303: URL: https://github.com/apache/spark/pull/33303#issuecomment-879265736 Merged to master and branch-3.2 Thanks for fixing this @venkata91 ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] mridulm commented on pull request #33303: [SPARK-32920][CORE][SHUFFLE][FOLLOW-UP] Fix to run push-based shuffle tests in DAGSchedulerSuite in ad-hoc manner

mridulm commented on pull request #33303: URL: https://github.com/apache/spark/pull/33303#issuecomment-879264054 +CC @gengliangwang, merged to branch-3.2 as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [spark] asfgit closed pull request #33303: [SPARK-32920][CORE][SHUFFLE][FOLLOW-UP] Fix to run push-based shuffle tests in DAGSchedulerSuite in ad-hoc manner

asfgit closed pull request #33303: URL: https://github.com/apache/spark/pull/33303 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubsc

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879258556 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45490/ -- This is an automated message from the A

[GitHub] [spark] viirya closed pull request #31570: [SPARK-10816][SS] SessionWindow support for Structure Streaming

viirya closed pull request #31570: URL: https://github.com/apache/spark/pull/31570 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubsc

[GitHub] [spark] viirya closed pull request #32422: [DO-NOT-MERGE][WIP][SS] Custom stateful task scheduling

viirya closed pull request #32422: URL: https://github.com/apache/spark/pull/32422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubsc

[GitHub] [spark] SparkQA removed a comment on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

SparkQA removed a comment on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879045983 **[Test build #140973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140973/testReport)** for PR 33322 at commit [`8f9e2bd`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

SparkQA commented on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879242998 **[Test build #140973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140973/testReport)** for PR 33322 at commit [`8f9e2bd`](https://github.co

[GitHub] [spark] stephanecollot commented on pull request #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty

stephanecollot commented on pull request #27861: URL: https://github.com/apache/spark/pull/27861#issuecomment-879238130 Hi I'm interested in this, I want to give a row number per group, without sorting for performance reason and because I don't mind about the order. Here: ht

[GitHub] [spark] dongjoon-hyun commented on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

dongjoon-hyun commented on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-879237641 Thank you so much, @allisonwang-db and @cloud-fan ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879234600 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45490/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

AmplabJenkins removed a comment on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879229381 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45488/

[GitHub] [spark] AmplabJenkins commented on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

AmplabJenkins commented on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879229381 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45488/ -- T

[GitHub] [spark] mickjermsurawong-stripe commented on pull request #33205: [SPARK-20384][SQL] Support value class in nested schema for Dataset

mickjermsurawong-stripe commented on pull request #33205: URL: https://github.com/apache/spark/pull/33205#issuecomment-879225200 hi @eejbyfeldt please feel free to drive this forward. Thank you for the work. Happy if you'd like to make a patch here :) On backward-compat, i think one pr

[GitHub] [spark] xinrong-databricks commented on pull request #33315: [SPARK-36104][PYTHON][FOLLOWUP] Remove unused import "typing.cast"

xinrong-databricks commented on pull request #33315: URL: https://github.com/apache/spark/pull/33315#issuecomment-879223295 Thanks @sarutak! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [spark] michaelzhang-db commented on pull request #33310: [SPARK-36105][SQL] OptimizeLocalShuffleReader support reading data of multiple mappers in one task

michaelzhang-db commented on pull request #33310: URL: https://github.com/apache/spark/pull/33310#issuecomment-879214835 @cloud-fan @maryannxue Can you both quickly review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] viirya closed pull request #31989: [SPARK-34891][SS] Introduce state store manager for session window in streaming query

viirya closed pull request #31989: URL: https://github.com/apache/spark/pull/31989 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubsc

[GitHub] [spark] viirya commented on pull request #31989: [SPARK-34891][SS] Introduce state store manager for session window in streaming query

viirya commented on pull request #31989: URL: https://github.com/apache/spark/pull/31989#issuecomment-879208893 Thanks @HeartSaVioR. Merging to master/3.2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [spark] SparkQA commented on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

SparkQA commented on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879207190 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45488/ -- This is an automated message from the A

[GitHub] [spark] viirya commented on pull request #33311: [SPARK-36109][SS][TEST] Check data after adding data to topic in KafkaSourceStressSuite

viirya commented on pull request #33311: URL: https://github.com/apache/spark/pull/33311#issuecomment-879204852 Thanks @dongjoon-hyun and @HeartSaVioR. I will create backport PRs for 3.1/3.0. -- This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [spark] AmplabJenkins commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

AmplabJenkins commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-879200836 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45489/ -- T

[GitHub] [spark] SparkQA commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

SparkQA commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-879200812 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45489/ -- This

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879197621 **[Test build #140976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140976/testReport)** for PR 32959 at commit [`4723f8e`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

SparkQA removed a comment on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-879194929 **[Test build #140975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140975/testReport)** for PR 32401 at commit [`4da61d9`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

AmplabJenkins removed a comment on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-879195524 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140975/ -

[GitHub] [spark] SparkQA commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

SparkQA commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-879195501 **[Test build #140975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140975/testReport)** for PR 32401 at commit [`4da61d9`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

AmplabJenkins commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-879195524 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140975/ -- This

[GitHub] [spark] SparkQA commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

SparkQA commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-879194929 **[Test build #140975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140975/testReport)** for PR 32401 at commit [`4da61d9`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31989: [SPARK-34891][SS] Introduce state store manager for session window in streaming query

AmplabJenkins removed a comment on pull request #31989: URL: https://github.com/apache/spark/pull/31989#issuecomment-879189149 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140971/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31989: [SPARK-34891][SS] Introduce state store manager for session window in streaming query

AmplabJenkins commented on pull request #31989: URL: https://github.com/apache/spark/pull/31989#issuecomment-879189149 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140971/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31989: [SPARK-34891][SS] Introduce state store manager for session window in streaming query

SparkQA removed a comment on pull request #31989: URL: https://github.com/apache/spark/pull/31989#issuecomment-878972400 **[Test build #140971 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140971/testReport)** for PR 31989 at commit [`f12cda8`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31989: [SPARK-34891][SS] Introduce state store manager for session window in streaming query

SparkQA commented on pull request #31989: URL: https://github.com/apache/spark/pull/31989#issuecomment-879187376 **[Test build #140971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140971/testReport)** for PR 31989 at commit [`f12cda8`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #33325: [SPARK-36076][SQL][3.0] ArrayIndexOutOfBounds in Cast string to times…

AmplabJenkins commented on pull request #33325: URL: https://github.com/apache/spark/pull/33325#issuecomment-879187059 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33321: [SPARK-35735][SQL][FOLLOWUP] Remove unused method `IntervalUtils.checkIntervalStringDataType()`

AmplabJenkins removed a comment on pull request #33321: URL: https://github.com/apache/spark/pull/33321#issuecomment-879185674 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140969/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33321: [SPARK-35735][SQL][FOLLOWUP] Remove unused method `IntervalUtils.checkIntervalStringDataType()`

AmplabJenkins commented on pull request #33321: URL: https://github.com/apache/spark/pull/33321#issuecomment-879185674 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140969/ -- This

[GitHub] [spark] SparkQA commented on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

SparkQA commented on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879179839 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45488/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33321: [SPARK-35735][SQL][FOLLOWUP] Remove unused method `IntervalUtils.checkIntervalStringDataType()`

SparkQA removed a comment on pull request #33321: URL: https://github.com/apache/spark/pull/33321#issuecomment-878971603 **[Test build #140969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140969/testReport)** for PR 33321 at commit [`72aaf8f`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33321: [SPARK-35735][SQL][FOLLOWUP] Remove unused method `IntervalUtils.checkIntervalStringDataType()`

SparkQA commented on pull request #33321: URL: https://github.com/apache/spark/pull/33321#issuecomment-879173445 **[Test build #140969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140969/testReport)** for PR 33321 at commit [`72aaf8f`](https://github.co

[GitHub] [spark] dgd-contributor commented on pull request #33325: [SPARK-36076][SQL][3.0] ArrayIndexOutOfBounds in Cast string to times…

dgd-contributor commented on pull request #33325: URL: https://github.com/apache/spark/pull/33325#issuecomment-879168730 @gengliangwang this is a PR to cherry-pick to branch-3.0 for pull request #33293 -- This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] dgd-contributor opened a new pull request #33325: [SPARK-36076][SQL][3.0] ArrayIndexOutOfBounds in Cast string to times…

dgd-contributor opened a new pull request #33325: URL: https://github.com/apache/spark/pull/33325 …tamp ### What changes were proposed in this pull request? Casting string to timestamp might throw ArrayIndexOutOfBounds in certain cases This error only occur in branch 3.0, 3.1 and p

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33258: [SPARK-36037][SQL] Support ANSI SQL LOCALTIMESTAMP datetime value function

AmplabJenkins removed a comment on pull request #33258: URL: https://github.com/apache/spark/pull/33258#issuecomment-879141354 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140972/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33253: [SPARK-36038][CORE] Speculation metrics summary at stage level

AmplabJenkins removed a comment on pull request #33253: URL: https://github.com/apache/spark/pull/33253#issuecomment-87748 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45379/

[GitHub] [spark] SparkQA removed a comment on pull request #33258: [SPARK-36037][SQL] Support ANSI SQL LOCALTIMESTAMP datetime value function

SparkQA removed a comment on pull request #33258: URL: https://github.com/apache/spark/pull/33258#issuecomment-879008714 **[Test build #140972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140972/testReport)** for PR 33258 at commit [`e8c17e5`](https://gi

[GitHub] [spark] venkata91 commented on pull request #33253: [SPARK-36038][CORE] Speculation metrics summary at stage level

venkata91 commented on pull request #33253: URL: https://github.com/apache/spark/pull/33253#issuecomment-879141226 > > @venkata91 I checked out your change and run it on GA on my account but it fails to build. > > ``` > > [error] /home/runner/work/spark/spark/core/src/test/scala/org/

[GitHub] [spark] AmplabJenkins commented on pull request #33258: [SPARK-36037][SQL] Support ANSI SQL LOCALTIMESTAMP datetime value function

AmplabJenkins commented on pull request #33258: URL: https://github.com/apache/spark/pull/33258#issuecomment-879141354 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140972/ -- This

[GitHub] [spark] SparkQA commented on pull request #33258: [SPARK-36037][SQL] Support ANSI SQL LOCALTIMESTAMP datetime value function

SparkQA commented on pull request #33258: URL: https://github.com/apache/spark/pull/33258#issuecomment-879140563 **[Test build #140972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140972/testReport)** for PR 33258 at commit [`e8c17e5`](https://github.co

[GitHub] [spark] skhandrikagmail commented on a change in pull request #33301: Update SSLOptions.scala

skhandrikagmail commented on a change in pull request #33301: URL: https://github.com/apache/spark/pull/33301#discussion_r668821053 ## File path: core/src/main/scala/org/apache/spark/SSLOptions.scala ## @@ -78,6 +78,12 @@ private[spark] case class SSLOptions( trustStor

[GitHub] [spark] SparkQA commented on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

SparkQA commented on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879137241 **[Test build #140974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140974/testReport)** for PR 33324 at commit [`aedb62c`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #33323: [SPARK-35739][SQL] Add Java-compatible Dataset.join overloads

AmplabJenkins commented on pull request #33323: URL: https://github.com/apache/spark/pull/33323#issuecomment-879136851 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

AmplabJenkins removed a comment on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879136087 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45487/

[GitHub] [spark] AmplabJenkins commented on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

AmplabJenkins commented on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879136087 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45487/ -- T

[GitHub] [spark] MaxGekk closed pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

MaxGekk closed pull request #33322: URL: https://github.com/apache/spark/pull/33322 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubs

[GitHub] [spark] gengliangwang closed pull request #33293: [SPARK-36076][SQL][3.1] ArrayIndexOutOfBounds in Cast string to times…

gengliangwang closed pull request #33293: URL: https://github.com/apache/spark/pull/33293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-

[GitHub] [spark] gengliangwang commented on pull request #33293: [SPARK-36076][SQL][3.1] ArrayIndexOutOfBounds in Cast string to times…

gengliangwang commented on pull request #33293: URL: https://github.com/apache/spark/pull/33293#issuecomment-879130468 @dgd-contributor can you open a PR to cherry-pick to branch-3.0? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] gengliangwang edited a comment on pull request #33293: [SPARK-36076][SQL][3.1] ArrayIndexOutOfBounds in Cast string to times…

gengliangwang edited a comment on pull request #33293: URL: https://github.com/apache/spark/pull/33293#issuecomment-879128090 Merging to branch-3.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] gengliangwang commented on pull request #33293: [SPARK-36076][SQL][3.1] ArrayIndexOutOfBounds in Cast string to times…

gengliangwang commented on pull request #33293: URL: https://github.com/apache/spark/pull/33293#issuecomment-879128090 Merging to branch-3.1 / branch-3.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [spark] AngersZhuuuu opened a new pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

AngersZh opened a new pull request #33324: URL: https://github.com/apache/spark/pull/33324 ### What changes were proposed in this pull request? RemoveRedundantAliases may change DataWritingCommand's parameter's attribute name. In the UT's case before RemoveRedundantAliases the par

[GitHub] [spark] SparkQA commented on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

SparkQA commented on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879108929 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45487/ -- This is an automated message from the A

[GitHub] [spark] brandondahler opened a new pull request #33323: [SPARK-35739][SQL] Add Java-compatible Dataset.join overloads

brandondahler opened a new pull request #33323: URL: https://github.com/apache/spark/pull/33323 ### What changes were proposed in this pull request? Adds 3 new syntactic sugar overloads to Dataset's join method as proposed in [SPARK-35739](https://issues.apache.org/jira/browse/SPARK-3573

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33258: [SPARK-36037][SQL] Support ANSI SQL LOCALTIMESTAMP datetime value function

AmplabJenkins removed a comment on pull request #33258: URL: https://github.com/apache/spark/pull/33258#issuecomment-879086447 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45486/

<    1   2   3   4   5   6   7   >