[GitHub] [spark] SparkQA removed a comment on pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

SparkQA removed a comment on pull request #33629: URL: https://github.com/apache/spark/pull/33629#issuecomment-895692670 **[Test build #142251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142251/testReport)** for PR 33629 at commit

[GitHub] [spark] viirya opened a new pull request #33691: [SPARK-36465][SS] Dynamic gap duration in session window

viirya opened a new pull request #33691: URL: https://github.com/apache/spark/pull/33691 ### What changes were proposed in this pull request? This patch supports dynamic gap duration in session window. ### Why are the changes needed? The gap duration

[GitHub] [spark] kazuyukitanimura opened a new pull request #33690: [SPARK-36464][Core] Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

kazuyukitanimura opened a new pull request #33690: URL: https://github.com/apache/spark/pull/33690 ### What changes were proposed in this pull request? The `size` method of `ChunkedByteBufferOutputStream` returns a `Long` value; however, the underlying `_size` variable is initialized as

[GitHub] [spark] cloud-fan commented on a change in pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

cloud-fan commented on a change in pull request #33661: URL: https://github.com/apache/spark/pull/33661#discussion_r685706819 ## File path: sql/core/src/test/resources/sql-tests/inputs/interval.sql ## @@ -322,3 +322,13 @@ SELECT INTERVAL '153722867280' MINUTE; SELECT INTERVAL

[GitHub] [spark] SparkQA commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

SparkQA commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895744670 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46761/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #33689: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

AmplabJenkins commented on pull request #33689: URL: https://github.com/apache/spark/pull/33689#issuecomment-895740342 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46760/ --

[GitHub] [spark] SparkQA commented on pull request #33689: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

SparkQA commented on pull request #33689: URL: https://github.com/apache/spark/pull/33689#issuecomment-895740303 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46760/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33465: [SPARK-36245][SQL] Deduplicate the right side of left semi/anti join

SparkQA commented on pull request #33465: URL: https://github.com/apache/spark/pull/33465#issuecomment-895739636 **[Test build #142255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142255/testReport)** for PR 33465 at commit

[GitHub] [spark] cloud-fan closed pull request #33676: [SPARK-36449][SQL] v2 ALTER TABLE REPLACE COLUMNS should check duplicates for the user specified columns

cloud-fan closed pull request #33676: URL: https://github.com/apache/spark/pull/33676 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] cloud-fan commented on pull request #33676: [SPARK-36449][SQL] v2 ALTER TABLE REPLACE COLUMNS should check duplicates for the user specified columns

cloud-fan commented on pull request #33676: URL: https://github.com/apache/spark/pull/33676#issuecomment-895737599 thanks, merging to master/3.2! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] cloud-fan commented on pull request #33686: [SPARK-36086][SQL][3.0] CollapseProject project replace alias should use origin column name

cloud-fan commented on pull request #33686: URL: https://github.com/apache/spark/pull/33686#issuecomment-895737248 is it a real failure? ``` DataSourceV2ScanExecRedactionSuite.SPARK-30362: test input metrics for DSV2 ``` -- This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

AmplabJenkins commented on pull request #33629: URL: https://github.com/apache/spark/pull/33629#issuecomment-895737072 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142251/ -- This

[GitHub] [spark] SparkQA commented on pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

SparkQA commented on pull request #33629: URL: https://github.com/apache/spark/pull/33629#issuecomment-895736519 **[Test build #142251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142251/testReport)** for PR 33629 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33068: [SPARK-36461][SQL] Enable ObjectHashAggregate for more Aggregate functions

AmplabJenkins removed a comment on pull request #33068: URL: https://github.com/apache/spark/pull/33068#issuecomment-895557921 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

AmplabJenkins removed a comment on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895695382 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

AmplabJenkins commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895732308 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46759/ --

[GitHub] [spark] SparkQA commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

SparkQA commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895731933 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46761/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

SparkQA commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895730021 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46759/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

SparkQA removed a comment on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895713024 **[Test build #142254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142254/testReport)** for PR 33661 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-895504335 **[Test build #142244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142244/testReport)** for PR 33650 at commit

[GitHub] [spark] SparkQA commented on pull request #33689: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

SparkQA commented on pull request #33689: URL: https://github.com/apache/spark/pull/33689#issuecomment-895726410 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46760/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

AmplabJenkins commented on pull request #33629: URL: https://github.com/apache/spark/pull/33629#issuecomment-895721729 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46758/ --

[GitHub] [spark] SparkQA commented on pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

SparkQA commented on pull request #33629: URL: https://github.com/apache/spark/pull/33629#issuecomment-895721676 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46758/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-895718920 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142244/ -- This

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-895718691 **[Test build #142244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142244/testReport)** for PR 33650 at commit

[GitHub] [spark] SparkQA commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

SparkQA commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895715081 **[Test build #142254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142254/testReport)** for PR 33661 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

AmplabJenkins commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895715108 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142254/ -- This

[GitHub] [spark] SparkQA commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

SparkQA commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895713024 **[Test build #142254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142254/testReport)** for PR 33661 at commit

[GitHub] [spark] SparkQA commented on pull request #33689: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

SparkQA commented on pull request #33689: URL: https://github.com/apache/spark/pull/33689#issuecomment-895712998 **[Test build #142253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142253/testReport)** for PR 33689 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

AmplabJenkins commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895712369 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46756/ --

[GitHub] [spark] SparkQA commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

SparkQA commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895712343 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46756/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

AmplabJenkins removed a comment on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895711932 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33684: [SPARK-36429][SQL] JacksonParser should throw exception when data type unsupported.

AmplabJenkins removed a comment on pull request #33684: URL: https://github.com/apache/spark/pull/33684#issuecomment-895029634 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

AmplabJenkins commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895711932 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #33684: [SPARK-36429][SQL] JacksonParser should throw exception when data type unsupported.

AmplabJenkins commented on pull request #33684: URL: https://github.com/apache/spark/pull/33684#issuecomment-895711931 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46754/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

AmplabJenkins removed a comment on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895675982 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142248/

[GitHub] [spark] SparkQA commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

SparkQA commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895711493 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46757/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

SparkQA commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895711177 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46759/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

SparkQA removed a comment on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895692789 **[Test build #142252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142252/testReport)** for PR 33615 at commit

[GitHub] [spark] SparkQA commented on pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

SparkQA commented on pull request #33629: URL: https://github.com/apache/spark/pull/33629#issuecomment-895708439 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46758/ -- This is an automated message from the Apache

[GitHub] [spark] HeartSaVioR commented on a change in pull request #33689: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

HeartSaVioR commented on a change in pull request #33689: URL: https://github.com/apache/spark/pull/33689#discussion_r685670238 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingSessionWindowSuite.scala ## @@ -75,21 +76,7 @@ class

[GitHub] [spark] HeartSaVioR commented on pull request #33689: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

HeartSaVioR commented on pull request #33689: URL: https://github.com/apache/spark/pull/33689#issuecomment-895705717 To respect the semantic of "update" properly, we need "retraction" to provide two different events, remove old session and insert updated session. This could be implemented

[GitHub] [spark] SparkQA commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

SparkQA commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895703918 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46755/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33684: [SPARK-36429][SQL] JacksonParser should throw exception when data type unsupported.

SparkQA commented on pull request #33684: URL: https://github.com/apache/spark/pull/33684#issuecomment-895703574 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46754/ -- This is an automated message from the

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

AngersZh commented on a change in pull request #33661: URL: https://github.com/apache/spark/pull/33661#discussion_r685665527 ## File path: sql/core/src/test/resources/sql-tests/inputs/interval.sql ## @@ -322,3 +322,47 @@ SELECT INTERVAL '153722867280' MINUTE; SELECT

[GitHub] [spark] HeartSaVioR opened a new pull request #33689: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

HeartSaVioR opened a new pull request #33689: URL: https://github.com/apache/spark/pull/33689 ### What changes were proposed in this pull request? This PR proposes to prohibit update mode in streaming aggregation with session window. UnsupportedOperationChecker will check and

[GitHub] [spark] venkata91 commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

venkata91 commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895701289 > **[Test build #142252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142252/testReport)** for PR 33615 at commit

[GitHub] [spark] SparkQA commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

SparkQA commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895695358 **[Test build #142252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142252/testReport)** for PR 33615 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

AmplabJenkins commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895695382 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142252/ -- This

[GitHub] [spark] SparkQA commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

SparkQA commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895694291 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46757/ -- This is an automated message from the Apache

[GitHub] [spark] LuciferYang commented on a change in pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

LuciferYang commented on a change in pull request #33629: URL: https://github.com/apache/spark/pull/33629#discussion_r685657733 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java ## @@ -145,7 +145,7 @@ public

[GitHub] [spark] LuciferYang commented on a change in pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

LuciferYang commented on a change in pull request #33629: URL: https://github.com/apache/spark/pull/33629#discussion_r685657521 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/checksum/ShuffleChecksumHelper.java ## @@ -81,7 +81,7 @@ public

[GitHub] [spark] SparkQA commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

SparkQA commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895693418 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46756/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

SparkQA commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895692789 **[Test build #142252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142252/testReport)** for PR 33615 at commit

[GitHub] [spark] SparkQA commented on pull request #33629: [SPARK-36407][CORE][SQL] Convert int to long to avoid potential integer multiplications overflow risk

SparkQA commented on pull request #33629: URL: https://github.com/apache/spark/pull/33629#issuecomment-895692670 **[Test build #142251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142251/testReport)** for PR 33629 at commit

[GitHub] [spark] venkata91 commented on pull request #33615: [SPARK-36374][SHUFFLE][DOC] Push-based shuffle high level user documentation

venkata91 commented on pull request #33615: URL: https://github.com/apache/spark/pull/33615#issuecomment-895691108 Updated the PR with the recent changes from the master and also addressed the other pending review comments. Gentle ping to take a look again cc @mridulm @gengliangwang

[GitHub] [spark] LuciferYang commented on pull request #33628: [SPARK-36406][CORE] Avoid unnecessary file operations before delete a write failed file held by DiskBlockObjectWriter

LuciferYang commented on pull request #33628: URL: https://github.com/apache/spark/pull/33628#issuecomment-895690575 cc @Ngone51 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

SparkQA commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895689759 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46755/ -- This is an automated message from the Apache

[GitHub] [spark] LuciferYang closed pull request #33556: [SPARK-36324][CORE] Replace revertPartialWritesAndClose with close in ExternalSorter.spill and ExternalAppendOnlyMap.spill

LuciferYang closed pull request #33556: URL: https://github.com/apache/spark/pull/33556 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] LuciferYang commented on pull request #33556: [SPARK-36324][CORE] Replace revertPartialWritesAndClose with close in ExternalSorter.spill and ExternalAppendOnlyMap.spill

LuciferYang commented on pull request #33556: URL: https://github.com/apache/spark/pull/33556#issuecomment-895689379 @mridulm @Ngone51 I'll close this pr first. Thank you for your review ~ -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #33684: [SPARK-36429][SQL] JacksonParser should throw exception when data type unsupported.

SparkQA commented on pull request #33684: URL: https://github.com/apache/spark/pull/33684#issuecomment-895688926 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46754/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

SparkQA removed a comment on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895673858 **[Test build #142248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142248/testReport)** for PR 33665 at commit

[GitHub] [spark] Ngone51 commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

Ngone51 commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-895680912 LGTM if tests pass. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] Ngone51 commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

Ngone51 commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-895680790 @Victsm Please resolve the conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] Shockang removed a comment on pull request #33674: [WIP][Spark-36328][CORE][SQL] Reuse the FileSystem delegation token while querying partitioned hive table.

Shockang removed a comment on pull request #33674: URL: https://github.com/apache/spark/pull/33674#issuecomment-894800937 cc @cloud-fan Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] LuciferYang commented on a change in pull request #33682: [WIP][SPARK-36456][CORE][SQL][STRUCTURED STREAMING] Clean up compilation warnings related to `method closeQuietly in class IO

LuciferYang commented on a change in pull request #33682: URL: https://github.com/apache/spark/pull/33682#discussion_r685642539 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2657,6 +2657,24 @@ private[spark] object Utils extends Logging { try

[GitHub] [spark] Ngone51 commented on a change in pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

Ngone51 commented on a change in pull request #33613: URL: https://github.com/apache/spark/pull/33613#discussion_r685642507 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -748,20 +780,26 @@ private void

[GitHub] [spark] SparkQA commented on pull request #33661: [SPARK-36431][SQL] Support TypeCoercion of ANSI intervals with different fields

SparkQA commented on pull request #33661: URL: https://github.com/apache/spark/pull/33661#issuecomment-895677622 **[Test build #142250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142250/testReport)** for PR 33661 at commit

[GitHub] [spark] SparkQA commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

SparkQA commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895677574 **[Test build #142249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142249/testReport)** for PR 33665 at commit

[GitHub] [spark] gengliangwang closed pull request #33688: [SPARK-36460][SHUFFLE] Pull out NoOpMergedShuffleFileManager inner class outside

gengliangwang closed pull request #33688: URL: https://github.com/apache/spark/pull/33688 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] gengliangwang commented on pull request #33688: [SPARK-36460][SHUFFLE] Pull out NoOpMergedShuffleFileManager inner class outside

gengliangwang commented on pull request #33688: URL: https://github.com/apache/spark/pull/33688#issuecomment-895677034 Thanks, merging to master/3.2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] beliefer removed a comment on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

beliefer removed a comment on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895672953 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] beliefer commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

beliefer commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895676759 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

SparkQA commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895675956 **[Test build #142248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142248/testReport)** for PR 33665 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

AmplabJenkins commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895675982 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142248/ -- This

[GitHub] [spark] SparkQA commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

SparkQA commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895673858 **[Test build #142248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142248/testReport)** for PR 33665 at commit

[GitHub] [spark] SparkQA commented on pull request #33684: [SPARK-36429][SQL] JacksonParser should throw exception when data type unsupported.

SparkQA commented on pull request #33684: URL: https://github.com/apache/spark/pull/33684#issuecomment-895673727 **[Test build #142247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142247/testReport)** for PR 33684 at commit

[GitHub] [spark] beliefer commented on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

beliefer commented on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895672953 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] beliefer removed a comment on pull request #33665: [SPARK-36428][SQL] the seconds parameter of make_timestamp should accept integer type

beliefer removed a comment on pull request #33665: URL: https://github.com/apache/spark/pull/33665#issuecomment-895033822 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] beliefer commented on pull request #33684: [SPARK-36429][SQL] JacksonParser should throw exception when data type unsupported.

beliefer commented on pull request #33684: URL: https://github.com/apache/spark/pull/33684#issuecomment-895672859 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

AmplabJenkins commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-895672103 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46753/ --

[GitHub] [spark] HyukjinKwon closed pull request #33604: [SPARK-36377][DOCS] Re-document "Options read in YARN client/cluster mode" section in spark-env.sh.template

HyukjinKwon closed pull request #33604: URL: https://github.com/apache/spark/pull/33604 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #33604: [SPARK-36377][DOCS] Re-document "Options read in YARN client/cluster mode" section in spark-env.sh.template

HyukjinKwon commented on pull request #33604: URL: https://github.com/apache/spark/pull/33604#issuecomment-895671897 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] Ngone51 commented on pull request #33561: [SPARK-36332][SHUFFLE] Cleanup RemoteBlockPushResolver log messages

Ngone51 commented on pull request #33561: URL: https://github.com/apache/spark/pull/33561#issuecomment-895668423 GA passed, merged to master/3.2, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [spark] Ngone51 closed pull request #33561: [SPARK-36332][SHUFFLE] Cleanup RemoteBlockPushResolver log messages

Ngone51 closed pull request #33561: URL: https://github.com/apache/spark/pull/33561 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

SparkQA commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-895664441 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46753/ -- This is an automated message from the

[GitHub] [spark] yutoacts commented on pull request #33604: [SPARK-36377][DOCS] Re-document "Options read in YARN client/cluster mode" section in spark-env.sh.template

yutoacts commented on pull request #33604: URL: https://github.com/apache/spark/pull/33604#issuecomment-895660234 @tgravescs Thanks. @HyukjinKwon Does it look good to you? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] HyukjinKwon closed pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

HyukjinKwon closed pull request #33646: URL: https://github.com/apache/spark/pull/33646 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HyukjinKwon commented on pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

HyukjinKwon commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-895654929 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins commented on pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

AmplabJenkins commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-895652387 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142246/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

SparkQA removed a comment on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-895633763 **[Test build #142246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142246/testReport)** for PR 33646 at commit

[GitHub] [spark] planga82 commented on a change in pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

planga82 commented on a change in pull request #33672: URL: https://github.com/apache/spark/pull/33672#discussion_r685615448 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala ## @@ -402,7 +402,11 @@ class DataFrameReader

[GitHub] [spark] SparkQA commented on pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

SparkQA commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-895647257 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46753/ -- This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33687: [SPARK-36370][PYTHON] _builtin_table directly imported from pandas instead of being redefined

HyukjinKwon commented on a change in pull request #33687: URL: https://github.com/apache/spark/pull/33687#discussion_r685610326 ## File path: python/pyspark/pandas/groupby.py ## @@ -44,10 +43,16 @@ TYPE_CHECKING, ) -import numpy as np import pandas as pd from

[GitHub] [spark] SparkQA commented on pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

SparkQA commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-895643177 **[Test build #142246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142246/testReport)** for PR 33646 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

HyukjinKwon commented on a change in pull request #33672: URL: https://github.com/apache/spark/pull/33672#discussion_r685609893 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala ## @@ -402,7 +402,11 @@ class DataFrameReader

[GitHub] [spark] github-actions[bot] closed pull request #32373: [SPARK-35248] Spark shall load system class first in IsolatedClientLoader

github-actions[bot] closed pull request #32373: URL: https://github.com/apache/spark/pull/32373 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #33646: [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3

SparkQA commented on pull request #33646: URL: https://github.com/apache/spark/pull/33646#issuecomment-895633763 **[Test build #142246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142246/testReport)** for PR 33646 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33068: [SPARK-36461][SQL] Enable ObjectHashAggregate for more Aggregate functions

AmplabJenkins commented on pull request #33068: URL: https://github.com/apache/spark/pull/33068#issuecomment-895632203 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46752/ --

[GitHub] [spark] SparkQA commented on pull request #33068: [SPARK-36461][SQL] Enable ObjectHashAggregate for more Aggregate functions

SparkQA commented on pull request #33068: URL: https://github.com/apache/spark/pull/33068#issuecomment-895632186 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46752/ --

  1   2   3   4   5   >