(spark) branch master updated: [SPARK-47498][TESTS][CORE] Refine some GPU fraction calculation tests

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 96b301ce4e41 [SPARK-47498][TESTS][CORE] Refine

(spark) branch master updated: [SPARK-46721][CORE][TESTS] Make gpu fraction tests more robust

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 90e6c0cf2ca1 [SPARK-46721][CORE][TESTS] Make gpu

[spark] branch master updated: [SPARK-44126][CORE] Shuffle migration failure count should not increase when target executor decommissioned

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fc5342314c8d [SPARK-44126][CORE] Shuffle migration

[spark] branch master updated: [SPARK-40596][CORE] Populate ExecutorDecommission with messages in ExecutorDecommissionInfo

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4eb0edf5382 [SPARK-40596][CORE] Populate

[spark] branch master updated: [SPARK-39853][CORE] Support stage level task resource profile for standalone cluster when dynamic allocation disabled

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ab49dc21e43 [SPARK-39853][CORE] Support stage

[spark] branch master updated: [SPARK-39957][CORE] Delay onDisconnected to enable Driver receives ExecutorExitCode

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0e051ab7ba1 [SPARK-39957][CORE] Delay

[spark] branch master updated (68c7d836f46 -> 5cd5935e830)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 68c7d836f46 [MINOR][PYTHON][DOC] Fixed instructions for building python docs add 5cd5935e830 [SPARK-39062][CORE

[spark] branch master updated: [SPARK-32170][CORE] Improve the speculation through the stage task metrics

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6f1046afa40 [SPARK-32170][CORE] Improve

[spark] branch master updated: [SPARK-39152][CORE] Deregistering disk persisted local blocks in case of IO related errors

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 282c7ae7b5a [SPARK-39152][CORE] Deregistering disk

[spark] branch master updated: [SPARK-38683][SHUFFLE] It is unnecessary to release the ShuffleManagedBufferIterator or ShuffleChunkManagedBufferIterator or ManagedBufferIterator buffers when the clien

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dc995f2 [SPARK-38683][SHUFFLE] It is unnecessary

[spark] branch master updated (eab2331 -> fc877e9)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from eab2331 [SPARK-37850][PYTHON][INFRA] Enable flake's E731 rule in PySpark add fc877e9 [SPARK-37580][CORE] Reset

[spark] branch branch-3.0 updated: [SPARK-35714][FOLLOW-UP][CORE] WorkerWatcher should run System.exit in a thread out of RpcEnv

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new be441e8 [SPARK-35714][FOLLOW-UP][CORE

[spark] branch branch-3.1 updated: [SPARK-35714][FOLLOW-UP][CORE] WorkerWatcher should run System.exit in a thread out of RpcEnv

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 70d4fb1 [SPARK-35714][FOLLOW-UP][CORE

[spark] branch branch-3.2 updated: [SPARK-35714][FOLLOW-UP][CORE] WorkerWatcher should run System.exit in a thread out of RpcEnv

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 537de84 [SPARK-35714][FOLLOW-UP][CORE

[spark] branch master updated (3b88bc8 -> 639d6f4)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3b88bc8 [SPARK-37792][CORE] Fix the check of custom configuration in SparkShellLoggingFilter add 639d6f4 [SPARK

[spark] branch branch-3.2 updated: [SPARK-37695][CORE][SHUFFLE] Skip diagnosis ob merged blocks from push-based shuffle

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new d1cd110 [SPARK-37695][CORE][SHUFFLE] Skip

[spark] branch master updated: [SPARK-37695][CORE][SHUFFLE] Skip diagnosis ob merged blocks from push-based shuffle

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 57ca75f [SPARK-37695][CORE][SHUFFLE] Skip

[spark] branch master updated (6278c36 -> 7d88f1c)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6278c36 [MINOR][DOCS][PYTHON] Fix docstring of SeriesGroupBy.nsmallest add 7d88f1c [MINOR][UI] Fix Duration tips

[spark] branch branch-3.1 updated: [SPARK-37060][CORE][3.1] Handle driver status response from backup masters

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new e3d868b [SPARK-37060][CORE][3.1] Handle

[spark] branch branch-3.2 updated (6b2b6ea -> 22eb1eb)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git. from 6b2b6ea [SPARK-37656][BUILD] Upgrade SBT to 1.5.7 add 22eb1eb [SPARK-37060][CORE][3.2] Handle driver status

[spark] branch master updated (898cf76 -> 958c797)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 898cf76 [SPARK-37373] Collecting LocalSparkContext worker logs in case of test failure add 958c797 [SPARK-37060

[spark] branch master updated (5880df4 -> 7390eb0)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5880df4 [SPARK-37481][CORE][WEBUI] Fix disappearance of skipped stages after they retry add 7390eb0 [SPARK

[spark] branch branch-3.2 updated: [SPARK-37481][CORE][WEBUI] Fix disappearance of skipped stages after they retry

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new f20c408 [SPARK-37481][CORE][WEBUI] Fix

[spark] branch master updated (a30bec1 -> 5880df4)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a30bec1 [SPARK-37369][SQL] Avoid redundant ColumnarToRow transistion on InMemoryTableScan add 5880df4 [SPARK

[spark] branch master updated: Revert "[SPARK-36575][CORE] Should ignore task finished event if its task set is gone in TaskSchedulerImpl.handleSuccessfulTask"

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 16e2604 Revert "[SPARK-36575][CORE] Should i

[spark] branch master updated: [SPARK-36575][CORE] Should ignore task finished event if its task set is gone in TaskSchedulerImpl.handleSuccessfulTask

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bc80c84 [SPARK-36575][CORE] Should ignore task

svn commit: r49578 - in /dev/spark: v3.2.0-rc1-bin/ v3.2.0-rc1-docs/

Author: wuyi Date: Fri Aug 20 12:32:20 2021 New Revision: 49578 Log: remove failed 3.2.0 rc1 build Removed: dev/spark/v3.2.0-rc1-bin/ dev/spark/v3.2.0-rc1-docs/ - To unsubscribe, e-mail: commits-unsubscr

[spark] branch branch-3.0 updated (8862657 -> 0a31f1f)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git. from 8862657 [SPARK-34949][CORE][3.0] Prevent BlockManager reregister when Executor is shutting down add 0a31f1f

[spark] branch branch-3.2 updated: [SPARK-36332][SHUFFLE] Cleanup RemoteBlockPushResolver log messages

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 38dd42a [SPARK-36332][SHUFFLE] Cleanup

[spark] branch master updated: [SPARK-36332][SHUFFLE] Cleanup RemoteBlockPushResolver log messages

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ab89710 [SPARK-36332][SHUFFLE] Cleanup

[spark] branch branch-3.2 updated: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new b4c065b [SPARK-36391][SHUFFLE] When state

[spark] branch master updated: [SPARK-36391][SHUFFLE] When state is remove will throw NPE, and we should improve the error message

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b377ea2 [SPARK-36391][SHUFFLE] When state

[spark] branch branch-3.2 updated: [SPARK-35259][SHUFFLE] Update ExternalBlockHandler Timer variables to expose correct units

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 23e48db [SPARK-35259][SHUFFLE] Update

[spark] branch master updated (09e1c61 -> 70a1586)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 09e1c61 [SPARK-36255][SHUFFLE][CORE] Stop pushing and retrying on FileNotFound exceptions add 70a1586 [SPARK

[spark] branch branch-3.2 updated: [SPARK-36255][SHUFFLE][CORE] Stop pushing and retrying on FileNotFound exceptions

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 96944ac [SPARK-36255][SHUFFLE][CORE] Stop

[spark] branch master updated: [SPARK-36255][SHUFFLE][CORE] Stop pushing and retrying on FileNotFound exceptions

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 09e1c61 [SPARK-36255][SHUFFLE][CORE] Stop pushing

[spark] branch branch-3.2 updated: [SPARK-36242][CORE] Ensure spill file closed before set `success = true` in `ExternalSorter.spillMemoryIteratorToDisk` method

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new b46a9f3 [SPARK-36242][CORE] Ensure spill

[spark] branch master updated (3ff8c9f -> f61d599)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3ff8c9f [SPARK-34399][SQL] Add commit duration to SQL tab's graph node add f61d599 [SPARK-36242][CORE] Ensure

[spark] branch master updated (201566c -> f8a80c4)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 201566c [SPARK-36109][SS][TEST] Check data after adding data to topic in KafkaSourceStressSuite add f8a80c4

[spark] branch branch-3.0 updated (6a1361c -> 845e750)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git. from 6a1361c [SPARK-35935][SQL][3.1][3.0] Prevent failure of `MSCK REPAIR TABLE` on table refreshing add 845e750

[spark] branch branch-3.1 updated: [SPARK-35714][FOLLOW-UP][CORE] Use a shared stopping flag for WorkerWatcher to avoid the duplicate System.exit

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 9229eb9 [SPARK-35714][FOLLOW-UP][CORE

[spark] branch master updated (5d74ace -> 868a594)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5d74ace [SPARK-35065][SQL] Group exception messages in spark/sql (core) add 868a594 [SPARK-35714][FOLLOW-UP

svn commit: r48399 - in /dev/spark/v3.0.3-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/parqu

Author: wuyi Date: Thu Jun 17 05:48:23 2021 New Revision: 48399 Log: Apache Spark v3.0.3-rc1 docs [This commit notification would consist of 1932 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r48398 - /dev/spark/v3.0.3-rc1-bin/

Author: wuyi Date: Thu Jun 17 05:28:47 2021 New Revision: 48398 Log: Apache Spark v3.0.3-rc1 Added: dev/spark/v3.0.3-rc1-bin/ dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3.tar.gz (with props) dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3.tar.gz.asc dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3

svn commit: r48397 - in /dev/spark: v3.0.3-rc1-bin/ v3.0.3-rc1-docs/

Author: wuyi Date: Thu Jun 17 03:27:59 2021 New Revision: 48397 Log: delete v3.0.3 bin docs Removed: dev/spark/v3.0.3-rc1-bin/ dev/spark/v3.0.3-rc1-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org

svn commit: r48395 - in /dev/spark/v3.0.3-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/parqu

Author: wuyi Date: Wed Jun 16 19:51:47 2021 New Revision: 48395 Log: Apache Spark v3.0.3-rc1 docs [This commit notification would consist of 1932 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r48394 - /dev/spark/v3.0.3-rc1-bin/

Author: wuyi Date: Wed Jun 16 19:30:26 2021 New Revision: 48394 Log: Apache Spark v3.0.3-rc1 Added: dev/spark/v3.0.3-rc1-bin/ dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3.tar.gz (with props) dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3.tar.gz.asc dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3

svn commit: r48393 - /dev/spark/v3.0.3-rc1-bin/

Author: wuyi Date: Wed Jun 16 17:14:16 2021 New Revision: 48393 Log: remove v3.0.3-rc1-bin Removed: dev/spark/v3.0.3-rc1-bin/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail

svn commit: r48352 - /dev/spark/v3.0.3-rc1-bin/

Author: wuyi Date: Tue Jun 15 09:28:03 2021 New Revision: 48352 Log: Apache Spark v3.0.3-rc1 Added: dev/spark/v3.0.3-rc1-bin/ dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3.tar.gz (with props) dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3.tar.gz.asc dev/spark/v3.0.3-rc1-bin/SparkR_3.0.3

[spark] branch branch-3.0 updated (673654b -> f1711af)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git. from 673654b [SPARK-35714][CORE] Bug fix for deadlock during the executor shutdown add 65ac1e7 Preparing Spark

[spark] 01/01: Preparing development version 3.0.4-SNAPSHOT

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git commit f1711afda14ccf4e9a39d688f69ebf98a8fda14b Author: Wu Yi AuthorDate: Tue Jun 15 04:04:57 2021 + Preparing

[spark] tag v3.0.3-rc1 created (now 65ac1e7)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to tag v3.0.3-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git. at 65ac1e7 (commit) This tag includes the following new commits: new 65ac1e7 Preparing Spark release v3.0.3-rc1

[spark] 01/01: Preparing Spark release v3.0.3-rc1

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to tag v3.0.3-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git commit 65ac1e75dc468f53fc778cd2ce1ba3f21067aab8 Author: Wu Yi AuthorDate: Tue Jun 15 04:04:50 2021 + Preparing Spark

[spark] branch master updated (2550490 -> b9e53f8)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2550490 [SPARK-35617][INFRA] Update GitHub Action docker image to 20210602 add b9e53f8 [SPARK-35011][CORE

[spark] branch master updated (631077d -> 58d4da1)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 631077d [SPARK-35455][SQL] Unify empty relation optimization between normal and AQE optimizer add 58d4da1

[spark] branch master updated: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 74b9326 [SPARK-35135][CORE] Turn

[spark] branch master updated (2ff0032 -> f11950f)

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2ff0032 [SPARK-34796][SQL] Initialize counter variable for LIMIT code-gen in doProduce() add f11950f [SPARK

[spark-website] branch asf-site updated: Add Yi Wu to committers' list

This is an automated email from the ASF dual-hosted git repository. wuyi pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new a6a57a9 Add Yi Wu to committers' list