[
https://issues.apache.org/jira/browse/SPARK-56589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-56589:
-----------------------------------
Labels: pull-request-available (was: )
> Use Virtual Threads for BlockManagerMasterEndpoint ask thread pool
> ------------------------------------------------------------------
>
> Key: SPARK-56589
> URL: https://issues.apache.org/jira/browse/SPARK-56589
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 4.2.0
> Reporter: Noritaka Sekiyama
> Priority: Major
> Labels: pull-request-available
>
> Follow-up of SPARK-49807 (Incorporate Java Virtual Threads), applying the
> opt-in pattern from SPARK-50383 (RestSubmissionServer) and SPARK-56297
> (reconciliation thread pool) to BlockManagerMasterEndpoint's ask thread pool.
> The existing pool is capped at 100 platform threads, serialising
> Future.sequence fan-outs on clusters with many executors.
> Details, benchmark numbers, and rationale for the default-off choice are in
> the PR.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
