[
https://issues.apache.org/jira/browse/SPARK-56412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Tenedorio reassigned SPARK-56412:
----------------------------------------
Assignee: Haiyang Sun
> Implement WorkerDispatcher for direct worker that are spawned as local
> processes.
> ---------------------------------------------------------------------------------
>
> Key: SPARK-56412
> URL: https://issues.apache.org/jira/browse/SPARK-56412
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core, SQL
> Affects Versions: 4.2.0
> Reporter: Haiyang Sun
> Assignee: Haiyang Sun
> Priority: Major
> Labels: pull-request-available
>
> As defined in the SPIP, a simple / direct worker can just be provisioned as a
> local process with a starting callable. And then we can manage the lifecycle
> of worker using SIGTERM/SIGKILL.
>
> This ticket tracks the progress to introduce a basic dispatcher
> implementation that reads the worker specification, run the env setup /
> verification script, and then start the worker starting callable.
>
> This PR doesn't care about the protocol running on the worker, but rather
> mostly focus on the spawning and management part.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
