[
https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi updated SPARK-37060:
-------------------------
Fix Version/s: 3.1.3
3.2.1
> Report driver status does not handle response from backup masters
> -----------------------------------------------------------------
>
> Key: SPARK-37060
> URL: https://issues.apache.org/jira/browse/SPARK-37060
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.1.0, 3.1.1, 3.1.2, 3.2.0
> Reporter: Mohamadreza Rostami
> Assignee: Mohamadreza Rostami
> Priority: Critical
> Fix For: 3.1.3, 3.2.1, 3.3.0
>
>
> After an improvement in SPARK-31486, contributor uses
> 'asyncSendToMasterAndForwardReply' method instead of
> 'activeMasterEndpoint.askSync' to get the status of driver. Since the
> driver's status is only available in active master and the
> 'asyncSendToMasterAndForwardReply' method iterate over all of the masters, we
> have to handle the response from the backup masters in the client, which the
> developer did not consider in the SPARK-31486 change. So drivers running in
> cluster mode and on a cluster with multi-master affected by this bug. I
> created the patch for this bug and will soon be sent the pull request.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
