[ 
https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhijie Shen updated YARN-549:
-----------------------------

    Attachment: YARN-549.2.patch

In the newest patch:

1. Do throw the exception in YarnClientImpl. IMHO, the exception should be 
thrown here in case interruption disturbs the application submission.

2. RM_CLIENT_STATE_POLL_INTERVAL has be renamed as 
YARN_CLIENT_APP_SUBMISSION_POLL_INTERVAL.

3. Throwing exceptions is refactored in RMAppManager#submitApplication. And log 
level (warn) is unified when exception is logged.

4. Refactor TestAppManager to move some duplicate init code to setup().

5. Re-visit the validation code in RMAppManager#submitApplication and 
ClientRMService#submitApplication. Some validations depend on the RM's 
configuration (dynamic), such that they need to be done whether during new 
submission or recovery. These validations need to be put in 
RMAppManager#submitApplication. The others are independent of the RM's 
configuration (static), such that the are only need to be done once during 
newly submission. These validations are put in 
ClientRMService#submitApplication.

6. After rebalance the validation code among RMAppManager#submitApplication and 
ClientRMService#submitApplication. The corresponding test code in 
TestAppManager and TestClientRMService are reorganized as well.


                
> Asynchronous application submission
> -----------------------------------
>
>                 Key: YARN-549
>                 URL: https://issues.apache.org/jira/browse/YARN-549
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>         Attachments: Proposal of Asynchronous Application Submission_v1.pdf, 
> YARN-549.1.patch, YARN-549.2.patch
>
>
> Currently, when submitting an application, storeApplication will be called 
> for recovery. However, it is a blocking API, and is likely to block 
> concurrent application submissions. Therefore, it is good to make application 
> submission asynchronous, and postpone storeApplication.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to