[
https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14617709#comment-14617709
]
Subru Krishnan commented on YARN-2915:
--------------------------------------
[~grey] Thanks for taking a look at our design proposal and your pertinent
question. Adding to [~curino]'s answer while we are planning to evaluate
cross-DC workloads as the architecture is generic for the control flow (job
scheduling) as you rightly observed, the data movement across DCs itself may
prove prohibitive. So our fallback plan is to have a StateStore per DC and have
jobs restricted to within a DC and have a simple rules based global router that
redirects user request to the target DC.
> Enable YARN RM scale out via federation using multiple RM's
> -----------------------------------------------------------
>
> Key: YARN-2915
> URL: https://issues.apache.org/jira/browse/YARN-2915
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: nodemanager, resourcemanager
> Reporter: Sriram Rao
> Assignee: Subru Krishnan
> Attachments: FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf,
> Yarn_federation_design_v1.pdf
>
>
> This is an umbrella JIRA that proposes to scale out YARN to support large
> clusters comprising of tens of thousands of nodes. That is, rather than
> limiting a YARN managed cluster to about 4k in size, the proposal is to
> enable the YARN managed cluster to be elastically scalable.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
