Arun Suresh created YARN-5501: --------------------------------- Summary: Container Pooling in YARN Key: YARN-5501 URL: https://issues.apache.org/jira/browse/YARN-5501 Project: Hadoop YARN Issue Type: Improvement Reporter: Arun Suresh
This JIRA proposes a method for reducing the container launch latency in YARN. It introduces a notion of pooling *Unattached Pre-Initialized Containers*. Proposal in brief: * Have a *Pre-Initialized Container Factory* service within the NM to create these unattached containers. * The NM would then advertise these containers as special resource types (this should be possible via YARN-3926). * When a start container request is received by the node manager for launching a container requesting this specific type of resource, it will take one of these unattached pre-initialized containers from the pool, and use it to service the container request. * Once the request is complete, the pre-initialized container would be released and ready to serve another request. This capability would help reduce container launch latencies and thereby allow for development of more interactive applications on YARN. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org