[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15389065#comment-15389065 ]
Varun Vasudev commented on YARN-3854: ------------------------------------- Agree with the docker pull approach. Couple of things to keep in mind - as [~shaneku...@gmail.com] mentioned above, docker pulls can become extremely slow - we should have probably have some support for timing out pulls and failing the container. On the flip side, we should also clean up unused images to manage disk space. We could fall back on the existing YARN application resource scopes - public, application, container - to help figure out when to clean up the images. This would also seem to go with [~templedf]'s suggestion of making the pull part of the localization. > Add localization support for docker images > ------------------------------------------ > > Key: YARN-3854 > URL: https://issues.apache.org/jira/browse/YARN-3854 > Project: Hadoop YARN > Issue Type: Sub-task > Components: yarn > Reporter: Sidharta Seethana > Assignee: Zhankun Tang > Attachments: YARN-3854-branch-2.8.001.patch, > YARN-3854_Localization_support_for_Docker_image_v1.pdf, > YARN-3854_Localization_support_for_Docker_image_v2.pdf > > > We need the ability to localize images from HDFS and load them for use when > launching docker containers. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org