[
https://issues.apache.org/jira/browse/YARN-10493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308167#comment-17308167
]
Eric Badger commented on YARN-10493:
------------------------------------
{noformat}
2021-03-24 20:21:56,225 WARN [Public Localizer]
localizer.LocalResourcesTrackerImpl
(LocalResourcesTrackerImpl.java:handle(184)) - Received LOCALIZATION_FAILED
event for request {
/runc-root/layer/f6/f64d0ed7e0de1a2c56f69eaae5cfe8351b23cc2d600cc226557881862a5bdf5f.sqsh,
1616544364679, FILE, null } but localized resource is missing
2021-03-24 20:21:56,226 ERROR [Public Localizer]
localizer.ResourceLocalizationService
(ResourceLocalizationService.java:run(1004)) - Failed to download resource { {
/runc-root/layer/f6/f64d0ed7e0de1a2c56f69eaae5cfe8351b23cc2d600cc226557881862a5bdf5f.sqsh,
1616544364679, FILE, null },pending,[],50806868248172187,DOWNLOADING}
java.io.IOException: Resource
/runc-root/layer/f6/f64d0ed7e0de1a2c56f69eaae5cfe8351b23cc2d600cc226557881862a5bdf5f.sqsh
is not publicly accessible and as such cannot be part of the public cache.
2021-03-24 20:21:56,227 WARN [Public Localizer]
localizer.LocalResourcesTrackerImpl
(LocalResourcesTrackerImpl.java:handle(184)) - Received LOCALIZATION_FAILED
event for request {
/runc-root/layer/d5/d5eed6e7343938620cc22b9b2db0d6a77e8de76ed1387e7b7288d034fd86a92d.sqsh,
1616544363068, FILE, null } but localized resource is missing
2021-03-24 20:21:56,227 ERROR [Public Localizer]
localizer.ResourceLocalizationService
(ResourceLocalizationService.java:run(1004)) - Failed to download resource { {
/runc-root/layer/d5/d5eed6e7343938620cc22b9b2db0d6a77e8de76ed1387e7b7288d034fd86a92d.sqsh,
1616544363068, FILE, null },pending,[],50806868248209381,DOWNLOADING}
java.io.IOException: Resource
/runc-root/layer/d5/d5eed6e7343938620cc22b9b2db0d6a77e8de76ed1387e7b7288d034fd86a92d.sqsh
is not publicly accessible and as such cannot be part of the public cache.
2021-03-24 20:21:56,227 WARN [Public Localizer]
localizer.LocalResourcesTrackerImpl
(LocalResourcesTrackerImpl.java:handle(184)) - Received LOCALIZATION_FAILED
event for request {
/runc-root/layer/30/30e0953848a62b1477a41e6c09d2f781ace3e6cfb215f01be9dacabdd9480d90.sqsh,
1616544367971, FILE, null } but localized resource is missing
2021-03-24 20:21:56,227 ERROR [Public Localizer]
localizer.ResourceLocalizationService
(ResourceLocalizationService.java:run(1004)) - Failed to download resource { {
/runc-root/layer/30/30e0953848a62b1477a41e6c09d2f781ace3e6cfb215f01be9dacabdd9480d90.sqsh,
1616544367971, FILE, null },pending,[],50806868248366695,DOWNLOADING}
java.io.IOException: Resource
/runc-root/layer/30/30e0953848a62b1477a41e6c09d2f781ace3e6cfb215f01be9dacabdd9480d90.sqsh
is not publicly accessible and as such cannot be part of the public cache.
2021-03-24 20:21:56,228 WARN [Public Localizer]
localizer.LocalResourcesTrackerImpl
(LocalResourcesTrackerImpl.java:handle(184)) - Received LOCALIZATION_FAILED
event for request {
/runc-root/layer/71/71a0a977369767160e5ed5f8ab279558240eb19efa880725049c4651411c2225.sqsh,
1616544367125, FILE, null } but localized resource is missing
2021-03-24 20:21:56,228 ERROR [Public Localizer]
localizer.ResourceLocalizationService
(ResourceLocalizationService.java:run(1004)) - Failed to download resource { {
/runc-root/layer/71/71a0a977369767160e5ed5f8ab279558240eb19efa880725049c4651411c2225.sqsh,
1616544367125, FILE, null },pending,[],50806868248376369,DOWNLOADING}
java.io.IOException: Resource
/runc-root/layer/71/71a0a977369767160e5ed5f8ab279558240eb19efa880725049c4651411c2225.sqsh
is not publicly accessible and as such cannot be part of the public cache.
2021-03-24 20:21:56,228 WARN [Public Localizer]
localizer.LocalResourcesTrackerImpl
(LocalResourcesTrackerImpl.java:handle(184)) - Received LOCALIZATION_FAILED
event for request {
/runc-root/config/a9/a9a241e617577cf0da93c89010d0026de8327c8220c732f2ede29d2ce15588cf,
1616544368404, FILE, null } but localized resource is missing
{noformat}
Building and running with an image under the default "library" namespace, I run
into these permission errors. The errors are pretty clear, but is this
something that you run into in your production environments? Is there a setup
step that is necessary before or after running the CLI tool to fix the perms on
the files?
> RunC container repository v2
> ----------------------------
>
> Key: YARN-10493
> URL: https://issues.apache.org/jira/browse/YARN-10493
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: nodemanager, yarn
> Affects Versions: 3.3.0
> Reporter: Craig Condit
> Assignee: Matthew Sharp
> Priority: Major
> Labels: pull-request-available
> Attachments: runc-container-repository-v2-design.pdf
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> The current runc container repository design has scalability and usability
> issues which will likely limit widespread adoption. We should address this
> with a new, V2 layout.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
