[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16325464#comment-16325464 ]
Chris Douglas commented on YARN-7712: ------------------------------------- bq. I need to use webhdfs to get the timestamp and set for each localized file every time I launch something. This is cumbersome and not necessary in case of my app Perhaps, but YARN doesn't have anything else for correctness. If you're convinced this is necessary, please ensure that the NM verifies that the timestamp for a cached dependency matches the remote, before it returns it to the client (so if it's changed, the app gets the new version, never the cached version). To be consistent, you may also want to add similar semantics for size. > Add ability to ignore timestamps in localized files > --------------------------------------------------- > > Key: YARN-7712 > URL: https://issues.apache.org/jira/browse/YARN-7712 > Project: Hadoop YARN > Issue Type: Improvement > Components: nodemanager > Reporter: Miklos Szegedi > Assignee: Miklos Szegedi > > YARN currently requires and checks the timestamp of localized files and > fails, if the file on HDFS does not match to the one requested. This jira > adds the ability to ignore the timestamp based on the request of the client. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org