[ https://issues.apache.org/jira/browse/YARN-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16456808#comment-16456808 ]
Eric Yang commented on YARN-7799: --------------------------------- [~billie.rinaldi] The summary of our discussion: 1. We can check prefix directory of yarn.service.framework.path to ensure all sub-directories are world readable and executable to ensure other user can access this path. 2. If the calling user to -enableFastLaunch is one of yarn.admin.acl, and yarn.service.framework.path is pre-conigured. User is allowed to upload service-dep.tar.gz. 3. If the calling user is dfs.cluster.administrators, user is allowed to upload service-dep.tar.gz. 4. Auto-upload follows the same logic. > YARN Service dependency follow up work > -------------------------------------- > > Key: YARN-7799 > URL: https://issues.apache.org/jira/browse/YARN-7799 > Project: Hadoop YARN > Issue Type: Bug > Components: client, resourcemanager > Reporter: Gour Saha > Assignee: Billie Rinaldi > Priority: Critical > Attachments: YARN-7799.1.patch > > > As per [~jianhe] these are some followup items that make sense to do after > YARN-7766. Quoting Jian's comment below - > Currently, if user doesn't supply location when run yarn app > -enableFastLaunch, the jars will be put under this location > {code} > hdfs:///yarn-services/<versionId>/service-dep.tar.gz > {code} > Since API server is embedded in RM, should RM look for this location too if > "yarn.service.framework.path" is not specified ? > And if "yarn.service.framework.path" is not specified and still the file > doesn't exist at above default location, I think RM can try to upload the > jars to above default location instead, currently RM is uploading the jars to > the location defined by below code. This folder is per app and also > inconsistent with CLI location. > {code} > protected Path addJarResource(String serviceName, > Map<String, LocalResource> localResources) > throws IOException, SliderException { > Path libPath = fs.buildClusterDirPath(serviceName); > {code} > By doing this, the next time a submission request comes, RM doesn't need to > upload the jars again. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org