[
https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426068#comment-16426068
]
Xuan Gong commented on YARN-1151:
---------------------------------
[~leftnoteasy]
bq. I'm not sure if I understand correct: assume we have multiple services,
does this logic remove all other service localized jars?
Oh, my fault. Fix the issue.
bq. And a minor comment is, it's better to have a separate to handle jar
download / remove outdated local folder logic.
It might be easier if we can handle them together. When we check whether we
need to re-download it or not, we will do:
* if the last modified time does not change, we would break the for loop
* if it was changed, we would first DEL the previous jar file, then
re-download the latest jar
> Ability to configure auxiliary services from HDFS-based JAR files
> -----------------------------------------------------------------
>
> Key: YARN-1151
> URL: https://issues.apache.org/jira/browse/YARN-1151
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Affects Versions: 2.1.0-beta, 2.9.0
> Reporter: john lilley
> Assignee: Xuan Gong
> Priority: Major
> Labels: auxiliary-service, yarn
> Attachments: YARN-1151.1.patch, YARN-1151.2.patch, YARN-1151.3.patch,
> YARN-1151.4.patch, YARN-1151.5.patch, YARN-1151.6.patch,
> YARN-1151.branch-2.poc.2.patch, YARN-1151.branch-2.poc.3.patch,
> YARN-1151.branch-2.poc.patch, [YARN-1151] [Design] Configure auxiliary
> services from HDFS-based JAR files.pdf
>
>
> I would like to install an auxiliary service in Hadoop YARN without actually
> installing files/services on every node in the system. Discussions on the
> user@ list indicate that this is not easily done. The reason we want an
> auxiliary service is that our application has some persistent-data components
> that are not appropriate for HDFS. In fact, they are somewhat analogous to
> the mapper output of MapReduce's shuffle, which is what led me to
> auxiliary-services in the first place. It would be much easier if we could
> just place our service's JARs in HDFS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
