> On Oct. 18, 2013, 6:30 p.m., Robert Kanter wrote: > >
Can you also update the documentation? - Robert ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14741/#review27197 ----------------------------------------------------------- On Oct. 18, 2013, 5:22 p.m., Purshotam Shah wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/14741/ > ----------------------------------------------------------- > > (Updated Oct. 18, 2013, 5:22 p.m.) > > > Review request for oozie. > > > Bugs: OOZIE-1584 > https://issues.apache.org/jira/browse/OOZIE-1584 > > > Repository: oozie > > > Description > ------- > > Supported features. > > 1. If Oozie.action.ship.launcher.jar = true then, Oozie auto-deploy jar at > server start. > > 2. Admin copies sharelib to new timestamp directory and issues invalidate > command to Oozie server. Oozie picks latest shared lib. > > 3. Oozie server doesn't auto deploy sharelib at startup. It picks the latest > sharelib jar pushed by admin(based on timestamp). > > > DFS after generating launcher jar by ooozie server and sharelib by cli > > makebag-lm:example purushah$ /var/hadoop-1.2.1/bin/hadoop fs -ls > /user/purushah/share/lib/ > /user/purushah/share/lib/launcher_20131017092254 > /user/purushah/share/lib/launcher_20131017093814 > /user/purushah/share/lib/launcher_20131017094652 > /user/purushah/share/lib/launcher_20131017094836 > /user/purushah/share/lib/launcher_20131017095549 > /user/purushah/share/lib/lib_20131017092806 > makebag-lm:example purushah$ > > > Purging. > ------------- > There are two set( launcher_ for launcher jars and Lib_ for shared lib) of > directory and purging happens for both at startup. > Anything older than ( defined in property) is purged. > We always keep 2 set of directory, purging happens if number of sharelib > directory > 2. > > > Multiple version. > ------------------- > To support multiple version, sharelib will be in below format. > > Sharelib will cache all versions and return list of dfs files for a particular > version. > > makebag-lm:example purushah$ /var/hadoop-1.2.1/bin/hadoop fs -ls > /user/purushah/share/lib/ > Found 15 items > /user/purushah/share/lib/launcher_20131017092254 > /user/purushah/share/lib/launcher_20131017093814 > /user/purushah/share/lib/launcher_20131017094652 > /user/purushah/share/lib/launcher_20131017094836 > /user/purushah/share/lib/launcher_20131017095549 > /user/purushah/share/lib/lib_20131017092806/pig/... > /user/purushah/share/lib/lib_20131017092806/pig_9/... > /user/purushah/share/lib/lib_20131017092806/pig_10/... > makebag-lm:example purushah$ > > > Diffs > ----- > > > http://svn.apache.org/repos/asf/oozie/trunk/core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java > 1532127 > > http://svn.apache.org/repos/asf/oozie/trunk/core/src/main/java/org/apache/oozie/service/ShareLibService.java > 1532127 > > http://svn.apache.org/repos/asf/oozie/trunk/core/src/test/java/org/apache/oozie/service/TestShareLibService.java > 1532127 > > http://svn.apache.org/repos/asf/oozie/trunk/tools/src/main/java/org/apache/oozie/tools/OozieSharelibCLI.java > 1532127 > > Diff: https://reviews.apache.org/r/14741/diff/ > > > Testing > ------- > > > Thanks, > > Purshotam Shah > >
