[ https://issues.apache.org/jira/browse/GIRAPH-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Reisman updated GIRAPH-312: ------------------------------- Attachment: GIRAPH-312-6.patch Sorry the last rebase was the right patch, but the wrong name. This is merged with today's trunk successfully so I'm guessing its still fine as-is. Unless something has changed in bin/giraph script this should still be good to go. I know this sort of splits up the shell/environment var setup for the "hadoop jar" call in a new way, so someone might want to take a peek and see if this approach conflicts with anything thats happened more recently in the run scripts? If not I can rebase to just run the Zk cleanup without the giraph-env file etc. > Giraph needs an admin script > ---------------------------- > > Key: GIRAPH-312 > URL: https://issues.apache.org/jira/browse/GIRAPH-312 > Project: Giraph > Issue Type: New Feature > Components: conf and scripts, zookeeper > Affects Versions: 0.2.0 > Reporter: Eli Reisman > Assignee: Eli Reisman > Priority: Minor > Fix For: 0.2.0 > > Attachments: GIRAPH-312-1.patch, GIRAPH-312-2.patch, > GIRAPH-312-3.patch, GIRAPH-312-3.patch, GIRAPH-312-4.patch, > GIRAPH-312-5.patch, GIRAPH-312-6.patch, GIRAPH-326-6.patch > > > Our zookeeper instances have very long uptimes on our cluster, and failed job > trees are never cleaned from memory. There is a separate shell script to do > this, but its not picky about which node trees it erases, and on some systems > some Giraph users may not have access to it. > This patch will add a shell script to activate a new class which will use > Giraph conf file options or our normal -Dgiraph.XYZ command-line opts to get > the ZK quorum info, and clean out the remnants from its memory of old failed > and killed jobs. They do pile up over time. > This led to the larger idea that Giraph needs a general giraph-admin shell > script as a home for stuff like this. Jakob suggested it would be a good idea > to put this into such a script since then admin groups can be created so that > not every Giraph client can run it. This script currently only has code to > start up the zk cleaner, but can have more options added to it as JIRA's to > add features crop up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira