[Bug 57613] Distributed cron replacement

2014-09-01 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added Keywords|tracking| --- Comment

[Bug 57613] Distributed cron replacement

2014-09-01 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Yuvi Panda yuvipa...@gmail.com changed: What|Removed |Added Status|ASSIGNED|RESOLVED

[Bug 57613] Distributed cron replacement

2014-02-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 John Broughton johnbrough...@comcast.net changed: What|Removed |Added CC|

[Bug 57613] Distributed cron replacement

2014-02-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #28 from John Broughton johnbrough...@comcast.net --- (In reply to comment #21) https://www.mediawiki.org/wiki/Facebook_Open_Academy/Cron -- You are receiving this mail because: You are the assignee for the bug. You are on the CC

[Bug 57613] Distributed cron replacement

2014-02-10 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #29 from Tyler Romeo tylerro...@gmail.com --- (In reply to comment #27) Do any of the following provide a solution, or something that could be used as a base for a solution? * Chronos -

[Bug 57613] Distributed cron replacement

2014-01-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Tim Landscheidt t...@tim-landscheidt.de changed: What|Removed |Added CC|

[Bug 57613] Distributed cron replacement

2014-01-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #24 from Tyler Romeo tylerro...@gmail.com --- (In reply to comment #23) I'm with the NIH critics. cronie already provides crontabs on a cluster (- redundancy), and that can be used with SGE (or anything else) for load

[Bug 57613] Distributed cron replacement

2014-01-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #25 from Tim Landscheidt t...@tim-landscheidt.de --- (In reply to comment #24) [...] Could you possibly explain how cronie is used for cluster execution? Because I cannot find any documentation on it, nor do I see any evidence

[Bug 57613] Distributed cron replacement

2014-01-21 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #26 from Tyler Romeo tylerro...@gmail.com --- (In reply to comment #25) cronie - as used on the Toolserver for quite some time now - offers an option -c for its crond that enables cluster behaviour. With that, you can share

[Bug 57613] Distributed cron replacement

2014-01-15 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Pavel (pastakhov) pastak...@yandex.ru changed: What|Removed |Added CC|

[Bug 57613] Distributed cron replacement

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Tyler Romeo tylerro...@gmail.com changed: What|Removed |Added CC||tylerro...@gmail.com

[Bug 57613] Distributed cron replacement

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #20 from Tyler Romeo tylerro...@gmail.com --- Also my friend suggested using something like https://github.com/coreos/etcd to manage distributed state and then just having the cluster machines check that/ -- You are receiving this

[Bug 57613] Distributed cron replacement

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #21 from MZMcBride b...@mzmcbride.com --- (In reply to comment #17) This project has been picked up by the Facebook Open Academy. Is there a place (mailing list, wiki page, etc.) to follow the progress of this? -- You are

[Bug 57613] Distributed cron replacement

2013-12-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #18 from Seb35 seb35wikipe...@gmail.com --- This sounds me like the job of a scheduler. Aside the old Sun Grid Engine, I briefly used as a user OAR, which is used in research context for HPC applications (e.g. Grid'5000 is a

[Bug 57613] Distributed cron replacement

2013-12-25 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Marc A. Pelletier m...@uberbox.org changed: What|Removed |Added Status|NEW |ASSIGNED ---

[Bug 57613] Distributed cron replacement

2013-12-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #14 from Ryan Lane rlan...@gmail.com --- native c probably wouldn't be a sane language for this. Something high level would be good. It's unlikely that raw speed is a major need here. Anyway, I still think this is a problem that's

[Bug 57613] Distributed cron replacement

2013-12-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #15 from Antoine hashar Musso has...@free.fr --- Another feature that would be quite nice is the ability to define batch of tasks. At a previous job we used IBM Tivoli Workload Scheduler. I never used directly myself since I was

[Bug 57613] Distributed cron replacement

2013-12-04 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #16 from Quim Gil q...@wikimedia.org --- On whether this should be a project for Facebook Open Academy program or not: the project could be simply based on the definition of the problem to solve, which doesn't seem to be currently

[Bug 57613] Distributed cron replacement

2013-12-03 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Faidon Liambotis fai...@wikimedia.org changed: What|Removed |Added CC|

[Bug 57613] Distributed cron replacement

2013-12-03 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #11 from Marc A. Pelletier m...@uberbox.org --- I expect there is a I'm failing to express the concept properly. Let's try again. There is need for something that: * allows endusers to schedule things to run arbitrary snippets of

[Bug 57613] Distributed cron replacement

2013-12-03 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 MZMcBride b...@mzmcbride.com changed: What|Removed |Added CC||b...@mzmcbride.com ---

[Bug 57613] Distributed cron replacement

2013-12-03 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Peter Bena benap...@gmail.com changed: What|Removed |Added CC||benap...@gmail.com ---

[Bug 57613] Distributed cron replacement

2013-12-01 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 vladjohn2...@gmail.com changed: What|Removed |Added CC||vladjohn2...@gmail.com ---

[Bug 57613] Distributed cron replacement

2013-12-01 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #9 from Marc A. Pelletier m...@uberbox.org --- (In reply to comment #8) Should this project be still listed in that page? I'm not sure what the usual workflow is for projects of the sort. I'm certainly willing to mentor, and it's

[Bug 57613] Distributed cron replacement

2013-11-28 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #6 from Ryan Lane rlan...@gmail.com --- I don't understand why we need to write something from scratch for this, or why it needs to be fully decentralized. Decentralized things are *hard*, especially when building them from scratch.

[Bug 57613] Distributed cron replacement

2013-11-28 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #7 from Marc A. Pelletier m...@uberbox.org --- (In reply to comment #6) Is there really something wrong with gearman or jenkins? The fact that neither of them solves the stated problem set? (Well, I suppose Jenkins could be

[Bug 57613] Distributed cron replacement

2013-11-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #3 from Tyler Romeo tylerro...@gmail.com --- The specification for this needs a bit more. Some questions: * How distributed? GitHub is distributed, but at the same time centralized. Do we just want the task execution to be

[Bug 57613] Distributed cron replacement

2013-11-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #4 from Tyler Romeo tylerro...@gmail.com --- OK, here's my proposal: * A cluster of masters, with a maximum of 10 or so, which can double as workers * One or more masters can manage a cluster of workers. The collection of masters

[Bug 57613] Distributed cron replacement

2013-11-27 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #5 from Marc A. Pelletier m...@uberbox.org --- I think that's a sound approach; my own initial brain experiments were mostly centered about a network of peers (similar to your master-only scenario); but I agree that separating

[Bug 57613] Distributed cron replacement

2013-11-26 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 Ryan Lane rlan...@gmail.com changed: What|Removed |Added CC||rlan...@gmail.com ---

[Bug 57613] Distributed cron replacement

2013-11-26 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=57613 --- Comment #2 from Quim Gil q...@wikimedia.org --- Facebook Open Academy program [1] is interested in this project. We need to decide whether we commit to mentor it, and how many students with which skills are we looking for. Note that this