https://bugzilla.wikimedia.org/show_bug.cgi?id=46770

       Web browser: ---
            Bug ID: 46770
           Summary: Rewrite jobs-loop.sh in a proper programming language
           Product: Wikimedia
           Version: unspecified
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: Unprioritized
         Component: General/Unknown
          Assignee: ro...@wikimedia.org
          Reporter: tstarl...@wikimedia.org
    Classification: Unclassified
   Mobile Platform: ---

In terms of complexity, jobs-loop.sh has become complex enough that its shell
script implementation is awkward. Porting it to a proper language like PHP
would increase the number of people who could meaningfully contribute to it.

The following features would be desirable:

* The ability to wrap runJobs.php in a per-section PoolCounter pool. It has
recently become apparent (Ie5bb11b0) that if the CPU power available to the job
runners is going to be efficiently utilised, then the number of job runners
running on any given DB master needs to be limited. 

* A configuration file. Currently Puppet configures jobs-loop.sh in two
different ways simultaneously: by changing the command line parameters via
JR_EXTRA_ARGS in mw-job-runner.default, and by altering the code itself by
making the shell script be a template. I don't think either is an especially
elegant configuration method.

* The ability to check for the exit status from runJobs.php, somehow avoiding a
tight loop of respawns. 

* An error log might be nice too.

-- 
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to