On 7/18/2023 4:12 PM, Hans Hagen wrote:
Hi,
In todays upload there is a follow up on a new feature that is already
present in the previous upload (but that was not yet advertised):
context --parallel test1.tex test2.tex test3.tex
context --parallel --pattern=test*.tex
context --parallellist myfile.cmd (filters context processing lines)
context --parallel test1.tex test2.tex test3.tex --terminal
The --parellel feature will run in parallel, By default upto 8 jobs
but you can specify less or more depending on your hardware but on my
machine this is reasonable.
See workflows-parrallel at the end for more info. That one also
mentions the new --forceinput flag which makes that when these
context foo-1.tex --mode=m-1 --forceinput=whatever.tex
context foo-3.tex --mode=m-3 --forceinput=whatever.tex
are run in parallel there is no clash in tuc/pdf. Of course not all
scenarios might work out well. Commandline arguments given are passed
on to the different jobs but it's good enough for the purpose I have
in mind.
fwiw: a single pass teststuite run (some 1950 files) goes down from
1350 to 700 seconds but another run with 1200 complex xml documents
goes 4 times faster. In the end this is way cheaper than updating a 5
year old dev machine (a new one would run about twice as fast which
would bring about the same gain).
Hans
ps. Because tex is a memory intense application it doesn't scale with
the number of cores unless one has the latest greatest fast memory as
well as generous cpu caches. There's only so much one can do in the
code base about it.
Nice. Some of my make files use concurrence (MAKEFLAGS += --jobs=5).
That seems to bring similar benefits. Is this different beyond the syntax?
--
Rik
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the
Wiki!
maillist : ntg-context@ntg.nl / https://www.ntg.nl/mailman/listinfo/ntg-context
webpage : https://www.pragma-ade.nl / http://context.aanhet.net
archive : https://bitbucket.org/phg/context-mirror/commits/
wiki : https://contextgarden.net
___________________________________________________________________________________
