There are some minor fixes in the latest HEAD with parallel that might improve your overall experiences. Nothing should change timing very much.
The -j option only speeds the write-phase of the build. I'm not *totally* sure about all of the particulars, but I've noticed the following: - The amount of speed up is more closely related to the number of files than the total length of the text. This more conjectural, but I expect that Sphinx will run builds with small numbers of files in parallel more effectively *if* the files are roughly the same size. - You'll see greater improvements if your document require less processing on the part of Sphinx: your sphinx extensions are still a singly-threaded bottleneck, any processing of input (includes, cross referencing, indexing, etc,) has to happen before multiprocessing. - If you're running singlhtml or latex/man/texinfo with a small number of outputs, the parallel builder won't help at all. I hope these conclusions will be pretty self evident. And please feel free to correct me if I'm wrong. Cheers, sam/tychoish On Wednesday, July 17 2013, 20:59:09, shirou wrote: >> I updated to 1.2b1 (from 1.1.3) and the build is 25% faster now, without the >> -j option! > > I'm happy to hear that. > >> But with -j N (i triead N=1-4) the build is not faster, in fact it is a >> little bit slower :). > > On my understanding, -j option makes parallel only writing files. Not > fit your environment at this time. > > Regards, > WAKAYAMA Shirou > > > 2013/7/17 Olaf <[email protected]>: >> I updated to 1.2b1 (from 1.1.3) and the build is 25% faster now, without the >> -j option! >> >> But with -j N (i triead N=1-4) the build is not faster, in fact it is a >> little bit slower :). >> >> >> On Wednesday, July 17, 2013 4:12:24 AM UTC+2, shirou wrote: >>> >>> Hi Olaf, >>> >>> How about using -j option to parallel build? >>> http://sphinx-doc.org/latest/invocation.html >>> >>> This option is added at version 1.2b1 and currently experimental. But >>> it may help. >>> >>> Thank you >>> WAKAYAMA Shirou >>> >>> >>> 2013/7/17 Olaf <[email protected]>: >>> > Hi, >>> > >>> > We have documentation for hardware modules that is written in rst and >>> > translated to HTML with sphinx. >>> > >>> > We are translating about ~300000 lines of rst. Which is not small but >>> > also >>> > not absolutely huge: >>> > olaf@pc:~/ee/doc$ find . -name '*.rst' | xargs wc -l >>> > [...] >>> > 335911 total >>> > >>> > You can take a look at the documentation here: >>> > http://www.tinkerforge.com/en/doc/index.html >>> > >>> > The building process takes about 10 minutes if i don't change anything >>> > after >>> > the last build (i.e. everything that can be cached should be cached): >>> > olaf@pc:~/ee/doc$ time make html >>> > [...] >>> > real 10m27.748s >>> > user 9m30.036s >>> > sys 0m6.932s >>> > >>> > We will be adding lots of new hardware modules soon, which will double >>> > the >>> > amount of documentation... >>> > >>> > Adding stuff to the documentation has become really painful since it >>> > takes >>> > so long before one can review it. So the question is: How can we speed >>> > this >>> > up? >>> > >>> > For us it would also be helpfull if we were able to only build a part of >>> > the >>> > documentation. Is that somehow possible? >>> > >>> > Thanks! >>> > Olaf >>> > >>> > -- >>> > You received this message because you are subscribed to the Google >>> > Groups >>> > "sphinx-users" group. >>> > To unsubscribe from this group and stop receiving emails from it, send >>> > an >>> > email to [email protected]. >>> > To post to this group, send email to [email protected]. >>> > Visit this group at http://groups.google.com/group/sphinx-users. >>> > For more options, visit https://groups.google.com/groups/opt_out. >>> > >>> > -- Sam Kleinman (tychoish): - [email protected] - tychoish <http://tychoish.com/> "don't get it right, get it written" -- james thurber -- You received this message because you are subscribed to the Google Groups "sphinx-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/sphinx-users. For more options, visit https://groups.google.com/groups/opt_out.
