[docbook-apps] AW: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes
Hi, I found out that the autoindex ist very slow or contains high load. I tried to use the index.method kosek or kimber, but the kosek way didn't improve the speed and the kimber way didn't work with saxon 8.8.0.7. So ... is there a way to speed up the indexer? Best regards Markus -Ursprüngliche Nachricht- Von: Jirka Kosek [mailto:ji...@kosek.cz] Gesendet: Donnerstag, 16. Januar 2014 17:40 An: Sticker Markus EXT FRD EPOS Cc: docbook-apps@lists.oasis-open.org Betreff: Re: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes On 16.1.2014 17:32, markus.sticker.e...@zf.com wrote: > yes. I only do the FO, and also yes for the local copy of docbook 5 . > If removed some obsolate (for my case) Parts and now I'm using the > saxon 9.5 with multithreading and 3G heap so my process time is about > 3-5 minutes. Not good - just a little better. > If I look at the content there is nothing bad - only chapters, paras , etc. > Do you know a good xslt performance test tool, or parameters to reduce > the output (20mb). First, I would check that you are using recent DocBook XSL stylesheet distribution (1.78.1). Then you can run Saxon with -t switch which will show you how long resources are loaded and transformed. This can give you some insight. Multi-core processor will not help, unless you are using features from commercial version Saxon-EE (and those features are not used in DocBook stylesheets), transformation runs in a single thread. Jirka -- -- Jirka Kosek e-mail: ji...@kosek.cz http://xmlguru.cz -- Professional XML consulting and training services DocBook customization, custom XSLT/XSL-FO document processing -- OASIS DocBook TC member, W3C Invited Expert, ISO JTC1/SC34 rep. -- Bringing you XML Prague conferencehttp://xmlprague.cz --
Re: [docbook-apps] AW: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes
On 27.1.2014 16:03, markus.sticker.e...@zf.com wrote: > I found out that the autoindex ist very slow or contains high load. > I tried to use the index.method kosek or kimber, but the kosek way > didn't improve the speed and the kimber way didn't work with > saxon 8.8.0.7. Why you are not using Saxon 9.x? 8.x branch is quite old and there are many new optimizations in 9.x version. > So ... is there a way to speed up the indexer? I haven't done any extensive profiling on indexig code. It already uses xsl:key for many things, so it is quite unlikely that there is a possibility of some dramatic improvement. If you really need to improve performance you can hire me and I can reproduce your setup and do some analysis and come up with some workaround. Please contact me off-list if you are interested. Jirka -- -- Jirka Kosek e-mail: ji...@kosek.cz http://xmlguru.cz -- Professional XML consulting and training services DocBook customization, custom XSLT/XSL-FO document processing -- OASIS DocBook TC member, W3C Invited Expert, ISO JTC1/SC34 rep. -- Bringing you XML Prague conferencehttp://xmlprague.cz -- signature.asc Description: OpenPGP digital signature
AW: [docbook-apps] AW: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes
Hi Jirka, I tried to use the 9.5EE but there was the problem with the chunker "Don't know how to chunk with Saxonica" Saxon uses xsl:result-document. So I changed to Saxon 8 - also docbook (kimber index method) retruns with "use saxon 6 or 8" ... so that's the reason. Best regards Markus -Ursprüngliche Nachricht- Von: Jirka Kosek [mailto:ji...@kosek.cz] Gesendet: Montag, 27. Januar 2014 16:37 An: Sticker Markus EXT FRD EPOS Cc: docbook-apps@lists.oasis-open.org Betreff: Re: [docbook-apps] AW: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes On 27.1.2014 16:03, markus.sticker.e...@zf.com wrote: > I found out that the autoindex ist very slow or contains high load. > I tried to use the index.method kosek or kimber, but the kosek way > didn't improve the speed and the kimber way didn't work with saxon > 8.8.0.7. Why you are not using Saxon 9.x? 8.x branch is quite old and there are many new optimizations in 9.x version. > So ... is there a way to speed up the indexer? I haven't done any extensive profiling on indexig code. It already uses xsl:key for many things, so it is quite unlikely that there is a possibility of some dramatic improvement. If you really need to improve performance you can hire me and I can reproduce your setup and do some analysis and come up with some workaround. Please contact me off-list if you are interested. Jirka -- -- Jirka Kosek e-mail: ji...@kosek.cz http://xmlguru.cz -- Professional XML consulting and training services DocBook customization, custom XSLT/XSL-FO document processing -- OASIS DocBook TC member, W3C Invited Expert, ISO JTC1/SC34 rep. -- Bringing you XML Prague conferencehttp://xmlprague.cz --
Re: AW: [docbook-apps] AW: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes
On 27.1.2014 16:42, markus.sticker.e...@zf.com wrote: > I tried to use the 9.5EE but there was the problem with the chunker > "Don't know how to chunk with Saxonica" > Saxon uses xsl:result-document. I thought that you are producing FO output, not chunked HTML. There is patched version of chunker.xsl in archives of mailing which works with Saxon 9, but not with xsltproc, so it wasn't merged into the codebase. Jirka -- -- Jirka Kosek e-mail: ji...@kosek.cz http://xmlguru.cz -- Professional XML consulting and training services DocBook customization, custom XSLT/XSL-FO document processing -- OASIS DocBook TC member, W3C Invited Expert, ISO JTC1/SC34 rep. -- Bringing you XML Prague conferencehttp://xmlprague.cz -- signature.asc Description: OpenPGP digital signature
AW: AW: [docbook-apps] AW: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes
I have to do both (xhtml and pdf). Thank for your advice. Is that right: http://sourceforge.net/projects/docbook/files/docbook-xsl-saxon/1.00/docbook-xsl-saxon-1.00.zip/download ??? -Ursprüngliche Nachricht- Von: Jirka Kosek [mailto:ji...@kosek.cz] Gesendet: Montag, 27. Januar 2014 16:52 An: Sticker Markus EXT FRD EPOS Cc: docbook-apps@lists.oasis-open.org Betreff: Re: AW: [docbook-apps] AW: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes On 27.1.2014 16:42, markus.sticker.e...@zf.com wrote: > I tried to use the 9.5EE but there was the problem with the chunker > "Don't know how to chunk with Saxonica" > Saxon uses xsl:result-document. I thought that you are producing FO output, not chunked HTML. There is patched version of chunker.xsl in archives of mailing which works with Saxon 9, but not with xsltproc, so it wasn't merged into the codebase. Jirka -- -- Jirka Kosek e-mail: ji...@kosek.cz http://xmlguru.cz -- Professional XML consulting and training services DocBook customization, custom XSLT/XSL-FO document processing -- OASIS DocBook TC member, W3C Invited Expert, ISO JTC1/SC34 rep. -- Bringing you XML Prague conferencehttp://xmlprague.cz --
Re: AW: AW: [docbook-apps] AW: AW: [docbook] performance issue - 5MB Source lead to a processtime up to 20 minutes
On 27.1.2014 16:59, markus.sticker.e...@zf.com wrote: > I have to do both (xhtml and pdf). > Thank for your advice. > Is that right: > http://sourceforge.net/projects/docbook/files/docbook-xsl-saxon/1.00/docbook-xsl-saxon-1.00.zip/download > ??? No, I think it is this one: https://lists.oasis-open.org/archives/docbook-apps/201103/msg00123.html -- -- Jirka Kosek e-mail: ji...@kosek.cz http://xmlguru.cz -- Professional XML consulting and training services DocBook customization, custom XSLT/XSL-FO document processing -- OASIS DocBook TC member, W3C Invited Expert, ISO JTC1/SC34 rep. -- Bringing you XML Prague conferencehttp://xmlprague.cz -- signature.asc Description: OpenPGP digital signature
