Re: processing large files

2005-10-28 Thread Grzegorz Tañczyk
Hello Éric, If this file is not very complex and You don't need XPath to be happy then You should to consider writing custom Transformer or Generator. SAXParser interface is easy to use. Friday, October 28, 2005, 5:30:50 PM, you wrote: BÉ> Hi all BÉ> I need to process large xml file and as

Re: processing large files

2005-10-28 Thread Geert Josten
keeps suggestions coming.. they are appreciated. XSLT transforms are the most obvious reason for the memory usage and speed behaviour you observe. It is really a matter of limiting the memory usage, that will influence the performance the most. Is it really necessary to use XSLT? Could STX be

RE: processing large files

2005-10-28 Thread Boisvert, Éric
lto:[EMAIL PROTECTED] Envoyé : 28 octobre, 2005 14:43 À : users@cocoon.apache.org Objet : Re: processing large files hi, have you seen Nico Verwer's presentation "Performance on big documents". You can download it as mp3/pdf on http://www.cocoongt.org/Slides-and-recordings.html They use

Re: processing large files

2005-10-28 Thread Christoph Gaffga (triplemind.com)
> > > -Message d'origine- > De : Ralph Goers [mailto:[EMAIL PROTECTED] > Envoyé : 28 octobre, 2005 13:55 > À : users@cocoon.apache.org > Objet : Re: processing large files > > > You may not have to rewrite your xslt. Part of the idea is to reduce the

RE: processing large files

2005-10-28 Thread Boisvert, Éric
Ralph Goers [mailto:[EMAIL PROTECTED] Envoyé : 28 octobre, 2005 13:55 À : users@cocoon.apache.org Objet : Re: processing large files You may not have to rewrite your xslt. Part of the idea is to reduce the size of the document by eliminating unnecessary stuff in a transformer before your XSL

Re: processing large files

2005-10-28 Thread Ralph Goers
starting rewriting the xslt (I know, I'm lazy) Eric -Message d'origine- De : Ralph Goers [mailto:[EMAIL PROTECTED] Envoyé : 28 octobre, 2005 11:51 À : users@cocoon.apache.org Objet : Re: processing large files Boisvert, Éric wrote: Hi all I need to process large xml fil

RE: processing large files

2005-10-28 Thread Boisvert, Éric
thanks, I saw that. I wondered if there was some obvious thing I could check before starting rewriting the xslt (I know, I'm lazy) Eric -Message d'origine- De : Ralph Goers [mailto:[EMAIL PROTECTED] Envoyé : 28 octobre, 2005 11:51 À : users@cocoon.apache.org Objet : Re:

Re: processing large files

2005-10-28 Thread Ralph Goers
Boisvert, Éric wrote: Hi all I need to process large xml file and as I tested with increasingly larger file, the time to process suddently increased a lot. For instance, 200 K files took 0.8 seconds, 400 K file 2.5 sec and when I get near 1 Meg, it jumps to 30 seconds (nearly 10 times, for twi

Re: processing large files

2005-10-28 Thread Ralph Goers
Boisvert, Éric wrote: Hi all I need to process large xml file and as I tested with increasingly larger file, the time to process suddently increased a lot. For instance, 200 K files took 0.8 seconds, 400 K file 2.5 sec and when I get near 1 Meg, it jumps to 30 seconds (nearly 10 times, for twi