WE've used this approach as well... seems like a kludge but it actually works really really well. MS Text driver and DTS (or SSIS) are exceptionally fast for importing textual data. We have a process that consumes 350,000 rows of data in about 5-8 seconds... and does it every 2 minutes.
-Mark -----Original Message----- From: Marco Antonio C. Santos [mailto:marcoacsan...@gmail.com] Sent: Thursday, February 17, 2011 9:54 AM To: cf-talk Subject: Re: Big XML files processing Really s-l-o-w. Solution? In our company I found a solution to parse big XML files in ColdFusion applications: 1) using xml2csv(http://www.a7soft.com/xml2csv.html), a very fast application to convert XML to csv file; 2) with SQL Server BULK INSERT to insert in our database Using this approach reduced time in 100 times. Very fast. Cheers Marco Antonio On Thu, Feb 17, 2011 at 1:30 PM, Rick Faircloth <r...@whitestonemedia.com>wrote: > > No problem... I haven't done much with XML, myself, so I thought > this presented a good opportunity to learn something new, too. > > Let us know how the solution you're working on pans out. > > > > -----Original Message----- > From: Matt Robertson [mailto:websitema...@gmail.com] > Sent: Thursday, February 17, 2011 9:42 AM > To: cf-talk > Subject: Re: Big XML files processing Really s-l-o-w. Solution? > > > On Wed, Feb 16, 2011 at 8:08 PM, Rick Faircloth wrote: > > Perhaps this will be of some help. > > Thanks Rick, Interesting stuff. I don't work with xml so much so a > lot of this is new, and I hate new :-). I haven't been a full-time > programmer for a few years now so I haven't kept up with everything > like I would have otherwise. > > I have a business trip today so I have to set this aside but I'm going > to run Jochem's solution - which is presented darn near turnkey - as > soon as I can tomorrow and see what happens. > > -- > --m@Robertson-- > Janitor, The Robertson Team > mysecretbase.com > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:342383 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
