I did this a number of years ago. The MLS listing were in a 20-50(?) meg XML file. I was using CF 5 or maybe 6. I am pretty sure it was cf 5.
I got a script to work using a small portion of the file and then ran the whole thing and it hung for about 1/2 hr, sucked up 700 megs of ram (on a box with 512) the box keeled over and died. It probably had a lot to do with poor coding as well. I wrote a similar script in PHP but that took a solid 10 min to run and rendered the box pretty much useless for all other calls. Not acceptable either. I ended up writing an Active X script used by MSSQL server's Data Transformation services (DTS). That ended up taking a couple of seconds to run. It was literally a little blip on task manager. I was talking about parsing big text files with my boss the other day and he said that he had the same problem (same time frame) and ended up writing a DLL to do the same thing. Seeing the number of blog posts on using Java to parse text files I am guessing CF still has performance issues with parsing text. You could use Java read the file and do the inserts/updates. Or run a Google search on parsing XML with ActiveX and SQL server. I found the original ActiveX tutorial on Experts exchange http://www.experts-exchange.com/ Jerry Guido Programmer MGT of America, Inc. [EMAIL PROTECTED] The information contained in this electronic communication is intended only for the use of the addressee, and may be a confidential communication. If you are not the intended recipient, you are hereby notified that you have received this transmittal in error; any review, dissemination, distribution or copying of this transmittal is strictly prohibited. -----Original Message----- From: Rick Faircloth [mailto:[EMAIL PROTECTED] Sent: Thursday, January 17, 2008 10:27 AM To: CF-Talk Subject: Tags useful to accomplish automating MLS direct feed into MySQL DB? Hi, all. I assume some of you work on Real Estate sites where you have to deal with a direct feed of data from MLS's. The direct feed for one of my Real Estate sites currently in development will be in the form of an FTP site, from which I can download a zip file with all files, including a tab delimited data file for properties and photos whose name will include broker's MLS numbers so they can be matched to properties. I will then import the tab delimited info and property filenames into an MySQL database, and place the property photos into the appropriate local server directory. This is something I've never attempted before and I'd like to know, first, if it's possible to automate this process so I don't have to update everything manually each day. If it is possible to automate the process, what tags should I look to employ to carry this out. Not asking for any code (yet! :o), but just a bullet-point overview of the process. Then I can go and do some research on how to put it together. But I thought I'd just pick some experienced brains concerning the basic procedure. Remember, I'm still thinking, for the most part in CF 4.5 terms, and there will be a ton of tags and functionality I'm not even familiar with. such as, I've never written or used a CFC! :| Thanks for any feedback on tags and, especially tutorial or blogs on the subject. Rick ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:296758 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
