I agree with Warren. Make sure your PC is not using swap files. I do processing on huge amounts of data (1,000,000s of files and >40GB of data). My PC had only 512MB and was heavily swapping memory to the hard disk. I have optimised my algorithms to use less than 1GB and have upgraded to 1GB of RAM. This increased processing ten-fold.
-----Original Message----- From: Warren Vick, Europa Technologies Ltd. [mailto:[EMAIL PROTECTED] Sent: 20 December 2004 13:53 To: 'Data Directions'; 'MapInfo List' Subject: RE: MI-L : Speed processing issues Hello Bill, I do processing that takes days even on a high performance machine so I know how you feel. Your processing time will be influenced by a number of factors. Let's put the software ones aside for now as you were asking about hardware. 512Mb is a "little light" these days but it depends on what your process does. Do a Ctrl-Alt-Del and select Task Manager > Performance. You can see here what your system is consuming memory wise. As long as you have physical memory available and do not dip into the virtual pool, then your current memory is fine. Your processing will help quite a bit if there is some number crunching going on but I would suggest that you're fine with 2.4GHz. Unless you are running other things too, you probably would not notice much difference with additional processors either. My favourite area for update is disks and I'm a huge fan of SCSI drives. They are so much faster than EIDE and will help cut through your data very quickly. I have no experience with SATA but am told they're very good too. The cheapest option is to look at your code, over and over again. There is nearly always a potential change in there which looks so small, but over the processing iterations can chip hours out of run times. It's a shame that MB never had an execution profiler to help with such things. Regards, Warren Vick Europa Technologies Ltd. http://www.europa-tech.com -----Original Message----- From: Data Directions [mailto:[EMAIL PROTECTED] Sent: 20 December 2004 13:37 To: MapInfo List Subject: MI-L : Speed processing issues I am doing erase, combine and disaggregate operations on 1.3 Gb files, and needless to say, the processing times are ridiculous ... hours and hours .. ad infinitum! I have implemented the idea of using the MapBasic window and choosing to bypass transaction files by the process: set table YourTableName fastedit on undo off Aside from the impractical option of purchasing a Sun Sparc station, would it help if I was to increase my RAM or even processor speed? I am currently running on a 2.4 GHz Pentium 4 with 512 Mb RAM. Or should I maybe consider doing these operations in another product that imports MID/MIF files? Thanks again, Bill --------------------------------------------------------------------- List hosting provided by Directions Magazine | www.directionsmag.com | To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] Message number: 14638 --------------------------------------------------------------------- List hosting provided by Directions Magazine | www.directionsmag.com | To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] Message number: 14640 ______________________________________________________________________ This email has been scanned by the MessageLabs Email Security System. For more information please visit http://www.messagelabs.com/email ______________________________________________________________________ --------------------------------------------------------------------- List hosting provided by Directions Magazine | www.directionsmag.com | To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] Message number: 14642
