No, this is in MySQL, and unfortunately it is not just reading data from files and importing. Most of the transactions are updates of counters in the records from the database. I know that this is probably not the best way, but it is really just an experiment for a much larger project that would be ongoing, and would need to store all this data in the database anyway.
jonathan ----- Original Message ----- From: "Edmund Lian" <[EMAIL PROTECTED]> To: "jonathan" <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]> Sent: Wednesday, July 31, 2002 12:12 AM Subject: Re: [Webware-discuss] middleKit sql queries > > On 07/30/2002 09:26:40 AM webware-discuss-admin wrote: > > >3. In the experimental project that I am playing around with, it requires > >initially about 1.5m transactions on the database to set up the data. For > >some reason that I am not clear on the app starts to really slow down > about > >halfway into this, it looks like it is having trouble with the amount of > >memory it is using, because it really starts to flail away at the disk > >cache. I tried doing store.clear() to make sure that it wasn't storing to > >many objects locally, but that didn't help at all. I also thought it might > >be a problem with the number of connections that it was creating and > >discarding. > > Are you using PostgreSQL? If so, you need to disable autocommit when you > upload this much stuff at once. For bulk uploads, consider some other > import mechanism like "copy from stdin" instead of a sequence of insert > commands. > > ...Edmund. > ------------------------------------------------------- This sf.net email is sponsored by: Dice - The leading online job board for high-tech professionals. Search and apply for tech jobs today! http://seeker.dice.com/seeker.epl?rel_code=31 _______________________________________________ Webware-discuss mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/webware-discuss
