One option is to create a new table that is a mirror of the target table except the new table should NOT have any of the keys enabled. Using a bulk load tool add the data to the new table. Then add the keys to the new table. Drop the old table and rename the new table to the original target table name. This technique usually saves a bunch of time.
On Wed, Feb 25, 2009 at 1:00 PM, Sean <liushu2...@gmail.com> wrote: > > Hi, > > I am using django+MySql. > My job involves to write a huge number of products codes into the > MySql, code such as: ABCDEFGHI10, it is typically between 1 million up > to 50 million codes within 1 file, which need to be uploaded/ > downloaded into MySql. > > The problem for this is it takestoo much time to insert data into the > database, a typical 10 million code file will take 3 hours at least to > load/download into MySql, it is even took a night time to process a 50 > million code file, which is a nightmare. So I want to make it faster. > > I got a powerful Core2 workstation and Xeron Server, which are almost > the most powerful machin I can get in the market, so hardware is not a > issue. > > I guess the slow down is caused by I/O to hard-disk. > > Anyone have any suggestion how can I make this process faster, or > there is any other superfast database engine than MySql? > > Sean --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to django-users+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/django-users?hl=en -~----------~----~----~----~------~----~------~--~---
