I hit duplicate hashes for unique records, not sure why, I think I used aes_encrypt, how do you recomend creating a hash column via sql?Split the myisam table into seperate tables. We will call each table a bucket.
Create a MERGE table of all of them. For selecting the data.
When inserting, use a hash function on your primary
key values to determine which bucket to insert into. If you almost always select by primary key, then you
can optimize your select queries to only look at the
correct bucket as well, and to only use the merge
table when you aren't selecting by primary key.
This will speed your inserts because instead of 258M
rows to search through for each insert there are only
8M if you use 32 buckets. The biggest benefit is that
you could also insert in parallel using multiple mysql
connections, because you could calculate the bucket as
an additional column in your temporary table, then do
the inserts for all the buckets the same time.
I already split the data into separate tables, and use a merge, it really didnt speed things up that much
-- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED]
