2008/10/14 John Huttley <[EMAIL PROTECTED]>: > So the modified version is actually a bit faster? >
Well, yes. > Thats odd. So that MySQL slow with fields of type BLOB, imho. In an alternative scheme appear new fields : size, ctime, mtime. I therefore reduced length the value that is inserted into the field LStat. char *lstat = "MI s9MB IG0 B H2 H0 A 9t BAA I"; instead of char *lstat = "MI s9MB IG0 B H2 H0 A 9t BAA I BIVsDs BIR93m BIVqaC A A E"; > > are you running 64Bit? Yes. > Whats your Ram? 8Gb, but MySQL does not use the entire memory. The server is used only for this test. > Version of Mysql? mysql Ver 14.12 Distrib 5.0.45, for redhat-linux-gnu (x86_64) using readline 5.0 /etc/my.cnf taken from /usr/share/doc/mysql-server-5.0.45/my-huge.cnf > > > I'll run it on my system also. > > Regards, > > john > > > Yuri Timofeev wrote: > > Hi > > 2008/10/7 John Huttley <[EMAIL PROTECTED]>: > > > Hi > My first test are complete. > To aid in getting all the questions/answers and results in one place, I've > made a wiki entry. > > http://wiki.bacula.org/doku.php?id=wiki:playground > > > > My first test are complete. ;) > > Summary: > > MySQL, ProLiant DL180G5, CentOS 5.2 > > 1. Batch inserts 10M unique! records in table 'File' (DB schema not > changed) : 39 hours (23+16), DB file size 15,4 Gb > 2. Batch inserts 10M unique! records in table 'File' (NEW DB schema > see also create_mysql_test2.sh) : 35 hours (19+16), DB file size 15,2 > Gb > > Source code attached. > > Please note that the length of time (16 hours) insert records from the > table 'batch' to the table 'File' the same. > This indicates the stability of results. > > > > > > Full report: > > # ./test > Date: Oct 10 2008 11:27:37 > Host: Localhost via UNIX socket > Use database: 'bacula_test'. > Temporary table 'batch' created. > Start filling tables 'batch'(temporary), 'Path', 'Filename' ... > End. > 10000000 records inserts. > *** CPUs time used : 375.880000 > *** Elapsed time (wall clock) : 85334.000000 > > Start inserts from temporary table 'batch' to 'File' ... > End inserts to 'File' ... > *** CPUs time used : 0.000000 > *** Elapsed time (wall clock) : 58838.000000 > > > > > # ./test2 > Date: Oct 10 2008 11:27:37 > Host: Localhost via UNIX socket > Use database: 'bacula_test2'. > Temporary table 'batch' created. > Start filling tables 'batch'(temporary), 'Path', 'Filename' ... > End. > 10000000 records inserts. > *** CPUs time used : 384.650000 > *** Elapsed time (wall clock) : 71670.000000 > > Start inserts from temporary table 'batch' to 'File' ... > End inserts to 'File' ... > *** CPUs time used : 0.000000 > *** Elapsed time (wall clock) : 58564.000000 > > > > > > > > ________________________________ > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great > prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > ________________________________ > _______________________________________________ > Bacula-devel mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/bacula-devel > -- with best regards ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Bacula-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/bacula-devel
