Re: [Bacula-users] Despooling attributes very slow
On Nov 15, 2014, at 4:16 PM, Will Twomey term...@gmail.com wrote: Hey John, Thanks for the response. That hdparm was run during the despooling process which is likely impacting those numbers. (Although I would argue that 125MB/sec should be more than enough to despool a 45MB file! :)) This does seem to be a mysql issue, as switching to postgres has resolved this. Oddly enough, running myqltuner.pl http://myqltuner.pl/ didn't show any cause for concern. Thanks again for the prompt response I think you’ll be much happier with PostgreSQL in the long term. One of my tuning expeditions, for future reference: https://plus.google.com/106386350930626759085/posts/hhKemT3UQE7 https://plus.google.com/106386350930626759085/posts/hhKemT3UQE7 disclosure: I wrote the PostgreSQL backend for Bacula. — Dan Langille http://langille http://langille/.org/ -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Despooling attributes very slow
# hdparm -tT /dev/md3 /dev/md3: Timing cached reads: 1724 MB in 2.00 seconds = 862.23 MB/sec Timing buffered disk reads: 376 MB in 3.01 seconds = 125.06 MB/sec These are both very slow for a modern PC. The top number measures cache/ram speed I would expect this number 2000 to 5000. The bottom number which measures disk performance is less than a single SATA drive. Any assistance would be greatly appreciated If you can make sure the database is not on /dev/md3 especially if this is the source or destination of your backups. Also did you tune the database? A lot of mysql implementations are tuned for a ridiculously small amount of ram like 64MB. John -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Despooling attributes very slow
Hey John, Thanks for the response. That hdparm was run during the despooling process which is likely impacting those numbers. (Although I would argue that 125MB/sec should be more than enough to despool a 45MB file! :)) This does seem to be a mysql issue, as switching to postgres has resolved this. Oddly enough, running myqltuner.pl didn't show any cause for concern. Thanks again for the prompt response Will On Sat, Nov 15, 2014 at 7:12 AM, John Drescher dresche...@gmail.com wrote: # hdparm -tT /dev/md3 /dev/md3: Timing cached reads: 1724 MB in 2.00 seconds = 862.23 MB/sec Timing buffered disk reads: 376 MB in 3.01 seconds = 125.06 MB/sec These are both very slow for a modern PC. The top number measures cache/ram speed I would expect this number 2000 to 5000. The bottom number which measures disk performance is less than a single SATA drive. Any assistance would be greatly appreciated If you can make sure the database is not on /dev/md3 especially if this is the source or destination of your backups. Also did you tune the database? A lot of mysql implementations are tuned for a ridiculously small amount of ram like 64MB. John -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Despooling attributes very slow
Thanks for the response. That hdparm was run during the despooling process which is likely impacting those numbers. (Although I would argue that 125MB/sec should be more than enough to despool a 45MB file! :)) Its usually an IOPS issue more than a sequential write. The defaults cause mysql to flush too often by setting it to use too small of a buffer... John -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Despooling attributes very slow
Hi Will, Can you take a look at this: http://bugs.bacula.org/view.php?id=2034 Maybe is the same that happened to me. Try setting MyISAM as default storage engine in MySQL: default_storage_engine = MyISAM Jordi. 2014-11-15 22:56 GMT+01:00 John Drescher dresche...@gmail.com: Thanks for the response. That hdparm was run during the despooling process which is likely impacting those numbers. (Although I would argue that 125MB/sec should be more than enough to despool a 45MB file! :)) Its usually an IOPS issue more than a sequential write. The defaults cause mysql to flush too often by setting it to use too small of a buffer... John -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
