Does anyone have experience with large backups off of many servers (specifically web servers)? I'm trying to see why it is that backups slow down significantly after running for awhile. This is eventually leading to bacula hanging.
Should I switch databases? Not quite sure where the bottleneck is coming from. I think that it could be the DB, seeing as it eventually goes to 99% usage on the first CPU, but it appears to not be doing much at all. Mostly SELECT queries. Is there a way to make bacula create multiple connections to the DB? Anyone have any specific tuning/performance tips that may relate to my situation? Should I possibly run multiple instances of bacula on different ports for different groups of servers? Any ideas/suggestions are appreciated. -Ronan On Thu, 2005-05-12 at 01:43 -0400, Ronan Eckelberry wrote: > Hi all, > > I run rather large backups, about 70+ servers, 1 Full a month, rest > daily incrementals. All disk -> disk backups. At the time of full > backups I can be pulling anywhere from 1.5-3TB of total data from the > servers. > > Backups start out great, pulling a few megs a piece from about 8 boxes > at a time. The problem is after about 12 hours of running, MySQL shoots > up to 99% CPU, which is not really a problem because it is SMP, and box > is still responsive. I check the processes on mysql and it is > responding to queries quickly still. Backup speed however drops to > about 20k/sec from each box. It continues to run, but after awhile the > director stops responding altogether and all the bacula process show as > sleeping. I am forced to restart bacula and lose the backups that were > unfinished. > > Not sure if this is because of MySQL, which seems to be operating fine, > or maybe bacula, RAM, or what. Below is what the server is. I can > supply configs or whatever may be needed. If anyone has any suggestions > or a similar setup that had the same type of problem and was resolved, > it would be appreciated. > > Server: > Debian Woody > Kernel 2.4.26 > P4 2.8 HT > 1G RAM > 2G Swap > Intel S875WP MB > > Thanks for any help, > > -Ronan > > > > ------------------------------------------------------- > This SF.Net email is sponsored by Oracle Space Sweepstakes > Want to be the first software developer in space? > Enter now for the Oracle Space Sweepstakes! > http://ads.osdn.com/?ad_id=7393&alloc_id=16281&op=click > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > ------------------------------------------------------- This SF.Net email is sponsored by Oracle Space Sweepstakes Want to be the first software developer in space? Enter now for the Oracle Space Sweepstakes! http://ads.osdn.com/?ad_id=7393&alloc_id=16281&op=click _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
