On Thursday 08 September 2005 22:33, Arunav Mandal wrote: > The director is running on xeon 2.8Ghz having 4GB of RAM on Hardware Raid0 > and the storage demaon is on dual P4 3Ghz having 1GB ram and 1TB disk > spool(xfs) also on Hardware Raid0. Most of clients are on P4 3gig machine > with 1Gb ram running linux and windows.At peak there were atleast 40Jobs > running at the same time. I will give a example of slowness below. As you > can see the Rate is only at 568.2 KB/s before spooling it was around > 8000KB/S. At the time of this client backup there were around 10 jobs > running.
Can you show us the output for the same job before the spooling was turned on? If not, can you turn spooling off and run the job again? > As you can see this backup took around 7hrs. So my question is > having latest hardware and enough memory why this is slow and what could be > done to improve it. > > > 08-Sep 15:47 No prior Full backup Job record found. > 08-Sep 15:47 No prior or suitable Full backup found. Doing FULL backup. > 08-Sep 15:47 : Start Backup JobId 1012, Job=backup-abc.2005-09-08_15.47.00 > 07-Sep 15:48 Spooling data ... > 07-Sep 21:41 Committing spooled data to Volume. Despooling 13,235,326,697 > bytes ... > 07-Sep 21:56 Sending spooled attrs to the Director. Despooling 122,253,435 > bytes ... > 08-Sep 22:12 Bacula 1.36.3 (22Apr05): 08-Sep-2005 22:12:50 > JobId: 1012 > Job: backup-abc.2005-09-08_15.47.00 > Backup Level: Full (upgraded from Incremental) > Client: abc-fd > FileSet: "linux-default" 2005-09-08 00:20:01 > Pool: "daily" > Storage: "SDLT6K-1" > Start time: 08-Sep-2005 15:47:02 > End time: 08-Sep-2005 22:12:50 > FD Files Written: 396,170 > SD Files Written: 396,170 > FD Bytes Written: 13,151,694,548 > SD Bytes Written: 13,208,137,447 > Rate: 568.2 KB/s > Software Compression: None > Volume name(s): SDLT005 > Volume Session Id: 21 > Volume Session Time: 1126100490 > Last Volume Bytes: 154,989,306,412 > Non-fatal FD errors: 0 > SD Errors: 0 > FD termination status: OK > SD termination status: OK > Termination: Backup OK > > > > > ----- Original Message ----- > From: "Arno Lehmann" <[EMAIL PROTECTED]> > To: "Arunav Mandal" <[EMAIL PROTECTED]> > Cc: <bacula-users@lists.sourceforge.net> > Sent: Thursday, September 08, 2005 9:09 PM > Subject: Re: [Bacula-users] Slow backups > > > Hi, > > > > Arunav Mandal wrote: > >> I am running 1.36.3 on both director and storage deamon and diff. > >> versions on 150 clients. Recently I started spooling to disk first then > >> to tape with around 100 concurrent connections for director and storage > >> deamons. Now the backups seems to take time Rate seems to be around > >> 700KB/s before spooling and concurrent connections it was around > >> 8000KB/s. I know too many clients are backing at the same time is that > >> the reason? > > > > I can't follow you here, but yes, having too many clients working > > concurrently can reduce the overall performance. You've got to find your > > personal optimal number of concurrent jobs depending on overall network > > throughput, server power, storage and spool speed - I don't think that > > it's possible to tell you what the perfect setup is for you. > > > >> Also when all the clients start backing up at the same time I can't log > >> onto the console since there is no free connections left is there any > >> way I can atleast reserve one connection for the console? > > > > Two possible reasons: > > Not enough connections allowed - change the numer in the config. > > Server load too high - wait, or, better, have less clients run > > simultaneously. Remember that each job means a fork and a process, takes > > memory, cpu time, and loads the catalog database. That's all stuff you > > need to work on the console, too. > > > >> Thx, > >> > >> Arunav. > > > > Arno > > > > > > -- > > IT-Service Lehmann [EMAIL PROTECTED] > > Arno Lehmann http://www.its-lehmann.de > > ------------------------------------------------------- > SF.Net email is Sponsored by the Better Software Conference & EXPO > September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices > Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA > Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Best regards, Kern ("> /\ V_V ------------------------------------------------------- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
