[Bacula-users] Rif: Bacula Network Performance
Hi Jordan, in my experience you will get better perfomance on a single client if you turn spooling off. -- Ferdinando Pasqualetti G.T.Dati srl Tel. 0557310862 - 3356172731 - Fax 055720143 "Jordan Desroches" <[EMAIL PROTECTED]> Inviato da: [EMAIL PROTECTED] 15/05/2007 14.55 Per bacula-users@lists.sourceforge.net CC Oggetto [Bacula-users] Bacula Network Performance Greetings! First, I apologize if this comes through multiple times. I'm having trouble connecting to the list. I've been trying to bake off AMANDA and Bacula in our environment, and have run up against a Bacula performance snag. Amanda is regularly able to average ~50 MB/s over our network, while I'm getting ~30 MB/s out of Bacula (spooling turned on over gig-e). I like the feature set and usability of Bacula much better than that which AMANDA provides, but the speed difference is an issue. I think the difference may have to do with AMANDA running multiple simultaneous dumpers on the client. I've bumped "Maximum Network Buffer Size" to 65536 bytes in both the storage daemon and file daemon configurations with little to no change from the 32K buffer. A typical Bacula client status reads: *status client=foo-fd Connecting to Client foo-fd at foo.thayer.dartmouth.edu:9102 foo-fd Version: 2.0.3 (06 March 2007) i686-pc-linux-gnu debian testing/unstable Daemon started 14-May-07 10:53, 0 Jobs run since started. Heap: bytes=980,146 max_bytes=994,080 bufs=4,843 max_bufs=4,867 Sizeof: boffset_t=8 size_t=4 debug=0 trace=0 Running Jobs: JobId 9 Job foo.2007-05-14_10.53.38 is running. Backup Job started: 14-May-07 10:55 Files=20,612 Bytes=6,910,478,815 Bytes/sec=29,281,689 Files Examined=20,612 Processing file: /backup/mulch/vmware/mulch.0.tar.gz SDReadSeqNo=5 fd=5 Director connected at: 14-May-07 10:59 Any ideas what I can do to eek out some more speed? Best, Jordan Desroches Systems Administrator Thayer School of Engineering Dartmouth College - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Rif: Bacula Network Performance
So it doesn't look like the MySQL process is tanking the system at all. I increased cache sizes in MySQL with no effect, along with buffer sizes in sysctl.conf . I also tried using SQLite , and got marginally better throughput. Has anyone seen significantly >30 MB/s over a gig line on backup? Thanks, Jordan - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Rif: Bacula Network Performance
Jordan Desroches schrieb: > So it doesn't look like the MySQL process is tanking the system at all. I > increased cache sizes in MySQL with no effect, along with buffer sizes in > sysctl.conf . I also tried using SQLite , and got marginally better > throughput. Has anyone seen significantly >30 MB/s over a gig line on > backup? Spooling transfer rate: Job write elapsed time = 01:17:50, Transfer rate = 49.64 M bytes/second Despooling to tape: Despooling elapsed time = 00:55:10, Transfer rate = 70.11 M bytes/second Average: Rate: 26546.5 KB/s I guess my average transfer rate could be higher, if I would not use spooling. I'm not running concurrent jobs. Ralf ~ - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Rif: Bacula Network Performance
Hi, On 5/15/2007 9:52 PM, Jordan Desroches wrote: > So it doesn't look like the MySQL process is tanking the system at all. > I increased cache sizes in MySQL with no effect, along with buffer sizes > in sysctl.conf . I also tried using SQLite , and got marginally better > throughput. Has anyone seen significantly >30 MB/s over a gig line on > backup? Yes, but on setups where multiple jobs from different clients run in parallel. Each job might have a slower throughput, but the overall (estimated) network throughput is close to the real-life maximum of about 60 to 80 MB/s. I don't have access to these systems at the moment, though, so I can't check if I recall correctly. Arno > Thanks, > > Jordan > > > > > - > This SF.net email is sponsored by DB2 Express > Download DB2 Express C - the FREE version of DB2 express and take > control of your XML. No limits. Just data. Click to get it now. > http://sourceforge.net/powerbar/db2/ > > > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
