Re: [Bacula-users] [Bacula-devel] Current version of bat

2007-05-15 Thread MaxxAtWork
On 5/14/07, Kern Sibbald [EMAIL PROTECTED] wrote:
 OK, I have included a screen shot of the current Bacula.  One could easily
 start on the tool bar icons.  From left to right, the icons are:

 - Connect (connect to director) -- there is a corresponding disconnected icon
  as well.
 - Status dir
 - Messages
 - Label
 - Restore
 - Run a job
 - Undock current window (in right pane)

 Note, Status dir and Messages are the same icon.

 What I think is most important is the following:
 1. To have different Status dir and Messages Icons
 2. To have a better Icon for Undock
 3. Possibly have a better icon for run
 4. Examine the other icons


Regarding 1, my suggestion is to use a traffic light icon for Status
and a balloon (as in a cartoon) for Messages.
With point 2, I don't have a proposal myself, but a plain Google
search for Images with undock icon as keyword offers some ideas.

-- 
Maxx

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Changing Directors.

2007-05-15 Thread Miki Lewinger
Flak Magnet wrote:
 I've been running bacula on solaris since December of '06.  It started out as 
 a single-box backup solution, with the dir, sd and fd running on a single 
 box.  Since then we've scaled it up to include a second sd and fd on another 
 Sun box, the an fd-only on a ubuntu machine, and the fd on a WinXP machine.
 
 I've been using mySQL.  I know how to get a dump of the database out, and how 
 to read that database back in.  I intend to use that to migrate the 
 database to the mySQL server on the new director.  I don't think that will 
 cause any problems.  I'm open to being corrected.

MYSQL transfer will probably be fine with mysqldump and mysql import. 
However, you should keep volumes (filenames in the case of FILE backup, 
  or the tapes themselves) bound to their ORIGINAL SD definitions as 
migration among SDs is not supported yet (not a feature), and volumes 
are internally connected to pools, which MAY or MAY NOT be connected to 
particular storage devices.

 With the director moving off of the original sun machine, I'm going to rename 
 the sd and fd on that machine.  If I have to do restores, I know that I'll 
 have to change the restore-from devices and such.  Currently their named 
 bacula-sd and bacula-fd.  I intend to change them to [hostname]-fd/sd.  Are 
 there any snafus I might encounter there?

I'd recommend NOT changing daemons names (see above), as they are part 
of the bacula database. The names bacula-sd and bacula-fd are internal 
to bacula and not connected to the server IP, thus do not NEED to be 
changed. Past backups may get confused regarding storage and pools 
associations. Or maybe I'm confused about the implication, but in any 
case it doesn't sound good.

 
 Anything else?
 

Have a nice day !

Michael Lewinger


-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Current version of bat

2007-05-15 Thread Kern Sibbald
On Tuesday 15 May 2007 08:44, MaxxAtWork wrote:
 On 5/14/07, Kern Sibbald [EMAIL PROTECTED] wrote:
  OK, I have included a screen shot of the current Bacula.  One could easily
  start on the tool bar icons.  From left to right, the icons are:
 
  - Connect (connect to director) -- there is a corresponding disconnected 
icon
   as well.
  - Status dir
  - Messages
  - Label
  - Restore
  - Run a job
  - Undock current window (in right pane)
 
  Note, Status dir and Messages are the same icon.
 
  What I think is most important is the following:
  1. To have different Status dir and Messages Icons
  2. To have a better Icon for Undock
  3. Possibly have a better icon for run
  4. Examine the other icons
 
 
 Regarding 1, my suggestion is to use a traffic light icon for Status
 and a balloon (as in a cartoon) for Messages.
 With point 2, I don't have a proposal myself, but a plain Google
 search for Images with undock icon as keyword offers some ideas.

Nice ideas thanks.

 
 -- 
 Maxx
 
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-devel mailing list
 [EMAIL PROTECTED]
 https://lists.sourceforge.net/lists/listinfo/bacula-devel
 

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Large memory usage problems

2007-05-15 Thread Kern Sibbald
Hello,

Several users have reported that the Director consumes huge amounts of memory 
when running large numbers of simultaneous jobs.  Actually, the Director 
needs something like between 80-100 K per job depending on the exact timing 
of that job.  This amount of memory per job is really quite small by any 
standards.  

Normally, Bacula does not lose memory when it is running because it has code 
integrated that detects memory loss.  However, system libraries that Bacula 
uses (such as glibc, mysqlclient, ...) are not covered by Bacula memory loss 
techniques (I call them orphanned buffer detection).

As a consequence, I ran Bacula under valgrind and found a rather large memory 
loss in Bacula's mysql interface.  In looking at the code, I believe that the 
code is correct, but perhaps I am misunderstanding their document.  Anyway, 
I've implemented a workaround in Bacula version 2.1.8 that ensures that the 
memory will not be lost.  At this point, I am not 100% sure if the problem is 
a MySQL change, a MySQL bug, or a Bacula bug, but it is now fixed.

This fix should resolve the problems that you have been seeing, where 
basically the memory lost depended on the number of files backed up and the 
number of Jobs run.  The short term workaround is to restart the Director 
from time to time, if you are having the problem.  The longer term solution 
is to upgrade to version 2.1.8 in a few days when it is released -- however, 
please remember it is BETA code.  The official release of 2.2.0 should be in 
about a month or two depending on how well 2.1.8 testing goes.

Best regards,

Kern

PS: there was also a problem in SQLite, which I also fixed.

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Volume purging/recycling

2007-05-15 Thread Jarrod Meyer
I have been trying to get Bacula to do one thing for some time now, and
cannot come right even after reading most of the manual (well, at least
some), searching the mailing lists, and of course Google.

The Setup: I have a set of volumes for each of my sites and each night a
FULL backup of the included directories is done and the tape is marked
'Used'. When the tape is re-inserted, the volume must be 'Purged',
'Recycled', and overwritten.

The Problem: Since each site cannot be counted on to have the correct
tape inserted on the correct day, and since I cannot afford for a backup
not to run on those occasions, I need to ensure that whatever tape is in
the drive can be overwritten without complaint or intervention. That
means the volume must have almost no retention period, because if the
same tape is inserted the next day, it will not be 'Recycled'. Also,
'AutoPrune' is needed to continually ensure the volumes are ready for
recycling, but this purges volumes almost as soon as they are written;
of course, even though the data is still there, this is not at all
helpful for any restores since the entire tape must be scanned etc.

I am posting to find out if this scenario is possible with Bacula, or
what the best solution to the problem would be; hope I have not left
anything important out. Any help is much appreciated. Thank you in
advance.

Jarrod Meyer
Product Development Engineer
Thusa Business Support (Pty) LTD
 


-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula Network Performance

2007-05-15 Thread Jordan Desroches

Greetings!

First, I apologize if this comes through multiple times. I'm having
trouble connecting to the list.

I've been trying to bake off AMANDA and Bacula in our environment, and
have run up against a Bacula performance snag. Amanda is regularly able
to average ~50 MB/s over our network, while I'm getting ~30 MB/s out of
Bacula (spooling turned on over gig-e). I like the feature set and usability
of
Bacula much better than that which AMANDA provides, but the speed
difference is an issue. I think the difference may have to do with
AMANDA running multiple simultaneous dumpers on the client. I've bumped
Maximum Network Buffer Size to 65536 bytes in both the storage daemon
and file daemon configurations with little to no change from the 32K buffer.
A typical Bacula client status reads:

*status client=foo-fd
Connecting to Client foo-fd at foo.thayer.dartmouth.edu:9102

foo-fd Version: 2.0.3 (06 March 2007)  i686-pc-linux-gnu debian
testing/unstable
Daemon started 14-May-07 10:53, 0 Jobs run since started.
Heap: bytes=980,146 max_bytes=994,080 bufs=4,843 max_bufs=4,867
Sizeof: boffset_t=8 size_t=4 debug=0 trace=0

Running Jobs:
JobId 9 Job foo.2007-05-14_10.53.38 is running.
  Backup Job started: 14-May-07 10:55
  Files=20,612 Bytes=6,910,478,815 Bytes/sec=29,281,689
  Files Examined=20,612
  Processing file: /backup/mulch/vmware/mulch.0.tar.gz
  SDReadSeqNo=5 fd=5
Director connected at: 14-May-07 10:59

Any ideas what I can do to eek out some more speed?

Best,

Jordan Desroches
Systems Administrator
Thayer School of Engineering
Dartmouth College
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Volume purging/recycling

2007-05-15 Thread Andy Collyer
Is Use Volume Once = yes in your Pool definition what you mean?

Cheers,
Andy
 

 -Original Message-
 From: [EMAIL PROTECTED] 
 [mailto:[EMAIL PROTECTED] On Behalf 
 Of Jarrod Meyer
 Sent: 15 May 2007 12:12
 To: bacula-users@lists.sourceforge.net
 Subject: [Bacula-users] Volume purging/recycling
 
 I have been trying to get Bacula to do one thing for some 
 time now, and cannot come right even after reading most of 
 the manual (well, at least some), searching the mailing 
 lists, and of course Google.
 
 The Setup: I have a set of volumes for each of my sites and 
 each night a FULL backup of the included directories is done 
 and the tape is marked 'Used'. When the tape is re-inserted, 
 the volume must be 'Purged', 'Recycled', and overwritten.
 
 The Problem: Since each site cannot be counted on to have the 
 correct tape inserted on the correct day, and since I cannot 
 afford for a backup not to run on those occasions, I need to 
 ensure that whatever tape is in the drive can be overwritten 
 without complaint or intervention. That means the volume must 
 have almost no retention period, because if the same tape is 
 inserted the next day, it will not be 'Recycled'. Also, 
 'AutoPrune' is needed to continually ensure the volumes are 
 ready for recycling, but this purges volumes almost as soon 
 as they are written; of course, even though the data is still 
 there, this is not at all helpful for any restores since the 
 entire tape must be scanned etc.
 
 I am posting to find out if this scenario is possible with 
 Bacula, or what the best solution to the problem would be; 
 hope I have not left anything important out. Any help is much 
 appreciated. Thank you in advance.
 
 Jarrod Meyer
 Product Development Engineer
 Thusa Business Support (Pty) LTD
  
 
 
 --
 ---
 This SF.net email is sponsored by DB2 Express Download DB2 
 Express C - the FREE version of DB2 express and take control 
 of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 




-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Network Performance

2007-05-15 Thread Michel Meyers
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Jordan Desroches wrote:
 Greetings!
 
 First, I apologize if this comes through multiple times. I'm having
 trouble connecting to the list.
 
 I've been trying to bake off AMANDA and Bacula in our environment, and
 have run up against a Bacula performance snag. Amanda is regularly able
 to average ~50 MB/s over our network, while I'm getting ~30 MB/s out of
 Bacula (spooling turned on over gig-e). I like the feature set and
 usability of
 Bacula much better than that which AMANDA provides, but the speed
 difference is an issue. I think the difference may have to do with
 AMANDA running multiple simultaneous dumpers on the client. I've bumped
 Maximum Network Buffer Size to 65536 bytes in both the storage daemon
 and file daemon configurations with little to no change from the 32K
 buffer.  A typical Bacula client status reads:
[...]
 
 Any ideas what I can do to eek out some more speed?

Just a guess/question: Do you have compression enabled in your job? If
the client's doing compression, that might throttle its throughput.

Greetings,
Michel
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.7 (MingW32)

iD8DBQFGSa8b2Vs+MkscAyURAuC+AKDnMf1RGfkBeq6qYmPZzEneCLVZxwCeNJYk
YpXNPfBS5fQRAMS/rNEvgcE=
=Adyp
-END PGP SIGNATURE-

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula crash

2007-05-15 Thread Martin Hicks

Hi,

I've installed a self-compiled RPM for SUSE professional 9.1 on x86.  It
has been working reasonably well, but lately I've gotten a few crashes.
One solid lockup, and last sunday (during the differential) I got the
attached crash.

its a P4-2.4GHz machine.  I'm backing up to external USB Hard drive.
xfs. Kernel is a custom built 2.6.16.11

Any ideas?


Using host libthread_db library /lib/tls/libthread_db.so.1.
[Thread debugging using libthread_db enabled]
[New Thread -1212310784 (LWP 3765)]
[New Thread -1271100496 (LWP 9666)]
[Thread debugging using libthread_db enabled]
[New Thread -1212310784 (LWP 3765)]
[New Thread -1271100496 (LWP 9666)]
[Thread debugging using libthread_db enabled]
[New Thread -1212310784 (LWP 3765)]
[New Thread -1271100496 (LWP 9666)]
[New Thread -1279493200 (LWP 9653)]
[New Thread -1237529680 (LWP 9643)]
[New Thread -1245922384 (LWP 9641)]
[New Thread -1254315088 (LWP 9640)]
[New Thread -1220744272 (LWP 3767)]
[New Thread -1212351568 (LWP 3766)]
0xe410 in ?? ()
$1 = 2037801326
$2 = 0x820f050 bacula-dir
$3 = 0x820f078 /usr/sbin/bacula-dir
$4 = 0x0
$5 = 0x8108da4 2.0.2 (28 January 2007)
$6 = 0x80fd856 i686-suse-linux-gnu
$7 = 0x80fd851 suse
$8 = 0x80fd86a 9.1
#0  0xe410 in ?? ()
#1  0xbfe3e5f8 in ?? ()
#2  0x in ?? ()
#3  0x in ?? ()
#4  0xb7f036b6 in __nanosleep_nocancel () from /lib/tls/libpthread.so.0
#5  0x0809f202 in bmicrosleep (sec=60, usec=0) at bsys.c:67
#6  0x0806f3f2 in wait_for_next_job (one_shot_job_to_run=0x0)
at scheduler.c:130
#7  0x0804f258 in main (argc=3, argv=0xbfe3e784) at dird.c:278

Thread 8 (Thread -1212351568 (LWP 3766)):
#0  0xe410 in ?? ()
#1  0xb7bcfa78 in ?? ()
#2  0x in ?? ()
#3  0xb7bceeb0 in ?? ()
#4  0xb7c8b391 in ___newselect_nocancel () from /lib/tls/libc.so.6
#5  0x080a27f0 in bnet_thread_server (addrs=0x820f828, max_clients=-514, 
client_wq=0x820d060, handle_client_request=0xfdfe) at bnet_server.c:163
#6  0x08087249 in connect_thread (arg=0xfdfe) at ua_server.c:84
#7  0xb7efe9dd in start_thread () from /lib/tls/libpthread.so.0
#8  0xb7c91ffa in clone () from /lib/tls/libc.so.6

Thread 7 (Thread -1220744272 (LWP 3767)):
#0  0xe410 in ?? ()
#1  0xb73cea70 in ?? ()
#2  0x4b64 in ?? ()
#3  0x in ?? ()
#4  0xb7f008e0 in pthread_cond_timedwait@@GLIBC_2.3.2 ()
   from /lib/tls/libpthread.so.0
#5  0x080c0bdf in watchdog_thread (arg=0x0) at watchdog.c:305
#6  0xb7efe9dd in start_thread () from /lib/tls/libpthread.so.0
#7  0xb7c91ffa in clone () from /lib/tls/libc.so.6

Thread 6 (Thread -1254315088 (LWP 9640)):
#0  0xe410 in ?? ()
#1  0xb53ca638 in ?? ()
#2  0x0004 in ?? ()
#3  0xb53ca66c in ?? ()
#4  0xb7f02ebb in __read_nocancel () from /lib/tls/libpthread.so.0
#5  0x080a1f40 in read_nbytes (bsock=0x8231ab0, 
ptr=0x4 Address 0x4 out of bounds, nbytes=-1254316436) at bnet.c:86
#6  0x080a2017 in bnet_recv (bsock=0x8231ab0) at bnet.c:207
#7  0x0805d5b7 in bget_dirmsg (bs=0x8231ab0) at getmsg.c:107
#8  0x08052045 in wait_for_job_termination (jcr=0x8237e00) at backup.c:285
#9  0x080526af in do_backup (jcr=0x8237e00) at backup.c:235
#10 0x08062f1d in job_thread (arg=0x8237e00) at job.c:290
#11 0x08063c0d in jobq_server (arg=0x820ccc0) at jobq.c:464
#12 0xb7efe9dd in start_thread () from /lib/tls/libpthread.so.0
#13 0xb7c91ffa in clone () from /lib/tls/libc.so.6

Thread 5 (Thread -1245922384 (LWP 9641)):
#0  0xe410 in ?? ()
#1  0xb5bcb638 in ?? ()
#2  0x0004 in ?? ()
#3  0xb5bcb66c in ?? ()
#4  0xb7f02ebb in __read_nocancel () from /lib/tls/libpthread.so.0
#5  0x080a1f40 in read_nbytes (bsock=0x8240f90, 
ptr=0x4 Address 0x4 out of bounds, nbytes=-1245923732) at bnet.c:86
#6  0x080a2017 in bnet_recv (bsock=0x8240f90) at bnet.c:207
#7  0x0805d5b7 in bget_dirmsg (bs=0x8240f90) at getmsg.c:107
#8  0x08052045 in wait_for_job_termination (jcr=0x823de38) at backup.c:285
#9  0x080526af in do_backup (jcr=0x823de38) at backup.c:235
#10 0x08062f1d in job_thread (arg=0x823de38) at job.c:290
#11 0x08063c0d in jobq_server (arg=0x820ccc0) at jobq.c:464
#12 0xb7efe9dd in start_thread () from /lib/tls/libpthread.so.0
#13 0xb7c91ffa in clone () from /lib/tls/libc.so.6

Thread 4 (Thread -1237529680 (LWP 9643)):
#0  0xe410 in ?? ()
#1  0xb63cc298 in ?? ()
#2  0x in ?? ()
#3  0x in ?? ()
#4  0xb7f03e8b in __waitpid_nocancel () from /lib/tls/libpthread.so.0
#5  0x080b9178 in signal_handler (sig=11) at signal.c:166
#6  signal handler called
#7  0x080e42a5 in vio_write (vio=0x36, buf=0x36 Address 0x36 out of bounds, 
size=54) at viosocket.c:109
#8  0x080e4587 in net_real_write (net=0x8235ee0, packet=0x8225900 2, len=54)
at net.c:504
#9  0x080e4868 in net_flush (net=0x8235ee0) at net.c:229
#10 0x080e49aa in net_write_command (net=0x8235ee0, command=3 '\003', 
header=0x0, head_len=0, 
packet=0x82202e8 SELECT FilenameId FROM Filename WHERE Name='pm.c', 
len=49) at net.c:352
#11 0x080e238b in cli_advanced_command (mysql=0x8235ee0, command=COM_QUERY, 
   

Re: [Bacula-users] Bacula Network Performance

2007-05-15 Thread Jordan Desroches
Compression is not enabled in the FileSet.

Thanks,

Jordan

Michel Meyers wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 Jordan Desroches wrote:
 Greetings!

 First, I apologize if this comes through multiple times. I'm having
 trouble connecting to the list.

 I've been trying to bake off AMANDA and Bacula in our environment, and
 have run up against a Bacula performance snag. Amanda is regularly able
 to average ~50 MB/s over our network, while I'm getting ~30 MB/s out of
 Bacula (spooling turned on over gig-e). I like the feature set and
 usability of
 Bacula much better than that which AMANDA provides, but the speed
 difference is an issue. I think the difference may have to do with
 AMANDA running multiple simultaneous dumpers on the client. I've bumped
 Maximum Network Buffer Size to 65536 bytes in both the storage daemon
 and file daemon configurations with little to no change from the 32K
 buffer.  A typical Bacula client status reads:
 [...]
 Any ideas what I can do to eek out some more speed?
 
 Just a guess/question: Do you have compression enabled in your job? If
 the client's doing compression, that might throttle its throughput.
 
 Greetings,
 Michel
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.7 (MingW32)
 
 iD8DBQFGSa8b2Vs+MkscAyURAuC+AKDnMf1RGfkBeq6qYmPZzEneCLVZxwCeNJYk
 YpXNPfBS5fQRAMS/rNEvgcE=
 =Adyp
 -END PGP SIGNATURE-
 
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Rif: Bacula Network Performance

2007-05-15 Thread Ferdinando Pasqualetti
Hi Jordan,
in my experience you will get better perfomance on a single client if you 
turn spooling off.

--
Ferdinando Pasqualetti
G.T.Dati srl
Tel. 0557310862 - 3356172731 - Fax 055720143






Jordan Desroches [EMAIL PROTECTED] 
Inviato da: [EMAIL PROTECTED]
15/05/2007 14.55

Per
bacula-users@lists.sourceforge.net
CC

Oggetto
[Bacula-users] Bacula Network Performance






Greetings!

First, I apologize if this comes through multiple times. I'm having
trouble connecting to the list.

I've been trying to bake off AMANDA and Bacula in our environment, and 
have run up against a Bacula performance snag. Amanda is regularly able
to average ~50 MB/s over our network, while I'm getting ~30 MB/s out of
Bacula (spooling turned on over gig-e). I like the feature set and 
usability of 
Bacula much better than that which AMANDA provides, but the speed
difference is an issue. I think the difference may have to do with
AMANDA running multiple simultaneous dumpers on the client. I've bumped
Maximum Network Buffer Size to 65536 bytes in both the storage daemon
and file daemon configurations with little to no change from the 32K 
buffer.  A typical Bacula client status reads:

*status client=foo-fd 
Connecting to Client foo-fd at foo.thayer.dartmouth.edu:9102

foo-fd Version: 2.0.3 (06 March 2007)  i686-pc-linux-gnu debian 
testing/unstable
Daemon started 14-May-07 10:53, 0 Jobs run since started.
 Heap: bytes=980,146 max_bytes=994,080 bufs=4,843 max_bufs=4,867
 Sizeof: boffset_t=8 size_t=4 debug=0 trace=0

Running Jobs:
JobId 9 Job foo.2007-05-14_10.53.38 is running.
   Backup Job started: 14-May-07 10:55
   Files=20,612 Bytes=6,910,478,815 Bytes/sec=29,281,689
   Files Examined=20,612
   Processing file: /backup/mulch/vmware/mulch.0.tar.gz 
   SDReadSeqNo=5 fd=5
Director connected at: 14-May-07 10:59

Any ideas what I can do to eek out some more speed?

Best,

Jordan Desroches
Systems Administrator
Thayer School of Engineering 
Dartmouth College 
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Network Performance

2007-05-15 Thread Alan Brown
On Tue, 15 May 2007, Michel Meyers wrote:

 Just a guess/question: Do you have compression enabled in your job? If
 the client's doing compression, that might throttle its throughput.

Another thing to consider is the speed of the spool disk(s).

I had to stripe the spool across several dedicated drives in order to 
achieve sufficient speed to simultaneously spool/despool and keep up with 
the tape drive(s)


-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Network Performance

2007-05-15 Thread Bill Moran
In response to Jordan Desroches [EMAIL PROTECTED]:

 Compression is not enabled in the FileSet.

Can you isolate where the bottleneck is?  IO?  CPU?  Network?

There are frequently discussions about throughput being sub-optimal on
the lists.  In my experience, these fall into a few categories:

*) The SQL server is the bottleneck.  This kinda falls outside the discussion
   of Bacula, as it's usually specific to the particular SQL server you
   use.  This problem shows up most often with filesets that contain lots
   of little files.  However, there _has_ been work done to improve how
   Bacula writes to the database, so which version you're using is important.
   If you can make any suggestions on how to improve this further, or even
   provide test cases to show where it's slow, I expect it will be helpful
   to the developers.
*) IO.  Often, folks are saturating the IO of their hardware and don't
   realize it.  This can show up when the database is on the same system
   as file volumes, as that system has to share the IO of database writes
   as well as file volume writes.
*) Mysterious network problems.  This is the one that it would be nice to
   get some real information on.  Some folks have claimed that Bacula is
   unable to send data anywhere near the speed of the network, even when
   there is no other bottleneck.  Unfortunately, this problem has been
   very difficult to diagnose, as it requires a high level of expertise
   in networking to track down the cause, and everyone who has report it
   has been unable and/or unwilling to isolate it well enough for anyone
   to really do anything to improve it.

So, I hope that information is helpful in narrowing down your problem.

 Michel Meyers wrote:
  -BEGIN PGP SIGNED MESSAGE-
  Hash: SHA1
  
  Jordan Desroches wrote:
  Greetings!
 
  First, I apologize if this comes through multiple times. I'm having
  trouble connecting to the list.
 
  I've been trying to bake off AMANDA and Bacula in our environment, and
  have run up against a Bacula performance snag. Amanda is regularly able
  to average ~50 MB/s over our network, while I'm getting ~30 MB/s out of
  Bacula (spooling turned on over gig-e). I like the feature set and
  usability of
  Bacula much better than that which AMANDA provides, but the speed
  difference is an issue. I think the difference may have to do with
  AMANDA running multiple simultaneous dumpers on the client. I've bumped
  Maximum Network Buffer Size to 65536 bytes in both the storage daemon
  and file daemon configurations with little to no change from the 32K
  buffer.  A typical Bacula client status reads:
  [...]
  Any ideas what I can do to eek out some more speed?
  
  Just a guess/question: Do you have compression enabled in your job? If
  the client's doing compression, that might throttle its throughput.
  
  Greetings,
  Michel
  -BEGIN PGP SIGNATURE-
  Version: GnuPG v1.4.7 (MingW32)
  
  iD8DBQFGSa8b2Vs+MkscAyURAuC+AKDnMf1RGfkBeq6qYmPZzEneCLVZxwCeNJYk
  YpXNPfBS5fQRAMS/rNEvgcE=
  =Adyp
  -END PGP SIGNATURE-
  
  -
  This SF.net email is sponsored by DB2 Express
  Download DB2 Express C - the FREE version of DB2 express and take
  control of your XML. No limits. Just data. Click to get it now.
  http://sourceforge.net/powerbar/db2/
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
  
 
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


-- 
Bill Moran
http://www.potentialtech.com

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Volume purging/recycling

2007-05-15 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

This parameter is deprecated. MaximumVolumeJobs = 1 is the new terminology.

Sounds like you need an admin job that purges whatever tape happens to
be in the drive. I assume you're doing full backups.

I would strongly advise against this, but you gotta do what you gotta
do. I suppose you are doing full backups every night, in this case.

Andy Collyer wrote:
 Is Use Volume Once = yes in your Pool definition what you mean?
 
 Cheers,
 Andy
  
 
 -Original Message-
 From: [EMAIL PROTECTED] 
 [mailto:[EMAIL PROTECTED] On Behalf 
 Of Jarrod Meyer
 Sent: 15 May 2007 12:12
 To: bacula-users@lists.sourceforge.net
 Subject: [Bacula-users] Volume purging/recycling

 I have been trying to get Bacula to do one thing for some 
 time now, and cannot come right even after reading most of 
 the manual (well, at least some), searching the mailing 
 lists, and of course Google.

 The Setup: I have a set of volumes for each of my sites and 
 each night a FULL backup of the included directories is done 
 and the tape is marked 'Used'. When the tape is re-inserted, 
 the volume must be 'Purged', 'Recycled', and overwritten.

 The Problem: Since each site cannot be counted on to have the 
 correct tape inserted on the correct day, and since I cannot 
 afford for a backup not to run on those occasions, I need to 
 ensure that whatever tape is in the drive can be overwritten 
 without complaint or intervention. That means the volume must 
 have almost no retention period, because if the same tape is 
 inserted the next day, it will not be 'Recycled'. Also, 
 'AutoPrune' is needed to continually ensure the volumes are 
 ready for recycling, but this purges volumes almost as soon 
 as they are written; of course, even though the data is still 
 there, this is not at all helpful for any restores since the 
 entire tape must be scanned etc.

 I am posting to find out if this scenario is possible with 
 Bacula, or what the best solution to the problem would be; 
 hope I have not left anything important out. Any help is much 
 appreciated. Thank you in advance.

 Jarrod Meyer
 Product Development Engineer
 Thusa Business Support (Pty) LTD
  


 --
 ---
 This SF.net email is sponsored by DB2 Express Download DB2 
 Express C - the FREE version of DB2 express and take control 
 of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

 
 
 
 
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer III
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFGScQ+mb+gadEcsb4RAmlNAJ40PYErbAAK92CSvJxAPxGZkxALmwCeJukT
5KIawuEVBhKSIjI42KBJSgY=
=bvFD
-END PGP SIGNATURE-


-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How to unload all loaded tapes to library ?

2007-05-15 Thread Thomas Eszlinger
Hello Adam,

I'm having an Always Open = No and an Automount = yes in my 
bacula-sd.conf so when bacula needs a tape he automatically mounts the 
right slot and gives it back when its not needed anymore.
With this I have no need to umount the drive from the bacula-console to 
change my tapes in the library.

Thomas

Adam Cécile schrieb:
 Andreas Helmcke a écrit :
 On 14.05.2007 09:40, Adam Cécile wrote:
   
 All weeks I need to unload all tapes from drives to the library, so all
 tapes can be removed from the Autochanger easily.
 However, when I do umount, device is marked as BLOCKED and no more
 jobs run until I mount the drive again.
 What's the right way to eject all tapes without blocking drives ?

 
 I don't know if it's the right way but what I do is a mount with an
 non existing slot e.g. slot 0 after an unmount.
 Afterwards the tape will be used again by bacula.

 Andreas
   
 Yes, it's what I'm doing right now (in fact I just type mount, and as
 there's no more tape loaded in the drive, mount fails, but bacula
 unblock the drive).
 
 However I really would find something like Blocked On Umount = No
 directive.
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
   
 
 

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] behavior in case of errors

2007-05-15 Thread Naufal Sheikh

Hey,

thanks for your help. Just few clarifications. For the Max Wait Time,  the
time specified is in min or sec? Or can I just write 25 min or 300 sec.
Secondly if i want this to be global parameter for all the jobs, I should be
mentioning it in the jobdefs right?

Thanks

On 5/14/07, Arno Lehmann [EMAIL PROTECTED] wrote:


Hi,

On 5/14/2007 5:04 PM, Naufal Sheikh wrote:
 Hi,

 i was running bacula and then went on vacations. In the meantime due to
 some error which required human intervention, bacula just got stuck on
 that job and please correct me if I am wrong bacula does not carry on to
 next jobs if it get stuck in case of any error.

Depends... the above is one good reason for allowing multiple concurrent
jobs, and there are configuration directives to limit the time a job can
wait and run before it's automatically cancelled.

All three options might be useful in your situation.

 when I do list jobs it
 shows me lot of jobs which haven't been started but are there in the
 list. Should I just cancel them to start the bacula at the point of
 today's schedule?

That depends on what you want, but it's definitely an option.

 I believe otherwise it will first attempt to complete
 all the jobs which had been pending for the past one week first before
 moving on.

Correct, unless configured otherwise.

 This kind of behaviour does not make sense, is there anything
 I am missing?

In the manual, chapter Configuring the Director, look at the job
resources. You'll find some Max something Delay and Max something
Time directives. These probably are what you need for the future.

Arno

 If some one can please help.

 Regards


 


-
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/


 

 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
IT-Service Lehmann[EMAIL PROTECTED]
Arno Lehmann  http://www.its-lehmann.de

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Current version of bat

2007-05-15 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Kern Sibbald wrote:
 Hello,
 
 On Thursday 10 May 2007 02:20, Berend Dekens wrote:
 Arno Lehmann wrote:
 Hi,

 On 5/9/2007 10:27 PM, Christopher Schwerdt wrote:
 What about status icons?
 Yes, great idea.  We would like to use icons but don't have any good 
 ones.
 For
 example, our current Status dir and Messages button icons are
 identical.
 I'm not a designer and cannot create such icons, and I suspect it is the
 same
 for Dirk.

 Contributions anyone?
 Silk is a good looking and free icon pack: 
 http://www.famfamfam.com/lab/icons/silk/
 No tape icons :-(

 Or, more general, the focus of bat would probably require more
 specialized icons.

 Arno

 How about specifying what icons would be needed for BAT? I'm sure if you
 gave a list of icons you would need a designer would much faster take a
 crack at it...
 
 OK, I have included a screen shot of the current Bacula.  One could easily 
 start on the tool bar icons.  From left to right, the icons are:
 
 - Connect (connect to director) -- there is a corresponding disconnected icon
  as well.
 - Status dir
 - Messages
 - Label
 - Restore
 - Run a job
 - Undock current window (in right pane)
 
 Note, Status dir and Messages are the same icon.
 
 What I think is most important is the following:
 1. To have different Status dir and Messages Icons
 2. To have a better Icon for Undock
 3. Possibly have a better icon for run
 4. Examine the other icons
 
 I've included attached a copy of all those icons.
 
 Finally, in addition to the up arrow icon, which serves as both the undock 
 tool bar button as well as the up one directly level in the restore point and 
 click, there are mark and unmark buttons, which are not too bad, but blue 
 compared to the green up arrow (also a different style).
 
 I've also included a screen dump of the restore window (a bit squeezed to 
 reduce the size).
 
 Any help with these or other icons would be very welcome.

I'm not sure how possible this is, but for a layperson it would SEEM
likely to be possible -- couldn't the native Qt icon sets for directory
listings/file picker be used rather than text? I think it would make the
GUI look much more like a GUI than the occasional
text-inside-a-graphics-window look that it has in some places now.

IANA KDE/Qt programmer though. :)

- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer III
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFGSfgemb+gadEcsb4RArL3AJ4xfC9q1oYkhzRRlBLSu6wVWfQc3ACgytPX
2QP0siFWYDGXMeHO/PMdhoM=
=T9s0
-END PGP SIGNATURE-


-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Auto-reuse

2007-05-15 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Andy Collyer wrote:
 Hello,

 On 5/11/2007 10:54 AM, Andy Collyer wrote:
 I want to *always* automatically re-use my tapes.  I can
 achieve this
 manually by using bconsole's SQL query mode and updating
 the Media table:
 update Media set VolStatus = Recycle [ WHERE ... ]; 
 However, once 
 the Volume is used, the Media table entry is re-set to 
 Append, so 
 next time the volume is used it isn't recycled. What's
 making bacula
 update the Media table?
 Running a backup job.

 And more importantly, how do I stop it?

 You need to not force this behavior with SQL but to use 
 the recycle 
 directives in bacula-dir.conf
 Well, I thought I had ... Relevant sections of bacula-dir.conf:

 Job {
   Name = BackupHome
   Type = Backup
   Level = Full
   Client = Server-fd
   FileSet = Home
   Storage = DLT-V4
   Pool = AC-recycle
   Priority = 10
   Messages = Standard
   Schedule = DailyCycle
 }

 Pool {
   Name = AC-recycle
   PoolType = Backup
   Recycle = yes
   AutoPrune = yes
   VolumeRetention = 0 days
   Maximum Volume Bytes = 148118648832
   Recycle Current Volume = yes
   LabelFormat = Recycle-
 }

 What am I missing or doing wrong???
 Well, by now I learned that a volume retention of indicates 
 to not ever prune a volume.

 So, my advice would be to set up your retention times 
 according to your needs.

 Arno

 
 Think I've got it - Pool should include:
 
   Use Volume Once = yes

I believe this is deprecated and no longer has any effect. I think you
want Maximum Volume Jobs = 1.

- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer III
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFGSfsOmb+gadEcsb4RAte3AKDMPwwY4C5c9tVZd1rfBg0wfg+0KQCgkYv8
gr8X8t4RjKia6GRXBidqa0I=
=HrHN
-END PGP SIGNATURE-


-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] bconsole missing?

2007-05-15 Thread Drew Myers

Hi,

I recently built bacula from source (v2.0.3) on RHEL4 ES. Here's the
configuration options I specified at build-time:

$ ./configure --prefix=/usr --sbindir=/usr/sbin --sysconfdir=/etc/bacula
--with-scriptdir=/etc/bacula --enable-smartalloc --with-postgresql
--with-working-dir=/var/bacula --with-pid-dir=/var/run
--with-subsys-dir=/var/lock/subsys --enable-conio

I have the bconsole config file: /etc/bacula/bconsole, but there is no
bconsole binary in /usr/sbin. 

Can someone help identify what I did wrong?

Thanks,

Drew

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Rif: Bacula Network Performance

2007-05-15 Thread Jordan Desroches

So it doesn't look like the MySQL process is tanking the system at all. I
increased cache sizes in MySQL with no effect, along with buffer sizes in
sysctl.conf .  I also tried using SQLite , and got marginally better
throughput. Has anyone seen significantly 30 MB/s over a gig line on
backup?

Thanks,

Jordan
-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Rif: Bacula Network Performance

2007-05-15 Thread Ralf Gross
Jordan Desroches schrieb:
 So it doesn't look like the MySQL process is tanking the system at all. I
 increased cache sizes in MySQL with no effect, along with buffer sizes in
 sysctl.conf .  I also tried using SQLite , and got marginally better
 throughput. Has anyone seen significantly 30 MB/s over a gig line on
 backup?

Spooling transfer rate:
Job write elapsed time = 01:17:50, Transfer rate = 49.64 M bytes/second

Despooling to tape:
Despooling elapsed time = 00:55:10, Transfer rate = 70.11 M bytes/second

Average:
Rate:   26546.5 KB/s

I guess my average transfer rate could be higher, if I would not use
spooling. I'm not running concurrent jobs.

Ralf
~


-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Rif: Bacula Network Performance

2007-05-15 Thread Arno Lehmann
Hi,

On 5/15/2007 9:52 PM, Jordan Desroches wrote:
 So it doesn't look like the MySQL process is tanking the system at all. 
 I increased cache sizes in MySQL with no effect, along with buffer sizes 
 in sysctl.conf .  I also tried using SQLite , and got marginally better 
 throughput. Has anyone seen significantly 30 MB/s over a gig line on 
 backup?

Yes, but on setups where multiple jobs from different clients run in 
parallel.

Each job might have a slower throughput, but the overall (estimated) 
network throughput is close to the real-life maximum of about 60 to 80 MB/s.

I don't have access to these systems at the moment, though, so I can't 
check if I recall correctly.

Arno

 Thanks,
 
 Jordan
 
 
 
 
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 
 
 
 
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
IT-Service Lehmann[EMAIL PROTECTED]
Arno Lehmann  http://www.its-lehmann.de

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] How often to backup the catalog database?

2007-05-15 Thread Peter Crighton
I am using conf files based on the defaults, with times changed. To
summarise, my backups are:

Linux server home files daily at 11:00
Linux server shares (i.e. my key files shared to other PCs) daily at
11:00
Above on a daily incremental / weekly differential / monthly full
cycle

Windows client files at 19:00 incremental daily / 11:00
full/differential on Saturdays (weekly/monthly)

The catalog is backed up daily at 11:10, Full every day.

The question - should I be backing up the catalog after each evenings
Windows files? I don't think so (this is a home environment). I think
that the only thing that could go wrong by not doing so is to lose the
ability to restore from one incremental backup of the Windows files
(if the worst happened and the server needed re-building). Is that
correct?

[The only reason for having a different time for the Windows
incremental backup is that it is not normally on during weekdays]
--

Peter Crighton

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] behavior in case of errors

2007-05-15 Thread Arno Lehmann
Hi,

On 5/15/2007 7:29 PM, Naufal Sheikh wrote:
 Hey,
 
 thanks for your help. Just few clarifications. For the Max Wait Time,  
 the time specified is in min or sec? Or can I just write 25 min or 300 
 sec.

Hmm. I'm unsure... there was some problem with these times a while ago 
where it didn't honor the time units, but also didn't abort with an 
error when parsing the configuration. I think this as been fixed, though.

I'm using, for example, Max Start Delay = 23h and this works as expected.

If unsure, simply don't use a qualifier like 'hours' and Bacula will 
interpret your numbers as seonds.

So, '300' should be identical to '5 min'.

 Secondly if i want this to be global parameter for all the jobs, I 
 should be mentioning it in the jobdefs right?

Yes.

Arno

 Thanks
 
 On 5/14/07, *Arno Lehmann* [EMAIL PROTECTED] 
 mailto:[EMAIL PROTECTED] wrote:
 
 Hi,
 
 On 5/14/2007 5:04 PM, Naufal Sheikh wrote:
   Hi,
  
   i was running bacula and then went on vacations. In the meantime
 due to
   some error which required human intervention, bacula just got
 stuck on
   that job and please correct me if I am wrong bacula does not
 carry on to
   next jobs if it get stuck in case of any error.
 
 Depends... the above is one good reason for allowing multiple concurrent
 jobs, and there are configuration directives to limit the time a job can
 wait and run before it's automatically cancelled.
 
 All three options might be useful in your situation.
 
   when I do list jobs it
   shows me lot of jobs which haven't been started but are there in the
   list. Should I just cancel them to start the bacula at the point of
   today's schedule?
 
 That depends on what you want, but it's definitely an option.
 
   I believe otherwise it will first attempt to complete
   all the jobs which had been pending for the past one week first
 before
   moving on.
 
 Correct, unless configured otherwise.
 
   This kind of behaviour does not make sense, is there anything
   I am missing?
 
 In the manual, chapter Configuring the Director, look at the job
 resources. You'll find some Max something Delay and Max something
 Time directives. These probably are what you need for the future.
 
 Arno
 
   If some one can please help.
  
   Regards
  
  
  
 
  
  
 -
 
   This SF.net email is sponsored by DB2 Express
   Download DB2 Express C - the FREE version of DB2 express and take
   control of your XML. No limits. Just data. Click to get it now.
   http://sourceforge.net/powerbar/db2/
  
  
  
 
  
   ___
   Bacula-users mailing list
   Bacula-users@lists.sourceforge.net
 mailto:Bacula-users@lists.sourceforge.net
   https://lists.sourceforge.net/lists/listinfo/bacula-users
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 
 --
 IT-Service Lehmann[EMAIL PROTECTED]
 mailto:[EMAIL PROTECTED]
 Arno Lehmann  http://www.its-lehmann.de
 
 -
 
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 mailto:Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 
 
 
 
 
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 
 
 
 
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
IT-Service Lehmann[EMAIL PROTECTED]
Arno Lehmann  http://www.its-lehmann.de

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/

Re: [Bacula-users] Changing Directors. -- Redux

2007-05-15 Thread Flak Magnet
Thanks for the responses, Mike and Arno.

It went easily and trouble-free enough, given the complexity and 
inter-relation between the config files that life on multiple hosts.

On Monday 14 May 2007 4:28:23 pm Arno Lehmann wrote:
  I've been using mySQL.  I know how to get a dump of the database out, and
  how to read that database back in.  I intend to use that to migrate the
  database to the mySQL server on the new director.  I don't think that
  will cause any problems.  I'm open to being corrected.

 I don't think you'll encounter problems there.

Not a single problem.

  With the director moving off of the original sun machine, I'm going to
  rename the sd and fd on that machine.  If I have to do restores, I know
  that I'll have to change the restore-from devices and such.  Currently
  their named bacula-sd and bacula-fd.  I intend to change them to
  [hostname]-fd/sd.  Are there any snafus I might encounter there?

 Just keep in mind that you'll have to start with a full backup again to
 allow simple full restores. I don't know if Bacula enforces that, but I
 suspect it will, because the FD name and FileSet ID combination is
 (IIRC) how Bacla identifies identical jobs.

Bacula did not enforce a full backup on the renamed SD or FD, which I found 
interesting.  I know it triggers an upgrade to Full if the fileset changes.  
I'm curious why it didn't with the new SD/FD names.  I did just re-use the 
same passwords and of course the hostnames stayed the same.

As I mentioned, I wanted to rename the FD and SD that I'd been using on the 
old director.  I have tested running a couple restores using volumes that 
were written before the FD and SD changed names and bacula handled the new 
names of both the SD and FD gracefully, so, my concerns, and the concerns of 
Mr. Lewinger can be laid to rest.

Note that I did not change the names of the devices on the SD, just the name 
in the Storage definition in the director and in the bacula-sd.conf, as well 
as updating it in the appropriate places for pool/job/schedule definition.  
Okay, so I guess I changed it in a lot of places.  

  Anything else?

 I don't think so... in any case, keep a copy of the catalog before
 migration, and only decomssion the old DIR after you ran all backups
 successfully with the new one.

Of course!  If at all possible, and unless I screw up, I always try to keep 
the go back to what was working option available.

I wish that practice was born out of foresight and intelligence instead of 
painful experience. *grin*

-- 
-- Flak Magnet (Tim)
www.flakmagnet.com

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How often to backup the catalog database?

2007-05-15 Thread Arno Lehmann
Hello,

On 5/15/2007 10:56 PM, Peter Crighton wrote:
 I am using conf files based on the defaults, with times changed. To
 summarise, my backups are:
 
 Linux server home files daily at 11:00
 Linux server shares (i.e. my key files shared to other PCs) daily at
 11:00
 Above on a daily incremental / weekly differential / monthly full
 cycle
 
 Windows client files at 19:00 incremental daily / 11:00
 full/differential on Saturdays (weekly/monthly)
 
 The catalog is backed up daily at 11:10, Full every day.
 
 The question - should I be backing up the catalog after each evenings
 Windows files? I don't think so (this is a home environment). I think
 that the only thing that could go wrong by not doing so is to lose the
 ability to restore from one incremental backup of the Windows files
 (if the worst happened and the server needed re-building). Is that
 correct?

Yes. And your catalog will be confused aout the volume usage after a 
rebuild, but Bacula will usually notice that and handle it correctly.

In your situation, the decision to not back up the catalog after the 
windows files sounds reasonable.

Arno

 [The only reason for having a different time for the Windows
 incremental backup is that it is not normally on during weekdays]
 --
 
 Peter Crighton
 
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
IT-Service Lehmann[EMAIL PROTECTED]
Arno Lehmann  http://www.its-lehmann.de

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users