[Bacula-users] Job vs volume retention periods

2009-06-24 Thread phatrik

Hi,

I'm confused in regards to job retention vs volume retention.  From the little 
bit I understand, if the volume retention period is passed and bacula is unable 
to find any other appendable volumes in the client's stoarge pool, it will 
delete all file and job records and then re-use that volume.  However, how 
about if all the jobs in that volume have been pruned but the volume retention 
period hasn't passed yet (and of course recycling is enabled) Will bacula still 
re-use the volume since no more jobs remained after they've all been pruned?  
If it does, what's the purpose of having a volume retention period which is 
usually without a doubt longer than the job retention period?  If it doesn't, 
what's the point of keeping a volume which doesn't contain jobIDs which can't 
be restored anymore?  


thanks in advance,



Erik

+--
|This was sent by erik.go...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Passing the current Storage to a Run Before Job script

2009-06-24 Thread teksupptom

Greetings!

I'm hopeful that someone can give us a little help. We currently run Bacula 
2.4.4. We have backups run on two storage devices, and each device has its own 
spool file directory. We've created a script that will check the spool 
directory at the start of each job to make sure that it's empty, since we've 
had a few issues with Bacula not deleting files due to crashes.

The issue comes in when we have to run a job on the other drive. For example, 
twice a year we run full backups of all of our file sets to be stored offsite. 
During this period, jobs that would normally run on our second tape drive are 
manually run on the primary drive instead, so that the second drive can be 
devoted to the offsite jobs. Unfortunately, the spool check script doesn't know 
about the storage change, so it will end up clobbering a valid spool file for 
the secondary drive, instead of checking the directory for the primary drive.

I've tried to find a variable to pass to the Run Before Job command to tell 
it the actual current storage, but have had no luck (${Storage} doesn't expand 
during the call). Does anyone know of a way to pass the storage to the script 
(without using Python)?

Thank You,
Tom

+--
|This was sent by tomisom.s...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Release Drive0 no longer works (99% of time)

2009-06-24 Thread terryc
Has anyone else running Debian Lenny had/have this problem?

Since upgrading from Debian Etch to Debian Lenny, I have found that 
release Drive0 does not unrelease the tape (DEC DLT single tape) in 
99% of occassions.

The message about drive waiting for sysop is still printed on the 
consol, but I now have to (99% of time) enter a unmount Drive0 command 
at the console, before it will unload the tape.

InitiallyI thought it might have been related to replacing the adaptec 
scsi card with a qlogic scsi card, which occurred at the same time as 
the distribution upgrade, but the adaptec card has returned to this 
system and the problem still persists.

Does anyone have any ideas of causes?

I suspect that yet another righteous dabble has been carried out in some 
application in Debian and this lack of functionlity in the scsi system 
is the result.

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Job vs volume retention periods

2009-06-24 Thread Fahrer, Julian
Hi Erik,

volumes will only be reused after the volume retention period is reached.
And the point of keeping a volume which doesn't contain jobIDs is that you 
could import the tape or recover data from it using btape since it still 
contains all files.

Kind regards

Julian


-Ursprüngliche Nachricht-
Von: phatrik [mailto:bacula-fo...@backupcentral.com] 
Gesendet: Mittwoch, 24. Juni 2009 03:46
An: bacula-users@lists.sourceforge.net
Betreff: [Bacula-users] Job vs volume retention periods


Hi,

I'm confused in regards to job retention vs volume retention.  From the little 
bit I understand, if the volume retention period is passed and bacula is unable 
to find any other appendable volumes in the client's stoarge pool, it will 
delete all file and job records and then re-use that volume.  However, how 
about if all the jobs in that volume have been pruned but the volume retention 
period hasn't passed yet (and of course recycling is enabled) Will bacula still 
re-use the volume since no more jobs remained after they've all been pruned?  
If it does, what's the purpose of having a volume retention period which is 
usually without a doubt longer than the job retention period?  If it doesn't, 
what's the point of keeping a volume which doesn't contain jobIDs which can't 
be restored anymore?  


thanks in advance,



Erik

+--
|This was sent by erik.go...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] File daemon at .... rejected Hello command

2009-06-24 Thread Gavin McCullagh
Hi,

On Tue, 23 Jun 2009, Arno Lehmann wrote:

 and welcome here! I hope you find all the advice you need here - and 
 I'm sure you'll be able to halp others, too!

Thanks.  I have so far :-)

Gavin



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restoring large directory does not work

2009-06-24 Thread Martin Simmons
 On Tue, 23 Jun 2009 16:09:57 -0700, mehma sarja said:
 
 
  Did you wait till the cpu went back to low cpu usage?
 
 No, it stays high overnight and my patience runs out before cpu pegging
 does.

I suggest attaching gdb to the bacula-dir process to see what it is doing,
e.g.

thread apply all bt

Then detach gdb, let it run some more, and do the above again to see how it
differs.

You might need to build a debugging version of Bacula to get useful
backtraces.

__Martin

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] dir and sd hang

2009-06-24 Thread Attila Fülöp
Silver Salonen wrote:
 On Tuesday 16 June 2009 15:08:29 Attila Fülöp wrote:
 Silver Salonen wrote:
 Hi.

 I use Bacula 3.0.0 on FreeBSD-6.3. The problem I have is that DIR and SD 
 tend 
 to hang often, and it seems one causes another, because they do it 
 together 
 mostly. Sometimes it happens between jobs, sometimes it happens before all 
 the 
 jobs. The only possibility unlock the processes is to kill them with -9 
 and 
 start again. After that backups work usually a few days and then the 
 processes 
 hang again.


Silver,

not sure if you have already seen this:
http://security.freebsd.org/advisories/FreeBSD-EN-09:04.fork.asc
Maybe this patch will fix your problems with FreeBSD 7.0.

Attila

 Anyone else experiencing this?
 I fixed thread related bacula 2.2.8 stability issues by moving from 6.3-
 RELEASE
 to 6.3-STABLE. It has a threadlib patch which 6.3-RELEASE has not. The issue 
 was
 that concurrent backups would after a while result in a locked dir and sd.

 So your problem sounds related and you may give 6.3-STABLE a try. I would
 appreciate any feedback since we are planing to update to 3.0.x. Stability
 issues would of course change our modus operandi.

 HTH

 Attila
 
 Well, Bacula SD had a 'hang issue' in 2.4.4 too, but it got patched (and it 
 was different..). After the patch it worked very well.
 
 About the issue in 3.0.0 - I actually see the same thing on FreeBSD-7.0 as 
 well, so I guess moving the one server from 6.3-RELEASE to STABLE won't fix 
 that.
 


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Job vs volume retention periods

2009-06-24 Thread Dirk Bartley
On Wed, 2009-06-24 at 09:14 +0200, Fahrer, Julian wrote:
 Hi Erik,
 
 volumes will only be reused after the volume retention period is reached.
 And the point of keeping a volume which doesn't contain jobIDs is that you 
 could import the tape or recover data from it using btape since it still 
 contains all files.

Greetings

Julian is correct with exceptions.

  Recycle Oldest Volume = yes
  Recycle Current Volume = yes
  PurgeOldestVolume = yes

Warning, the following description may not be perfect:

I use recycle oldest and purge oldest.  This way, the job records can be
maintained in the catalog with an unresonably long job retention period.
When the director completes jobs, it will still perform pruning
operations pruning file records.

Then when the director goes to schedule a job, it will purge job records
from the volume and label it recycled if all jobs have had their file
records pruned.  The volume chosen to recyle will be the one that has
not been written to for the longest period.

The status dir will show the recycled volume as the volume scheduled to
use.

For instance, I have a pool with two tapes for Tuesday and Thursday.  I
want to use it four times then have it schedule using the othe tape
rotating every two weeks.

Pool {
  Name = LTO_TueThu
  Pool Type = Backup
  Recycle = yes   
  AutoPrune = yes   
  Volume Retention = 16 Days 
  Volume Use Duration = 10 Days 
  Recycle Oldest Volume = yes
  PurgeOldestVolume = yes
  Storage = LTO
}


Set it up recently and it seems to work so far.  Best of luck.  The
documentation is awesome because there are so many possible parameters.
The one thing that may be missing is more recipes from current users.

Dirk

 
 Kind regards
 
 Julian
 
 
 -Ursprüngliche Nachricht-
 Von: phatrik [mailto:bacula-fo...@backupcentral.com] 
 Gesendet: Mittwoch, 24. Juni 2009 03:46
 An: bacula-users@lists.sourceforge.net
 Betreff: [Bacula-users] Job vs volume retention periods
 
 
 Hi,
 
 I'm confused in regards to job retention vs volume retention.  From the 
 little bit I understand, if the volume retention period is passed and bacula 
 is unable to find any other appendable volumes in the client's stoarge pool, 
 it will delete all file and job records and then re-use that volume.  
 However, how about if all the jobs in that volume have been pruned but the 
 volume retention period hasn't passed yet (and of course recycling is 
 enabled) Will bacula still re-use the volume since no more jobs remained 
 after they've all been pruned?  If it does, what's the purpose of having a 
 volume retention period which is usually without a doubt longer than the job 
 retention period?  If it doesn't, what's the point of keeping a volume which 
 doesn't contain jobIDs which can't be restored anymore?  
 
 
 thanks in advance,
 
 
 
 Erik
 
 +--
 |This was sent by erik.go...@gmail.com via Backup Central.
 |Forward SPAM to ab...@backupcentral.com.
 +--
 
 
 
 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 
 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Rewind permissions error in SD (UNCLASSIFIED)

2009-06-24 Thread Swartzbaugh, Richard A CTR DISA EUR
Classification:  UNCLASSIFIED 
Caveats: NONE

I have installed Bacula on a Solaris 10 system using a StorEdge C2 tape
jukebox.  When I try to label a tape, I get the following error:  Unable
to open device SDLT1-Drive (/dev/rmt/0mbn): ERR=Permission denied

Using the mt command (mt -f /dev/rmt/0mbn rewind), I can rewind the tape
without errors.

I ran the bacula-sd daemon in debug mode and got the output below.  It
appears that the rewind of the tape following the open fails due to
permission problems (even though all 3 daemons are running as root and
/dev/rmt/0mbn has 666 permissions).  

Line 441 in dev.c is after a d_ioctl() rewind call that apparently
fails.

backups-bge0-sd: dev.c:336-0 Close fd for mode change.
backups-bge0-sd: dev.c:345-0 open dev: type=2 dev_name=SDLT-Drive
(/dev/rmt/0mbn) vol=test118 mode=OPEN_READ_WRITE
backups-bge0-sd: dev.c:394-0 Open dev: device is tape
backups-bge0-sd: dev.c:409-0 Try open SDLT1-Drive (/dev/rmt/0mbn)
mode=OPEN_READ_WRITE
backups-bge0-sd: dev.c:431-0 Rewind after open
backups-bge0-sd: dev.c:441-0 Rewind error on SDLT1-Drive
(/dev/rmt/0mbn) close: ERR=Permission denied
backups-bge0-sd: dev.c:475-0 dev.c:474 Unable to open device
SDLT1-Drive (/dev/rmt/0mbn): ERR=Permission denied
backups-bge0-sd: dev.c:483-0 open dev: tape -1 opened
backups-bge0-sd: dev.c:358-0 preserve=0x0 fd=-1
backups-bge0-sd: dev.c:1892-0 Clear volhdr vol=
backups-bge0-sd: vol_mgr.c:562-0 vol_unused: no vol on SDLT1-Drive
(/dev/rmt/0mbn)


Any ideas?

Thanks,
Andy

Classification:  UNCLASSIFIED 
Caveats: NONE


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Upgrading from bacula 2 to 3

2009-06-24 Thread Assaf Flatto
Hello 

I am a newbie in bacula , I've inherited it from another admin .
I saw the our version is an old version and i wanted to upgrade to the latest 
version , i looked at 
the bacula documentation to see if there is an upgrade procedure and couldn't 
find any .

Is there an unofficial guide as to how to upgrade from version 2 to version 3 
of bacula ?

Thank you 
-- 
Assaf Flatto




IMPORTANT . this email and the information in it may be confidential, legally
privileged and/or protected by law. It is intended solely for the use of the
person to whom it is addressed. If you are not the intended recipient, please
notify the sender immediately and do not disclose the contents to any other
person, use it for any purpose, or store or copy the information in any medium.
Please also delete all copies of this email and any attachments from your
system.

We cannot guarantee the security or confidentiality of email communications. We
do not accept any liability for losses or damages that you may suffer as a
result of your receipt of this email including but not limited to computer
service or system failure, access delays or interruption, data non-delivery or
mis-delivery, computer viruses or other harmful components.

Copyright in this email and any attachments belong to Select Service Partner UK
Limited. Should you communicate with anyone at Select Service Partner UK 
Limited by
email, you consent to us monitoring and reading any such correspondence.

Nothing in this email shall be taken or read as suggesting, proposing or
relating to any agreement concerted practice or other practice that could
infringe UK or EC competition legislation.

Select Service Partner UK Limited is a company registered in England and Wales
(company number 05687183) whose registered office is at 1 The Heights, 
Brooklands, Weybridge. Surrey. KT13 0NY
 
 

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Upgrading from bacula 2 to 3

2009-06-24 Thread Dirk Bartley



On Wed, 2009-06-24 at 16:30 +, Assaf Flatto wrote:
 Hello 
 
 I am a newbie in bacula , I've inherited it from another admin .
 I saw the our version is an old version and i wanted to upgrade to the latest 
 version , i looked at 
 the bacula documentation to see if there is an upgrade procedure and 
 couldn't find any .

First get a good catalog backup.  Also make sure that you have a backup
of the /etc/bacula as well.  tar -czf /etc/bacula.tgz /etc/bacula just
to have that easy to get to.

http://www.bacula.org/manuals/en/install/install/Installing_Bacula.html#SECTION0032

Most all syntax of the config files will migrate.  So that should not be
a problem.  There is usually just the update to the db schema.

Dirk


 
 Is there an unofficial guide as to how to upgrade from version 2 to version 3 
 of bacula ?
 
 Thank you 


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Upgrading from bacula 2 to 3

2009-06-24 Thread Michel Meyers
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Assaf Flatto wrote:
 Hello 
 
 I am a newbie in bacula , I've inherited it from another admin .
 I saw the our version is an old version and i wanted to upgrade to the latest 
 version , i looked at 
 the bacula documentation to see if there is an upgrade procedure and 
 couldn't find any .
 
 Is there an unofficial guide as to how to upgrade from version 2 to version 3 
 of bacula ?

You might want to check the release notes, especially the bit about the
catalog format changes:

http://sourceforge.net/project/shownotes.php?group_id=50727release_id=679402

Other than SQL schema changes, there's rarely something you have to
modify, but watch out and double check your config files anyway, and of
course monitor Bacula more closely after the upgrade.

Greetings,
  Michel
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (MingW32)

iEYEARECAAYFAkpCYK0ACgkQ2Vs+MkscAyVDlACgsh0sFD9onspwSB82wwnb6JYr
mmQAniIJIxt7e4ZiH7Y5AjBGhtiCfFOX
=N++Y
-END PGP SIGNATURE-


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restoring large directory does not work

2009-06-24 Thread mehma sarja
I got into gdb but know very little how to move around in there. I tried:

[r...@lucifer ~]# gdb /usr/local/sbin/bacula-dir 27410
GNU gdb 6.1.1 [FreeBSD]
This GDB was configured as amd64-marcel-freebsd...(no debugging symbols
found)...
Attaching to program: /usr/local/sbin/bacula-dir, process 27410
Reading symbols from /usr/local/lib/libpq.so.5...(no debugging symbols
found)...done.
Loaded symbols for /usr/local/lib/libpq.so.5
Reading symbols from /lib/libcrypt.so.4...(no debugging symbols
found)...done.
Loaded symbols for /lib/libcrypt.so.4
Reading symbols from /lib/libthr.so.3...(no debugging symbols found)...done.
[New Thread 0x801a10300 (LWP 100334)]
[New Thread 0x801902600 (LWP 100329)]
[New Thread 0x801902480 (LWP 100192)]
[New Thread 0x801902180 (LWP 100350)]
Loaded symbols for /lib/libthr.so.3
Reading symbols from /usr/local/lib/libintl.so.8...(no debugging symbols
found)...done.
Loaded symbols for /usr/local/lib/libintl.so.8
Reading symbols from /usr/lib/libwrap.so.5...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/libwrap.so.5
Reading symbols from /usr/local/lib/libiconv.so.3...(no debugging symbols
found)...done.
Loaded symbols for /usr/local/lib/libiconv.so.3
Reading symbols from /usr/lib/libssl.so.5...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/libssl.so.5
Reading symbols from /lib/libcrypto.so.5...(no debugging symbols
found)...done.
Loaded symbols for /lib/libcrypto.so.5
Reading symbols from /usr/lib/libstdc++.so.6...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/libstdc++.so.6
Reading symbols from /lib/libm.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.5
Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols
found)...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libc.so.7...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.7
Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols
found)...done.
Loaded symbols for /libexec/ld-elf.so.1
[Switching to Thread 0x801a10300 (LWP 100334)]
0x0040c043 in add_findex ()
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Firewall fun

2009-06-24 Thread Dirk Bartley

On Tue, 2009-06-23 at 21:52 +0200, Arno Lehmann wrote:
 Hi,
 
 23.06.2009 17:04, Dirk Bartley wrote:
  Sure,  iptables allows for connection based rules as well as the old
  ipchains style rules based rules.
  
  So your probably using connection based rules like :
  iptables -A INPUT -p tcp -m state --state ESTABLISHED -j ACCEPT 
  iptables -A OUTPUT -p tcp -m state --state NEW,ESTABLISHED -j ACCEPT
  
  just add something like
  
  iptables -A INPUT -p tcp --source fd_dmz_ipaddress --destination
  sd_internal_address --dport 9103 ACCEPT
 
 Yup. That should work.
 
 But back to your problem, Dirk: Have you tried the heartbeat 
 interval setting? That should generate some traffic so that the pix 
 doesn't time-out the seemingly stale connection.

Tried 2 different things and on of them fixed it.  Added heartbeat
interval = 90 to the file daemon in the dmz and also added sysopt
connection timewait to the firewall.  One of the two fixed it, well at
least I got a good full backup last night.

Thanks for the suggesion!

Dirk

 
 Arno



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restoring large directory does not work

2009-06-24 Thread mehma sarja
(gdb) thread apply all bt

Thread 4 (Thread 0x801902180 (LWP 100350)):
#0  0x0008016f98cc in nanosleep () from /lib/libc.so.7
#1  0x0008009078c5 in nanosleep () from /lib/libthr.so.3
#2  0x0044e21e in bmicrosleep ()
#3  0x0042408d in wait_for_next_job ()
#4  0x00408a3c in main ()

Thread 3 (Thread 0x801902480 (LWP 100192)):
#0  0x000801715afc in select () from /lib/libc.so.7
#1  0x0008009074d4 in select () from /lib/libthr.so.3
#2  0x0044f9b2 in bnet_thread_server ()
#3  0x00438ba8 in connect_thread ()
#4  0x000800908a27 in pthread_getprio () from /lib/libthr.so.3
#5  0x in ?? ()
Error accessing memory address 0x7fbff000: Bad address.
#0  0x0040c043 in add_findex ()
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Upgrading from bacula 2 to 3

2009-06-24 Thread Timo Neuvonen
 I am a newbie in bacula , I've inherited it from another admin .
 I saw the our version is an old version and i wanted to upgrade to the
 latest version , i looked at
 the bacula documentation to see if there is an upgrade procedure and
 couldn't find any .

 Is there an unofficial guide as to how to upgrade from version 2 to
 version 3 of bacula ?


I may not be able to help much, but to get any more detailed advice, find
out and provide this information:
- on what OS your current Bacula server runs
- more precisely, what version it is, like 2.0.x or 2.4.x
- find out how it was installed: using some OS-spesific package manager
(like rpm in Red Hat based systems), or was it possibly compiled on-site
from a tarball
- some gurus might want to know what database (like MySQL) is used

If this is an install from eg. rpm-packages provided by Bacula developers,
the upgrade could be very straightforward and automatic process. On the
other side, some packages (like for Debian, AFAIK) may be built by OS
packagers and not by Bacula developers at all, and in that case you'd better
to search for information in OS-spesific forums too.

--
TiN



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restoring large directory does not work

2009-06-24 Thread Martin Simmons
 On Wed, 24 Jun 2009 10:41:03 -0700, mehma sarja said:
 
 (gdb) thread apply all bt
 
 Thread 4 (Thread 0x801902180 (LWP 100350)):
 #0  0x0008016f98cc in nanosleep () from /lib/libc.so.7
 #1  0x0008009078c5 in nanosleep () from /lib/libthr.so.3
 #2  0x0044e21e in bmicrosleep ()
 #3  0x0042408d in wait_for_next_job ()
 #4  0x00408a3c in main ()
 
 Thread 3 (Thread 0x801902480 (LWP 100192)):
 #0  0x000801715afc in select () from /lib/libc.so.7
 #1  0x0008009074d4 in select () from /lib/libthr.so.3
 #2  0x0044f9b2 in bnet_thread_server ()
 #3  0x00438ba8 in connect_thread ()
 #4  0x000800908a27 in pthread_getprio () from /lib/libthr.so.3
 #5  0x in ?? ()
 Error accessing memory address 0x7fbff000: Bad address.
 #0  0x0040c043 in add_findex ()

The function add_findex is interesting, but I think like your bacula-dir was
compiled without debugging info so it is difficult to see what is happening.

Try the following gdb commands (I assume you are running 64-bit FreeBSD):

break *add_findex
commands
printf arguments: %x %x %x\n, $rdi, $rsi, $rdx
end
continue

This sets a breakpoint at the start of the function add_findex to print the
arguments and starts Bacula running again.  It should stop in gdb when it
reaches the beginning of add_findex again (with a message like Breakpoint
1...in add_findex...).

When it stops, enter the continue command again and time how long it takes
before it stops again.

Do this a few times and post the results (including the arguments: output).

__Martin

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Overriding Job and/or File Retention Periods?

2009-06-24 Thread teksupptom

Greetings!

Is there any way, in Bacula 2.4.4, to override the File and/or Job retention 
period in either the Job, Schedule, or FileSet resource? The reason I ask is 
that we have a couple of filesets that are extremely large, but only on a 
handful of clients. We don't have the space to restore these sets except 
'in-place', so we were looking for a way to keep the files/jobs for those jobs 
in the catalog until the volumes themselves were purged.

Any ideas are appreciated :)

Tom

+--
|This was sent by tomisom.s...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Rewind permissions error in SD (UNCLASSIFIED)

2009-06-24 Thread Arno Lehmann
Hi,

24.06.2009 16:57, Swartzbaugh, Richard A CTR DISA EUR wrote:
 Classification:  UNCLASSIFIED 
 Caveats: NONE
 
 I have installed Bacula on a Solaris 10 system using a StorEdge C2 tape
 jukebox.  When I try to label a tape, I get the following error:  Unable
 to open device SDLT1-Drive (/dev/rmt/0mbn): ERR=Permission denied
 
 Using the mt command (mt -f /dev/rmt/0mbn rewind), I can rewind the tape
 without errors.
 
 I ran the bacula-sd daemon in debug mode and got the output below.  It
 appears that the rewind of the tape following the open fails due to
 permission problems (even though all 3 daemons are running as root and
 /dev/rmt/0mbn has 666 permissions).  

Hmm... I don't know this from Solaris, but with FreeBSD I recall 
something similar. In that case, a proper devfs.conf worked wonders!
(Even though you would assume that root could access the device anyway...)

Then, of course ACLs might prevent the SD from fully accessing the 
tape device - see getfacl et al.

With Solaris, in addition to the automatic permission assignment at 
device detection, there is also role-based access control, which is 
managed with tools like ppriv, roleadd, usermod with -R option, and 
probably others - this is where my knowledge ends :-)

Finally, Solaris is said to allow access to devices to only one user 
at a time - you can check which devices are in use by which user with 
list_devices. I guess it's possible that this feature might be the 
reason for your problems, too.

No you've got some ideas - have fun with them!

Arno


 Line 441 in dev.c is after a d_ioctl() rewind call that apparently
 fails.
 
 backups-bge0-sd: dev.c:336-0 Close fd for mode change.
 backups-bge0-sd: dev.c:345-0 open dev: type=2 dev_name=SDLT-Drive
 (/dev/rmt/0mbn) vol=test118 mode=OPEN_READ_WRITE
 backups-bge0-sd: dev.c:394-0 Open dev: device is tape
 backups-bge0-sd: dev.c:409-0 Try open SDLT1-Drive (/dev/rmt/0mbn)
 mode=OPEN_READ_WRITE
 backups-bge0-sd: dev.c:431-0 Rewind after open
 backups-bge0-sd: dev.c:441-0 Rewind error on SDLT1-Drive
 (/dev/rmt/0mbn) close: ERR=Permission denied
 backups-bge0-sd: dev.c:475-0 dev.c:474 Unable to open device
 SDLT1-Drive (/dev/rmt/0mbn): ERR=Permission denied
 backups-bge0-sd: dev.c:483-0 open dev: tape -1 opened
 backups-bge0-sd: dev.c:358-0 preserve=0x0 fd=-1
 backups-bge0-sd: dev.c:1892-0 Clear volhdr vol=
 backups-bge0-sd: vol_mgr.c:562-0 vol_unused: no vol on SDLT1-Drive
 (/dev/rmt/0mbn)
 
 
 Any ideas?
 
 Thanks,
 Andy
 
 Classification:  UNCLASSIFIED 
 Caveats: NONE
 
 
 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 

-- 
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabrück
www.its-lehmann.de

--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restoring large directory does not work

2009-06-24 Thread mehma sarja
Thanks for all your help you guys. I am impressed with the level of
expertise here!

 Error accessing memory address 0x7fbff000: Bad address.
  #0  0x0040c043 in add_findex ()

 The function add_findex is interesting, but I think like your bacula-dir
 was

 Try the following gdb commands (I assume you are running 64-bit FreeBSD):

 break *add_findex
 commands
 printf arguments: %x %x %x\n, $rdi, $rsi, $rdx
 end
 continue

 When it stops, enter the continue command again and time how long it takes
 before it stops again.

 Do this a few times and post the results (including the arguments:
 output).


Yes, it is FreeBSD 64 bit. The continue command comes right back with these
arguments:

Breakpoint 1, 0x0040bfc0 in add_findex ()
arguments: 1b17068 a0 5fe00b
arguments: 1b17068 a0 5fe00b
arguments: 1b17068 a0 5fe00b
arguments: 1b17068 a0 5fe00b
(gdb) continue
Continuing.

Breakpoint 1, 0x0040bfc0 in add_findex ()
arguments: 1b17068 a0 5fe039
arguments: 1b17068 a0 5fe039
arguments: 1b17068 a0 5fe039
arguments: 1b17068 a0 5fe039
(gdb) continue
Continuing.

Breakpoint 1, 0x0040bfc0 in add_findex ()
arguments: 1b17068 a0 5fe055
arguments: 1b17068 a0 5fe055
arguments: 1b17068 a0 5fe055
arguments: 1b17068 a0 5fe055
(gdb) continue
Continuing.

Breakpoint 1, 0x0040bfc0 in add_findex ()
arguments: 1b17068 a0 5fe060
arguments: 1b17068 a0 5fe060
arguments: 1b17068 a0 5fe060
arguments: 1b17068 a0 5fe060
(gdb) continue
Continuing.

Breakpoint 1, 0x0040bfc0 in add_findex ()
arguments: 1b17068 a0 5fe071
arguments: 1b17068 a0 5fe071
arguments: 1b17068 a0 5fe071
arguments: 1b17068 a0 5fe071
(gdb) continue
Continuing.

Breakpoint 1, 0x0040bfc0 in add_findex ()
arguments: 1b17068 a0 5fe079
arguments: 1b17068 a0 5fe079
arguments: 1b17068 a0 5fe079
arguments: 1b17068 a0 5fe079
(gdb) continue
Continuing.

Breakpoint 1, 0x0040bfc0 in add_findex ()
arguments: 1b17068 a0 5fe0ac
arguments: 1b17068 a0 5fe0ac
arguments: 1b17068 a0 5fe0ac
arguments: 1b17068 a0 5fe0ac
--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Job vs volume retention periods

2009-06-24 Thread phatrik


Dirk Bartley wrote:
 On Wed, 2009-06-24 at 09:14 +0200, Fahrer, Julian wrote:
 
  Hi Erik,
  
  volumes will only be reused after the volume retention period is reached.
  And the point of keeping a volume which doesn't contain jobIDs is that you 
  could import the tape or recover data from it using btape since it still 
  contains all files.
  
 
 Greetings
 
 Julian is correct with exceptions.
 
 Recycle Oldest Volume = yes
 Recycle Current Volume = yes
 PurgeOldestVolume = yes
 
 Warning, the following description may not be perfect:
 
 I use recycle oldest and purge oldest.  This way, the job records can be
 maintained in the catalog with an unresonably long job retention period.
 When the director completes jobs, it will still perform pruning
 operations pruning file records.
 
 Then when the director goes to schedule a job, it will purge job records
 from the volume and label it recycled if all jobs have had their file
 records pruned.  The volume chosen to recyle will be the one that has
 not been written to for the longest period.
 
 The status dir will show the recycled volume as the volume scheduled to
 use.
 
 For instance, I have a pool with two tapes for Tuesday and Thursday.  I
 want to use it four times then have it schedule using the othe tape
 rotating every two weeks.
 
 Pool {
 Name = LTO_TueThu
 Pool Type = Backup
 Recycle = yes   
 AutoPrune = yes   
 Volume Retention = 16 Days 
 Volume Use Duration = 10 Days 
 Recycle Oldest Volume = yes
 PurgeOldestVolume = yes
 Storage = LTO
 }
 
 
 Set it up recently and it seems to work so far.  Best of luck.  The
 documentation is awesome because there are so many possible parameters.
 The one thing that may be missing is more recipes from current users.
 
 Dirk
 
 
  
  Kind regards
  
  Julian
  
  
  -Ursprüngliche Nachricht-
  Von: phatrik [mailto:bacula-forum  at  backupcentral.com] 
  Gesendet: Mittwoch, 24. Juni 2009 03:46
  An: bacula-users  at  lists.sourceforge.net
  Betreff: [Bacula-users] Job vs volume retention periods
  
  
  Hi,
  
  I'm confused in regards to job retention vs volume retention.  From the 
  little bit I understand, if the volume retention period is passed and 
  bacula is unable to find any other appendable volumes in the client's 
  stoarge pool, it will delete all file and job records and then re-use that 
  volume.  However, how about if all the jobs in that volume have been pruned 
  but the volume retention period hasn't passed yet (and of course recycling 
  is enabled) Will bacula still re-use the volume since no more jobs remained 
  after they've all been pruned?  If it does, what's the purpose of having a 
  volume retention period which is usually without a doubt longer than the 
  job retention period?  If it doesn't, what's the point of keeping a volume 
  which doesn't contain jobIDs which can't be restored anymore?  
  
  
  thanks in advance,
  
  
  
  Erik
  
  +--
  |This was sent by erik.godin  at  gmail.com via Backup Central.
  |Forward SPAM to abuse  at  backupcentral.com.
  +--
  
  
  
  --
  ___
  Bacula-users mailing list
  Bacula-users  at  lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
  
  --
  ___
  Bacula-users mailing list
  Bacula-users  at  lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
  
 
 
 --
 ___
 Bacula-users mailing list
 Bacula-users  at  lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users









Hi,


Thanks for the help provided so far, it's very much appreciated.   I do have a 
few follow-up questions:


In a case where the client's storage pool would of reached it's maximum volume 
limit (I use this combined with maximum volume bytes to control the size of 
their allocated storage pools) and recycle oldest volume would be equal to 
yes... If all the jobs have already passed their retention period, bacula would 
recycle the oldest volume regardless of the volume retention period, is this 
correct (on what date is this based btw, the date of the last written job?)  
And that, as long as the volume wasn't recycled/overwritten, there's always 
possibility to use bscan, re-write the catalogue and restore file-by-file?  In 
a case where the file records have expired but not the job records, can I 
simply decide to restore an entire jobid instead of using bscan?  How about 
when a volume is purged?  My understanding is, files can still be recovered, 
however in this 

[Bacula-users] Overriding Job and/or File Retention Periods?

2009-06-24 Thread teksupptom

Trying to work around the file/job retention question above, is it possible to 
set up multiple Client resources for a single client machine, without running 
multiple file daemons on the client?

The way I read the manual, the name given to the client file daemon is what 
needs to be used for the client resource in the Director config. Is that true, 
or am I reading it incorrectly?

Thanks for any help,
Tom

+--
|This was sent by tomisom.s...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Job vs volume retention periods

2009-06-24 Thread Dirk Bartley

 
 Thanks for the help provided so far, it's very much appreciated.   I do have 
 a few follow-up questions:
 
 
 In a case where the client's storage pool

Pools don't belong to a client unless you set up the directors schedules
that way and don't run any manually to the pool.

  would of reached it's maximum volume limit (I use this combined with maximum 
 volume bytes to control the size of their allocated storage pools) and 
 recycle oldest volume would be equal to yes... If all the jobs have already 
 passed their retention period, bacula would recycle the oldest volume

if recycle oldest is set yes.  If you also set purge oldest, then it
will purge the jobs as well

  regardless of the volume retention period, 

recycle oldest respects retention of files and jobs.

 is this correct (on what date is this based btw, the date of the last written 
 job?)

I think first written, not totally sure

   And that, as long as the volume wasn't recycled/overwritten, there's always 
 possibility to use bscan, re-write the catalogue and restore file-by-file?  
 In a case where the file records have expired but not the job records, can I 
 simply decide to restore an entire jobid instead of using bscan?

yes, restoring the entire job is always an option if the job record
exists with purged files.

   How about when a volume is purged?

If the volume is purged, then there will be no knowledge of the job or
where it is on the tape, so bscan would be required.

   My understanding is, files can still be recovered, however in this case I'm 
 presuming using bscan isn't optional?

bscan required is my understanding.

Dirk

 
 
 I think this should be the last of my question :)

Bacula is pretty flexible.  I had to read the pool directives, try some
stuff for a bit, then read it again to fully appreciate what it took to
get the results I wanted.  Heck, I'm still not sure if I'm quite there
yet.

 
 
 Thanks in advance,
 
 
 
 Erik



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Overriding Job and/or File Retention Periods?

2009-06-24 Thread Dirk Bartley

If your serious about it, you could always script your way out of it.
Set the file and job retention to the higher of the two desired values,
then conjure up an sql statment that select the jobs that you want to
have the lower retention periods and purge the records desired in a
script.

You could use the scripting language you feel most comfortable.  Then
run the script in cron or run after job.

Here is an example of a sql statement

SELECT
  Job.JobId
FROM job
JOIN JobMedia ON JobMedia.JobId=Job.JobId
JOIN Media ON JobMedia.MediaId=Media.MediaId
WHERE media.volumename IN ($medialist)
ORDER BY Job.EndTime
Limit 1
; ;

But you could have it select jobs of a certain jobname or client that
are older than a certain age then purge files from those jobs.

It only takes a bit to set up.

Dirk

On Wed, 2009-06-24 at 21:29 -0400, teksupptom wrote:
 Trying to work around the file/job retention question above, is it possible 
 to set up multiple Client resources for a single client machine, without 
 running multiple file daemons on the client?
 
 The way I read the manual, the name given to the client file daemon is what 
 needs to be used for the client resource in the Director config. Is that 
 true, or am I reading it incorrectly?
 
 Thanks for any help,
 Tom
 
 +--
 |This was sent by tomisom.s...@gmail.com via Backup Central.
 |Forward SPAM to ab...@backupcentral.com.
 +--
 
 
 
 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users