[Bacula-users] accurate mode and full backup

2012-07-26 Thread d tbsky
hi:
   I use accurate mode  for incremental or differential backups. but when
incremental level upgrade to full level (like fist time backup) , will
bacula disable accurate mode automatically?
   I check the backup log and find  the line "accurate = yes" even when
bacula is doing full backup. should I worry about this?
  thanks a lot for your help!!

Regards,
tbskyd
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Copy Job Head Scratcher... Next Pool

2012-07-26 Thread NetCetera Lists
I am working on setting up a Copy job to a tape autoloader - and am
having an issue with the Next Pool directive requirement.

I am picking the jobs to copy - last Full for a number of existing
clients - using an SQL Query.

The query is working fine and providing the correct job ids as input.

The problem is that each client has its own Pool - containing Fulls,
Incrementals and Differentials - and I don't know how to
work around the Next Pool requirement...

I would rather use 1 job for all the copies if possible and would don't
really want to revamp the Pools so that the fulls etc have their own pools.

Anyone have any ideas ?

Thanks

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Building rpms from bacula.spec troubles

2012-07-26 Thread Robert Hartzell
I'm trying to build RPM's from the bacula.spec file included with the 5.2.10 
source on CentOS 6.3 and have ran into several problems. 

rpmbuild -ba --define "build_centos6 1" --define "build_mysql 1" 
SPECS/bacula.spec
results in this error:
error: line 457: Empty tag: Distribution:
which I think should be set by %define _dist %(grep CentOS /etc/redhat-release) 
but isn't.
so I set it manually like this: Distribution: %{CentOS release 6.3 (Final)}

That will allow the build to continue to this point...
Processing files: bacula-mysql-5.2.10-1.x86_64 
error: File not found: 
/home/bear/rpmbuild/BUILDROOT/bacula-5.2.10-1.x86_64/opt/bacula/scripts/startmysql
 
error: File not found: 
/home/bear/rpmbuild/BUILDROOT/bacula-5.2.10-1.x86_64/opt/bacula/scripts/stopmysql
 
error: File not found: 
/home/bear/rpmbuild/BUILDROOT/bacula-5.2.10-1.x86_64/opt/bacula/scripts/query.sql

RPM build errors:
File not found: 
/home/bear/rpmbuild/BUILDROOT/bacula-5.2.10-1.x86_64/opt/bacula/scripts/startmysql
File not found: 
/home/bear/rpmbuild/BUILDROOT/bacula-5.2.10-1.x86_64/opt/bacula/scripts/stopmysql
File not found: 
/home/bear/rpmbuild/BUILDROOT/bacula-5.2.10-1.x86_64/opt/bacula/scripts/query.sql

I can get past that by removing these lines from bacula.spec
cp -p examples/sample-query.sql 
$RPM_BUILD_ROOT%{script_dir}/sample-query.sql
%attr(-, root, %{daemon_group}) %{script_dir}/startmysql
%attr(-, root, %{daemon_group}) %{script_dir}/stopmysql
%attr(-, root, %{daemon_group}) %config(noreplace) 
%{script_dir}/query.sql
%attr(-, root, %{daemon_group}) %{script_dir}/sample-query.sql

But then..
Checking for unpackaged file(s): /usr/lib/rpm/check-files 
/home/bear/rpmbuild/BUILDROOT/bacula-5.2.10-1.x86_64
error: Installed (but unpackaged) file(s) found:
   /opt/bacula/lib64/libbaccats-5.2.10.so
   /opt/bacula/lib64/libbaccats-mysql-5.2.10.so
   /opt/bacula/lib64/libbaccats-mysql.la
   /opt/bacula/lib64/libbaccats-mysql.so
   /opt/bacula/lib64/libbaccats.la
   /opt/bacula/lib64/libbaccats.so
   /usr/share/man/man8/bregex.8.gz
   /usr/share/man/man8/bwild.8.gz

RPM build errors:
Installed (but unpackaged) file(s) found:
   /opt/bacula/lib64/libbaccats-5.2.10.so
   /opt/bacula/lib64/libbaccats-mysql-5.2.10.so
   /opt/bacula/lib64/libbaccats-mysql.la
   /opt/bacula/lib64/libbaccats-mysql.so
   /opt/bacula/lib64/libbaccats.la
   /opt/bacula/lib64/libbaccats.so
   /usr/share/man/man8/bregex.8.gz
   /usr/share/man/man8/bwild.8.gz

So is this something I'm doing wrong or is the spec file broken?
Any info or pointers would be appreciated.

Thanks, Robert

--
Robert Hartzell
President | RwHartzell.Net, Inc.
www.rwhartzell.net | blogs.rwhartzell.net/bear



--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Verify VolumeToCatalog still broken?

2012-07-26 Thread John Drescher
On Thu, Jul 26, 2012 at 4:19 PM, John Drescher  wrote:
> On Thu, Jul 26, 2012 at 4:14 PM, John Drescher  wrote:
>> Here is the log:
>>
>>  Build OS:   x86_64-pc-linux-gnu gentoo
>>   JobId:  29107
>>   Job:VerifyVolume_Gladwin-ds3-Job.2012-07-26_15.28.54_09
>>   FileSet:Gladwin-ds3-fs
>>   Verify Level:   VolumeToCatalog
>>   Client: datastore3-fd
>>   Verify JobId:   29104
>>   Verify Job:
>>   Start time: 26-Jul-2012 15:28:56
>>   End time:   26-Jul-2012 16:01:21
>>   Files Expected: 46,577
>>   Files Examined: 46,577
>>   Non-fatal FD errors:0
>>   FD termination status:  OK
>>   SD termination status:  OK
>>   Termination:Verify OK
>
> Hmm. It looks like user error.
>
> I do not have Verify Job set. I will try that.
>
> Verify Job = Job-Resource-Name
> If you run a verify job without this directive, the last job run
> will be compared with the catalog, which means that you must
> immediately follow a backup by a verify command. If you specify a
> Verify Job Bacula will find the last job with that name that ran. This
> permits you to run all your backups, then run Verify jobs on those
> that you wish to be verified (most often a VolumeToCatalog) so that
> the tape just written is re-read.
>

With that it is now working.

Select Client (File daemon) resource (1-35): 4
Connecting to Client datastore3-fd at datastore3:9102

datastore3-fd Version: 5.2.5 (26 January 2012)  x86_64-pc-linux-gnu gentoo
Daemon started 12-Jul-12 14:26. Jobs: run=20 running=0.
 Heap: heap=327,680 smbytes=276,437 max_bytes=943,545 bufs=136 max_bufs=287
 Sizeof: boffset_t=8 size_t=8 debug=0 trace=0
Running Jobs:
JobId 29108 Job VerifyVolume_Gladwin-ds3-Job.2012-07-26_16.15.35_15 is running.
Volume to Catalog Verify Job started: 26-Jul-12 16:15
Files=526 Bytes=0 Bytes/sec=0 Errors=0
Files Examined=526
Processing file:
/mnt/vg1/imagedata/clean/Lung/Gladwin/Gladwin/800203/1/002/HB18505_CT_8B0DAFC7_01_002_01_426.dcm
SDReadSeqNo=11546 fd=5
Director connected at: 26-Jul-12 16:22


Sorry about the false report.

John

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Verify VolumeToCatalog still broken?

2012-07-26 Thread John Drescher
On Thu, Jul 26, 2012 at 4:14 PM, John Drescher  wrote:
> Here is the log:
>
>  Build OS:   x86_64-pc-linux-gnu gentoo
>   JobId:  29107
>   Job:VerifyVolume_Gladwin-ds3-Job.2012-07-26_15.28.54_09
>   FileSet:Gladwin-ds3-fs
>   Verify Level:   VolumeToCatalog
>   Client: datastore3-fd
>   Verify JobId:   29104
>   Verify Job:
>   Start time: 26-Jul-2012 15:28:56
>   End time:   26-Jul-2012 16:01:21
>   Files Expected: 46,577
>   Files Examined: 46,577
>   Non-fatal FD errors:0
>   FD termination status:  OK
>   SD termination status:  OK
>   Termination:Verify OK

Hmm. It looks like user error.

I do not have Verify Job set. I will try that.

Verify Job = Job-Resource-Name
If you run a verify job without this directive, the last job run
will be compared with the catalog, which means that you must
immediately follow a backup by a verify command. If you specify a
Verify Job Bacula will find the last job with that name that ran. This
permits you to run all your backups, then run Verify jobs on those
that you wish to be verified (most often a VolumeToCatalog) so that
the tape just written is re-read.


-- 
John M. Drescher

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Verify VolumeToCatalog still broken?

2012-07-26 Thread John Drescher
Here is the log:

 Build OS:   x86_64-pc-linux-gnu gentoo
  JobId:  29107
  Job:VerifyVolume_Gladwin-ds3-Job.2012-07-26_15.28.54_09
  FileSet:Gladwin-ds3-fs
  Verify Level:   VolumeToCatalog
  Client: datastore3-fd
  Verify JobId:   29104
  Verify Job:
  Start time: 26-Jul-2012 15:28:56
  End time:   26-Jul-2012 16:01:21
  Files Expected: 46,577
  Files Examined: 46,577
  Non-fatal FD errors:0
  FD termination status:  OK
  SD termination status:  OK
  Termination:Verify OK

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Verify VolumeToCatalog still broken?

2012-07-26 Thread John Drescher
I just tried a verify job level VolumeToCatalog and it appears that
bacula is wrongly verifying the last completed job on the client
instead of the job I wanted.

datastore3-fd Version: 5.2.5 (26 January 2012)  x86_64-pc-linux-gnu gentoo
Daemon started 12-Jul-12 14:26. Jobs: run=19 running=0.
 Heap: heap=327,680 smbytes=276,437 max_bytes=943,545 bufs=136 max_bufs=287
 Sizeof: boffset_t=8 size_t=8 debug=0 trace=0
Running Jobs:
JobId 29107 Job VerifyVolume_Gladwin-ds3-Job.2012-07-26_15.28.54_09 is running.
Volume to Catalog Verify Job started: 26-Jul-12 15:28
Files=11,379 Bytes=0 Bytes/sec=0 Errors=0
Files Examined=11,379
Processing file:
/mnt/vg1/imagedata/clean/PHANTOMS/TOMOSYNTHESIS/DICOM/SLICES/SC17/SC17.SLICES.73.DCM
SDReadSeqNo=556146 fd=5
Director connected at: 26-Jul-12 15:45


Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName
==
 29077  Full  13.757 G  OK   22-Jul-12 01:22 BackupCatalog
 29083  Full  13.757 G  OK   24-Jul-12 01:22 BackupCatalog
 29089  Full  13.745 G  OK   25-Jul-12 01:22 BackupCatalog
 29095  Full  13.746 G  OK   26-Jul-12 01:22 BackupCatalog
 29097  Incr  4,9852.742 G  OK   26-Jul-12 10:33
LTRC-Phenotype-Study-job
 29099  Full  9,7055.099 G  OK   26-Jul-12 11:14
PA_HTN-Archive-ds3-Job
 29096  Full 81,43042.83 G  OK   26-Jul-12 11:51 Gladwin-ds3-Job
 29098  Incr185,32477.07 G  OK   26-Jul-12 12:25 LUNG_CA-Archive-Job
 29101  Full  3,48646.30 G  OK   26-Jul-12 12:59
Bin_BARP-Archive-Job
 29104  Incr 46,57739.30 G  OK   26-Jul-12 14:33 PHANTOM-Archive-job


The job I wanted to verify is Gladwin-ds3-Job howver I can see it is
looking at PHANTOM files instead of what I want.



Job {
  Name = "VerifyVolume_Gladwin-ds3-Job"
  JobDefs = "VerifyVolume_ds3-Jobdef"
  FileSet = "Gladwin-ds3-fs"
  Pool = LTO2-Archived-Data
}



JobDefs {
  Name = "VerifyVolume_ds3-Jobdef"
  Type = Verify
  Level = VolumeToCatalog
  Storage = "DEV6-Changer"
  Client = datastore3-fd
  Messages = VerifyMsgs
  Priority = 10
  SpoolData = yes
}

###

FileSet {
  Name = "Gladwin-ds3-fs"
  Include {
File = /mnt/vg1/imagedata/clean/Lung/Gladwin
Options {
  signature=SHA1
  verify=s1
}
Exclude Dir Containing = .dontbackupthisfolder
  }
}


##

Job {
  Name = "Gladwin-ds3-Job"
  JobDefs = "Gladwin-ds3-Jobdef"
  Level = Incremental
  Pool = LTO2-Archived-Data
  Storage = "DEV6-Changer"
  Client = datastore3-fd
  SpoolData = yes
}



JobDefs {
  Name = "Gladwin-ds3-Jobdef"
  Type = Backup
  Client = datastore3-fd
  FileSet = "Gladwin-ds3-fs"
  Messages = Standard
  Priority = 10
  SpoolData = yes
}


-- 
John M. Drescher

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] fileset: second eyes needed

2012-07-26 Thread Martin Simmons
> On Wed, 25 Jul 2012 08:34:08 -0400 (EDT), Steve Thompson said:
> 
> I have a large file system (/mnt/home, 60TB) whose backups are split into 
> multiple jobs. Two jobs in particular: one to backup all directories whose 
> names begin with "s" except for st123, and a second job to backup just st123:
> ...
> The file sets are as follows:
> 
> FileSet {
>Name = "home_s"
>Include {
>  Options {
>wilddir = "/mnt/home/s*"
>  }
>  Options {
>exclude = yes
>wilddir = "/mnt/home/st123"
>RegexDir = ".*"
>  }
>  Options {
>compression = GZIP4
>sparse = yes
>noatime = yes
>  }
>  File = /mnt/home
>}
> }
> ...
> All is well with the home_st123 job: it backups up only what is expected. 
> However, the home_s job backups up only the directories whose name begins
> with "s", but it also backs up st123, which has been excluded. Presumably
> I have the Options clauses incorrectly defined?

I think you need to split the Options clauses differently.

Bacula scans them in order and accepts/rejects as soon as one matches, so your
first clause matches only the directories whose name begins with "s"
(including st123) and the second clause rejects everything else.

Something like this will work:

FileSet {
   Name = "home_s"
   Include {
 Options {
   exclude = yes
   wilddir = "/mnt/home/st123"
 }
 Options {
   wild = "/mnt/home/s*"
   compression = GZIP4
   sparse = yes
   noatime = yes
 }
 Options {
   exclude = yes
   RegexDir = ".*"
 }
 File = /mnt/home
   }
}

__Martin

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-sd: Bacula interrupted by signal 11: Segmentation violation

2012-07-26 Thread Martin Simmons
Yes, that's better.

I think this can be caused by a mismatch between the Director or SD configs.

Can you post the Storage, Device and Autochanger sections from the
bacula-dir.conf and bacula-sd.conf?

__Martin


> On Wed, 25 Jul 2012 15:52:19 +0200, Tobias Dinse said:
> 
> Ok, I compiled our 5.0.2 Version of Bacula and attached the new report. 
> I hope this time its better  bu I can still see an .
> 
> I also tried to use 5.2.10 with 2 test machines. Both give the same 
> error as 5.0.2 :(
> 
> regards
> 
> Tobias
> 
> Am 24.07.2012 19:45, schrieb Martin Simmons:
> > That's good, but unfortunately the backtrace doesn't show the function 
> > names.
> > Can you recompile bacula with debugging options (just set CFLAGS="-g" in the
> > environment before running configure).
> >
> > Also, have you considered upgrading both Director and SD to 5.2.10?
> >
> > __Martin
> >
> >
> >> On Mon, 23 Jul 2012 09:38:44 +0200, Tobias Dinse said:
> >> Hi,
> >>
> >> the Debug Informations are on the Attachment. It create it manually like
> >> it was shown on the Bacula Homepage.
> >>
> >> regards
> >>
> >> Tobias
> >>
> >>
> >> Am 20.07.2012 20:11, schrieb Martin Simmons:
>  On Fri, 20 Jul 2012 09:41:26 +0200, Tobias Dinse said:
>  Syslog on sd:
> 
>  Jul 20 09:35:30 lx03-baculasd-ourcustomer bacula-sd: Bacula interrupted
>  by signal 11: Segmentation violation
> 
>  after getting this error Msg the sd-service crashing down
> >>> The next step is to attach gdb to the bacula-sd process before it crashes 
> >>> and
> >>> then get backtraces with "thread apply all bt".  You may need to 
> >>> recompile it
> >>> with debugging options (CFLAGS="-g").
> >>>
> >>> __Martin
> >>>
> >>> --
> >>> Live Security Virtual Conference
> >>> Exclusive live event will cover all the ways today's security and
> >>> threat landscape has changed and how IT managers can respond. Discussions
> >>> will include endpoint security, mobile security and the latest in malware
> >>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> >>> ___
> >>> Bacula-users mailing list
> >>> Bacula-users@lists.sourceforge.net
> >>> https://lists.sourceforge.net/lists/listinfo/bacula-users
> >>
> >> -- 
> >> # Stegbauer Datawork
> >> # Tobias Dinse
> >> # +49 (8571) 922213
> >> # Oberjulbachring 9, 84387 Julbach
> > --
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> > ___
> > Bacula-users mailing list
> > Bacula-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/bacula-users
> 
> 
> -- 
> # Stegbauer Datawork
> # Tobias Dinse
> # +49 (8571) 922213
> # Oberjulbachring 9, 84387 Julbach
> 
> 

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula base jobs

2012-07-26 Thread robi1a
Hello 
I'm trying to implement deduplication in my bacula installation but I didn't 
understand how does it fit into my installation. The bacula documentation about 
base jobs are not very usable (my opinion). Further I spent some hours in 
google but I didn't find any helpful hint.
 
My problem:
I have 2 servers called asterix and obelix. I want to backup both servers with 
bacula. Asterix is the primary server and obelix is rsync-mirror of asterix. So 
obelix should be nearly identical with asterix and the backup of obelix should 
be based on asterix. The pool resides on disk.

Job Definitions:
Job {
  Name = "asterix-Backup_BUERO"
  Client = asterix
  Schedule = "Sched_1st-sun-Full_sun-Diff_daily-Incr"
  JobDefs = "JobDef_BUERO"
}

Job {
  Name = "obelix-Backup_BUERO"
  Client = obelix
  Schedule = "Sched_2nd-sun-Full_sun-Diff_daily-Incr"
  JobDefs = "JobDef_BUERO"

Schedule Definitions:
Schedule {
  Name = "Sched_1st-sun-Full_sun-Diff_daily-Incr"
  Run = Level=Full 1st sun at 01:00
  Run = Level=Differential 2nd-5th sun at 01:00
  Run = Level=Incremental  mon-sat at 01:00
}

Schedule {
  Name = "Sched_2nd-sun-Full_sun-Diff_daily-Incr"
  Run = Level=Full 2nd sun at 02:00
  Run = Level=Differential 3rd-5th sun at 02:00
  Run = Level=Differential 1st sun at 02:00
  Run = Level=Incremental  mon-sat at 02:00

As you see in the schedules, asterix is doing a full backup once a month, a 
differential backup each sunday and a daily incremental backup. obelix is doing 
the same with 1 week offset.

If I declare asterix as Level=Base what happens with differential and 
incremental backup of asterix. 
1. Are these type of backups also a base backup?
2. Which backup (full/diff/incr) is base for obelix? All jobs have the same 
name.
3. Or do I need an extra job with run a full backup as a "base-only-job" on 
asterix and have a reference from both servers to them?
3.1. If yes, what happens if this "base-only-job" is replaced by a new one? Is 
the old "base-only-job" still available as long as all references are gone?

I appreciate any info.
regards robi

+--
|This was sent by r...@gmx.at via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Multiple Storages in Job Resource

2012-07-26 Thread John Drescher
>> http://sourceforge.net/projects/vchanger/
> IMHO, there is really no need to use that tool. Bacula is able to manage 
> virtual autochanger by itself...

Hmm. Is that a new feature in 5.2.X?

John

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Multiple Storages in Job Resource

2012-07-26 Thread Georges
Hello

> Message du 26/07/12 17:29
> De : "John Drescher" 
> A : "Jummo" 
> Copie à : bacula-users@lists.sourceforge.net
> Objet : Re: [Bacula-users] Multiple Storages in Job Resource
>
> On Thu, Jul 26, 2012 at 11:26 AM, John Drescher  wrote:
> > On Thu, Jul 26, 2012 at 11:10 AM, Jummo  wrote:
> >> Hi,
> >>
> >> I use backup to disk to backup my clients and I hit the slow restore
> >> problem when backup jobs run concurrently and use the same storage
> >> device/volume. The backup window is small and therefore jobs must run at
> >> the same time.
> >>
> >> My first intention was to create for each client a dedicated storage
> >> device, similar like [1]. With this configuration each backup job is saved
> >> on a sperated volume, no mixups and slow restore is gone. But the
> >> configuration overhead is huge and for a new client I have to restart the
> >> storage daemon.
> >>
> >> During my web search I found the configuration of mashdot [2]. He use four
> >> generic storage devices and use _all_ four in the Job Resource
> >> configuration.
> >>
> >> Job {
> >> ...
> >> Storage = 
> >> PrimaryFileStorage,SecondaryFileStorage,TertiaryFileStorage,QuaternaryFileStorage
> >> ...
> >> }
> >>
> >> It's possible to define more than one storage device and the jobs will
> >> select automatically the next free one until all are in used? I couldn't
> >> find anything about this in the official documentation or in mailing list
> >> archives.
> >>
> >
> > No
> >
> I meant not with bacula alone.
> 
> I recommend you use a disk virtual autochanger to achieve this.
> 
> http://sourceforge.net/projects/vchanger/
IMHO, there is really no need to use that tool. Bacula is able to manage 
virtual autochanger by itself...

G.
> 
> John
> 
> --
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and 
> threat landscape has changed and how IT managers can respond. Discussions 
> will include endpoint security, mobile security and the latest in malware 
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
> 







Une messagerie gratuite, garantie à vie et des services en plus, ça vous tente ?
Je crée ma boîte mail www.laposte.net

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Multiple Storages in Job Resource

2012-07-26 Thread John Drescher
On Thu, Jul 26, 2012 at 11:26 AM, John Drescher  wrote:
> On Thu, Jul 26, 2012 at 11:10 AM, Jummo  wrote:
>> Hi,
>>
>> I use backup to disk to backup my clients and I hit the slow restore
>> problem when backup jobs run concurrently and use the same storage
>> device/volume. The backup window is small and therefore jobs must run at
>> the same time.
>>
>> My first intention was to create for each client a dedicated storage
>> device, similar like [1]. With this configuration each backup job is saved
>> on a sperated volume, no mixups and slow restore is gone. But the
>> configuration overhead is huge and for a new client I have to restart the
>> storage daemon.
>>
>> During my web search I found the configuration of mashdot [2]. He use four
>> generic storage devices and use _all_ four in the Job Resource
>> configuration.
>>
>> Job {
>> ...
>>Storage = 
>> PrimaryFileStorage,SecondaryFileStorage,TertiaryFileStorage,QuaternaryFileStorage
>> ...
>> }
>>
>> It's possible to define more than one storage device and the jobs will
>> select automatically the next free one until all are in used? I couldn't
>> find anything about this in the official documentation or in mailing list
>> archives.
>>
>
> No
>
I meant not with bacula alone.

I recommend you use a disk virtual autochanger to achieve this.

http://sourceforge.net/projects/vchanger/

John

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Multiple Storages in Job Resource

2012-07-26 Thread John Drescher
On Thu, Jul 26, 2012 at 11:10 AM, Jummo  wrote:
> Hi,
>
> I use backup to disk to backup my clients and I hit the slow restore
> problem when backup jobs run concurrently and use the same storage
> device/volume. The backup window is small and therefore jobs must run at
> the same time.
>
> My first intention was to create for each client a dedicated storage
> device, similar like [1]. With this configuration each backup job is saved
> on a sperated volume, no mixups and slow restore is gone. But the
> configuration overhead is huge and for a new client I have to restart the
> storage daemon.
>
> During my web search I found the configuration of mashdot [2]. He use four
> generic storage devices and use _all_ four in the Job Resource
> configuration.
>
> Job {
> ...
>Storage = 
> PrimaryFileStorage,SecondaryFileStorage,TertiaryFileStorage,QuaternaryFileStorage
> ...
> }
>
> It's possible to define more than one storage device and the jobs will
> select automatically the next free one until all are in used? I couldn't
> find anything about this in the official documentation or in mailing list
> archives.
>

No

>
> If this is possible, why I'm getting the following errors when a jobs
> starts during another is already running?

John

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Multiple Storages in Job Resource

2012-07-26 Thread Jummo
Hi,

I use backup to disk to backup my clients and I hit the slow restore 
problem when backup jobs run concurrently and use the same storage 
device/volume. The backup window is small and therefore jobs must run at 
the same time.

My first intention was to create for each client a dedicated storage 
device, similar like [1]. With this configuration each backup job is saved 
on a sperated volume, no mixups and slow restore is gone. But the 
configuration overhead is huge and for a new client I have to restart the 
storage daemon.

During my web search I found the configuration of mashdot [2]. He use four 
generic storage devices and use _all_ four in the Job Resource 
configuration.

Job {
...
   Storage = 
PrimaryFileStorage,SecondaryFileStorage,TertiaryFileStorage,QuaternaryFileStorage
...
}

It's possible to define more than one storage device and the jobs will 
select automatically the next free one until all are in used? I couldn't 
find anything about this in the official documentation or in mailing list 
archives.

If this is possible, why I'm getting the following errors when a jobs 
starts during another is already running?

26-Jul 16:48 bacula.example.com-dir JobId 889: Start Backup JobId 889, 
Job=client2.example.com.2012-07-26_16.48.08_54
26-Jul 16:48 bacula.example.com-dir JobId 889: Created new Volume 
"client2.example.com-fd-new_FullPool-20120726-1648-889" in catalog.
26-Jul 16:48 bacula.example.com-dir JobId 889: Error: sql_create.c:424 Volume 
"client2.example.com-fd-new_FullPool-20120726-1648-889" already exists. 
26-Jul 16:48 bacula.example.com-dir JobId 889: Error: sql_create.c:424 Volume 
"client2.example.com-fd-new_FullPool-20120726-1648-889" already exists.
26-Jul 16:48 bacula.example.com-dir JobId 889: Error: sql_create.c:424 Volume 
"client2.example.com-fd-new_FullPool-20120726-1648-889" already exists.


Thanks,

  - Jummo



[1] http://myunix.dk/category/bacula/
[2] https://gist.github.com/2312522

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Automatic Tape Recycling

2012-07-26 Thread Phil Stracchino
On 07/26/12 02:35, Sven Tegethoff wrote:
> On 25.07.2012 17:50, Phil Stracchino wrote:
>> i think we need to understand more about the use cycle for these
>> volumes. Are these weekly tapes written to once per week with a single
>> job or set of jobs, or are they continuously appended to over the
>> course of a week? 
> 
> Let's just take a look at the daily backups, and only those that fit on
> one tape. (My problem is not limited to those, but it'll make it simpler
> to explain.)
> 
> There is a SET of jobs for every night, backing up different machines to
> the same tape one after another. The next morning, the tape is being
> swapped out for the next day's tape. Tapes are supposed to be re-used
> every week, so there is a "monday" tape, a "tuesday" tape, and so on,
> and the old expired backup from the preceeding week that's still on it
> is supposed to be automatically overwritten.
> 
> However, when the last job of the night finishes, and there's still room
> on the tape, bacula will leave the volume in "appendable" state.  And
> when the tape is re-inserted the next week to be overwritten, bacula
> insists to append to it - no matter what the "max use duration" and the
> volume retention period is. And the only way to prevent this is to
> manually update the volume status to "used".
> 
> This is actually documented. Why "max use duration" won't work is
> described in
> 
> http://www.bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html
> 
> Quote: "The use duration is checked and the *Used* status is set only at
> the end of a job that writes to the particular volume".

The following is a relevant Pool definition from my configuration:

Pool {
  Name = Incr-Disk
  Storage = babylon4-file
  Pool Type = Backup
  Recycle = no
  Recycle Oldest Volume = no
  Recycle Current Volume = no
  AutoPrune = yes
  Volume Retention = 1 month
  Maximum Volume Jobs = 0
  Volume Use Duration = 23h
  Label Format =
"INCR-$Year${Month:p/2/0/r}${Day:p/2/0/r}-${Hour:p/2/0/r}:${Minute:p/2/0/r}"
  RecyclePool = Scratch
}


And here's the beginning of the log from the first job to run last night:


26-Jul 04:30 babylon4-dir JobId 1306: shell command: run BeforeJob
"/opt/bacula/sbin/checkhost babylon4"
26-Jul 04:30 babylon4-dir JobId 1306: BeforeJob: Client babylon4 has
address 10.24.32.14
26-Jul 04:30 babylon4-dir JobId 1306: Start Backup JobId 1306,
Job=Babylon4_Backup.2012-07-26_04.30.00_02
26-Jul 04:30 babylon4-dir JobId 1306: Max configured use duration=82,800
sec. exceeded. Marking Volume "INCR-20120725-04:30" as
+Used.
26-Jul 04:30 babylon4-dir JobId 1306: Created new Volume
"INCR-20120726-04:30" in catalog.
26-Jul 04:30 babylon4-dir JobId 1306: Using Device "FileStorage"
26-Jul 04:30 babylon4-sd JobId 1306: Labeled new Volume
"INCR-20120726-04:30" on device "FileStorage" (/spool/bacula).
26-Jul 04:30 babylon4-sd JobId 1306: Wrote label to prelabeled Volume
"INCR-20120726-04:30" on device "FileStorage"
+(/spool/bacula)


The volume INCR-20120725-04:30 was created yesterday morning.  This
morning Bacula went to start the job, checked the volume, determined it
had exceeded its use duration, marked it used, and created a new one.
For me, this Just Works.  If you're doing the same thing, I don't
understand why it's not working for you.



-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
  Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater
 It's not the years, it's the mileage.

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users