Re: [Bacula-users] Verify Catalog
Yes John... Now, I think that I understood perfectly and I have tested it too. VolumeToCatalog = Compares the files in a Storage Volume with the Catalog; DiskToCatalog = Compares the files of the File Deamon's File Set with the Catalog; Catalog = Like the DiskToCatalog but for Catalogs that don't must change because the files are usually system files, so, must be an isolated Catalog and the Job with Level = InitCatalog must be run before the proper Job with Level = Catalog , in order to clean it and receive the new records. Am I Right, now? One detail is...I thought that in a VolumeToCatalog I could do the verification even without the FD connection, because, in my example, the Catalog and the Volume are in the same server machine, but, anyway, I needed the FD. I know that, if my files were encrypted in the Volume, I would need the FD to decryption, but, in this case, they weren't. Anyway, my real question was solved, Thank you. On Tue, May 31, 2011 at 6:34 PM, John Drescher wrote: > > Hi John, > > > > Well, I've tested like the way you said me and it worked. > > I used the Level DiskToCatalog cause is a Backup in Disk, > > That level compares what is on your source filesystem currently with > what the MD5/SHA1 was recorded in your catalog. You wanted > "VolumeToCatalog" to compare what is in your bacula disk volumes > versus the catalog. > > > so, I've > > noticed that it always do the "verify" with the last job written on > > the Catalog. Thus, I couldn't check an older backup. > > > > Another thing...in this test I got two .txt files with nothing write > > in them, i.e, they were 0 KB. Bacula considered them, either with MD5 > > or SHA1, like inconsistent files with those in the Catalog. When I > > wrote something in them and redid the test, so, the verification was > > OK. > > > > Thank you John, for your explanation. > > > > Just one more question for nowit seems such obvious, but, the > > Level VolumeToCatalog would be when I use Tapes? Is that right? > > No that is for tape, disk, dvd or whatever other storage you use in > bacula. Remember everything in bacula is stored in a volume. See my > previous answer. > > John > > > -- > Simplify data backup and recovery for your virtual environment with > vRanger. > Installation's a snap, and flexible recovery options mean your data is > safe, > secure and there when you need it. Data protection magic? > Nope - It's vRanger. Get your free trial download today. > http://p.sf.net/sfu/quest-sfdev2dev > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Verify Catalog
> Hi John, > > Well, I've tested like the way you said me and it worked. > I used the Level DiskToCatalog cause is a Backup in Disk, That level compares what is on your source filesystem currently with what the MD5/SHA1 was recorded in your catalog. You wanted "VolumeToCatalog" to compare what is in your bacula disk volumes versus the catalog. > so, I've > noticed that it always do the "verify" with the last job written on > the Catalog. Thus, I couldn't check an older backup. > > Another thing...in this test I got two .txt files with nothing write > in them, i.e, they were 0 KB. Bacula considered them, either with MD5 > or SHA1, like inconsistent files with those in the Catalog. When I > wrote something in them and redid the test, so, the verification was > OK. > > Thank you John, for your explanation. > > Just one more question for nowit seems such obvious, but, the > Level VolumeToCatalog would be when I use Tapes? Is that right? No that is for tape, disk, dvd or whatever other storage you use in bacula. Remember everything in bacula is stored in a volume. See my previous answer. John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: Verify Catalog
Please try to always email the list..
-- Forwarded message --
From: Rickifer Barros
Date: Tue, May 31, 2011 at 5:28 PM
Subject: Re: [Bacula-users] Verify Catalog
To: John Drescher
Hi John,
Well, I've tested like the way you said me and it worked.
I used the Level DiskToCatalog cause is a Backup in Disk, so, I've
noticed that it always do the "verify" with the last job written on
the Catalog. Thus, I couldn't check an older backup.
Another thing...in this test I got two .txt files with nothing write
in them, i.e, they were 0 KB. Bacula considered them, either with MD5
or SHA1, like inconsistent files with those in the Catalog. When I
wrote something in them and redid the test, so, the verification was
OK.
Thank you John, for your explanation.
Just one more question for nowit seems such obvious, but, the
Level VolumeToCatalog would be when I use Tapes? Is that right?
On Tue, May 31, 2011 at 5:06 PM, John Drescher wrote:
>
> 2011/5/31 Rickifer Barros :
> > Hello Bacula Users,
> >
> > I'm trying to test the Verify Job but, how I could understand, I have to
> > create another catalog just for verifications, but I'm not getting do this.
> > I have installed Bacula on Debian through the aptitude with PostGre. Now I
> > dont know how create this catalog. I've tried create a db called "verify"
> > and configured the Director:
> >
> > Catalog {
> > Name = Verification
> > dbname = verify; DB Address = ""; dbuser = "bacula"; dbpassword = "###"
> > }
> >
>
> No you do not want a separate catalog for verify. The example in the
> manual is for using Bacula to track changes in files that are not part
> of your backups.
>
>
>
> > ...so, I cannot even connect at the Director via console.
> >
> > What I need to do to use this Verify Job.
> >
>
> Just the job definition. And the job levels "VolumeToCatalog" or
> "DiskToCatalog"
>
> Be careful however. The last time I checked this Verify did not work
> correctly. And what I mean about that is I had more than 1 job for a
> client and in the verify command I specified the fileset for the first
> job ran and bacula tried to verify the fileset for the second job
> instead. It seems like it ignores the fileset in the verify Job and
> uses whatever Job was last run on the client instead of what I told it
> to do.
>
> John
--
John M. Drescher
--
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today.
http://p.sf.net/sfu/quest-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: Verify Catalog
Hi John,
Well, I've tested like the way you said me and it worked.
I used the Level DiskToCatalog cause is a Backup in Disk, so, I've noticed
that it always do the "verify" with the last job written on the Catalog.
Thus, I couldn't check an older backup.
Another thing...in this test I got two .txt files with nothing write in
them, i.e, they were 0 KB. Bacula considered them, either with MD5 or SHA1,
like inconsistent files with those in the Catalog. When I wrote something in
them and redid the test, so, the verification was OK.
Thank you John, for your explanation.
Just one more question for nowit seems such obvious, but, the Level
VolumeToCatalog would be when I use Tapes? Is that right?
On Tue, May 31, 2011 at 5:06 PM, John Drescher wrote:
> 2011/5/31 Rickifer Barros :
> > Hello Bacula Users,
> >
> > I'm trying to test the Verify Job but, how I could understand, I have to
> > create another catalog just for verifications, but I'm not getting do
> this.
> > I have installed Bacula on Debian through the aptitude with PostGre. Now
> I
> > dont know how create this catalog. I've tried create a db called "verify"
> > and configured the Director:
> >
> > Catalog {
> > Name = Verification
> > dbname = verify; DB Address = ""; dbuser = "bacula"; dbpassword = "###"
> > }
> >
>
> No you do not want a separate catalog for verify. The example in the
> manual is for using Bacula to track changes in files that are not part
> of your backups.
>
>
>
> > ...so, I cannot even connect at the Director via console.
> >
> > What I need to do to use this Verify Job.
> >
>
> Just the job definition. And the job levels "VolumeToCatalog" or
> "DiskToCatalog"
>
> Be careful however. The last time I checked this Verify did not work
> correctly. And what I mean about that is I had more than 1 job for a
> client and in the verify command I specified the fileset for the first
> job ran and bacula tried to verify the fileset for the second job
> instead. It seems like it ignores the fileset in the verify Job and
> uses whatever Job was last run on the client instead of what I told it
> to do.
>
> John
>
--
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today.
http://p.sf.net/sfu/quest-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Verify Catalog
2011/5/31 Rickifer Barros :
> Hello Bacula Users,
>
> I'm trying to test the Verify Job but, how I could understand, I have to
> create another catalog just for verifications, but I'm not getting do this.
> I have installed Bacula on Debian through the aptitude with PostGre. Now I
> dont know how create this catalog. I've tried create a db called "verify"
> and configured the Director:
>
> Catalog {
> Name = Verification
> dbname = verify; DB Address = ""; dbuser = "bacula"; dbpassword = "###"
> }
>
No you do not want a separate catalog for verify. The example in the
manual is for using Bacula to track changes in files that are not part
of your backups.
> ...so, I cannot even connect at the Director via console.
>
> What I need to do to use this Verify Job.
>
Just the job definition. And the job levels "VolumeToCatalog" or "DiskToCatalog"
Be careful however. The last time I checked this Verify did not work
correctly. And what I mean about that is I had more than 1 job for a
client and in the verify command I specified the fileset for the first
job ran and bacula tried to verify the fileset for the second job
instead. It seems like it ignores the fileset in the verify Job and
uses whatever Job was last run on the client instead of what I told it
to do.
John
--
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today.
http://p.sf.net/sfu/quest-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Verify Catalog
Hello Bacula Users,
I'm trying to test the Verify Job but, how I could understand, I have to
create another catalog just for verifications, but I'm not getting do this.
I have installed Bacula on Debian through the aptitude with PostGre. Now I
dont know how create this catalog. I've tried create a db called "verify"
and configured the Director:
Catalog {
Name = Verification
dbname = verify; DB Address = ""; dbuser = "bacula"; dbpassword = "###"
}
...so, I cannot even connect at the Director via console.
What I need to do to use this Verify Job.
Another thing...this type of Job is just to verify a group of file that
don't must change often. But, how about backup consistency checking, bacula
do this implicitly or I need do additional settings for this.
Thanks in advance.
Rickifer Barros.
--
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today.
http://p.sf.net/sfu/quest-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Network timeouts while running enormous backup
On Mon, May 30, 2011 at 11:33 PM, John Drescher wrote: >> I added a network interface to the backup server on the same segment >> as the client and the timeout disappeared, so it seems my firewall was >> expiring a TCP session somewhere along the line. Unsure whether it's a >> configuration problem on the Bacula or firewall side -- I expected the >> heartbeat to prevent this. >> >> Anyhow, I'm not sure Bacula is the right solution for this type of >> backup: the attribute despool has been running for nearly three days >> straight now. > > That is not normal. I have seen 30 minutes for 5 or so TB backup with > a few million files but never days. Do you have your database on a > server with at least 8GB of ram? Is your database on a raid 10 or SSD? I think you're right that database performance is the culprit here -- the database is postgresql running on the backup server. It's a RAID-10 volume on six SATA 7200RPM drives. The database itself lives on a different OS partition on the same volume as the spools. 2GB RAM and a dual-core Xeon 5110 aren't helping. An untuned postgresql has some potential for improvement without hardware changes, at least. >> Does anybody else have experience backing up tons of >> files? > > There are users that backup 30 TB containing millions of files in one > job on this list. So 50M files is not out of the ordinary? Thanks. Sorry for the newbie oversight. -SH -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Running multiple directors
Hi Craig, I haven't tested HA using Bacula, but I've done it for another type of service using Keepalived. http://www.keepalived.org/ In the case of having at least two Bacula Directors in different machines (one online and the other wating for the first to die), the storage should be in a different machine (Other than the first two). Bye! El 31/05/11 14:18, Craig Van Tassle escribió: > I was wondering if anyone had setup multiple directors in a kind of > High Availability setup, or if they run multiple directors how do you > setup the multiple directors? > > Thanks. > - CeSPI Centro Superior para el Procesamiento de la Información Universidad Nacional de La Plata --- Proteja el Medioambiente. No imprima este mail si no es absolutamente necesario -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Newbie question about labelling tapes for certain days
2011/5/31 "Stefan Günther" : > Hi, > > °Why do you want to do that? Lets Bacula manages all the tapes. > ° > Well, I would, but my client want's to have a visible prove that the monday > backup has been saved on the corresponding tape. > > °° Do I have to create a single pool for every single day together with a > single entry for every day in the schedule definition? > °°That would mean, that during labelling, I would assign the volume name > "monday", slot number "1" and pool "monday" ? > ° > °IMHO - It is not required. > ° > But how does Bacula then know which tape/volume it has to use? Just by > starting with the tape in slot1 on monday? > If you do label each day I would use separate pools otherwise at some point (holiday, missed backup ...) you will get out of sync and bacula will ask for a Friday tape on Monday.. John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Running multiple directors
I was wondering if anyone had setup multiple directors in a kind of High Availability setup, or if they run multiple directors how do you setup the multiple directors? Thanks. -- Craig Van Tassle HUBzero.org System Administrator YONG 1006 Desk Phone : (765)496-6413 -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Newbie question about labelling tapes for certain days
Hi, °Why do you want to do that? Lets Bacula manages all the tapes. ° Well, I would, but my client want's to have a visible prove that the monday backup has been saved on the corresponding tape. °° Do I have to create a single pool for every single day together with a single entry for every day in the schedule definition? °°That would mean, that during labelling, I would assign the volume name "monday", slot number "1" and pool "monday" ? ° °IMHO - It is not required. ° But how does Bacula then know which tape/volume it has to use? Just by starting with the tape in slot1 on monday? Thanks, Stefan ___ Schon gehört? WEB.DE hat einen genialen Phishing-Filter in die Toolbar eingebaut! http://produkte.web.de/go/toolbar -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backing up windows via SMB ?
On Tue, May 31, 2011 at 12:15 PM, SSzretter wrote: > According to the bacula feature set it supports backing up a windows machine > via SMB file share. How do you configure this? > > For example, I would imagine somewhere I need to specify \\machinename\c$ > You can mount the windows share on a linux box (or other *nix variant) and back that up. On linux you probably want mount.cifs that is unless you have an old distro. John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Newbie question about labelling tapes for certain days
Hello, 2011/5/31 "Stefan Günther" > > I already wrote the days Mon-Sun on the tapes. > > Good for you. > My question now is, who do I tell Bacula to use the "monday" tape in slot 1 > for the backup on monday evening and so on? > > Why do you want to do that? Lets Bacula manages all the tapes. If you would like to get all Monday's backups on single tape (and others days backups on others tapes) set a Volume Use Duration parameter of the Pool. Bacula will use any tape for a given time only. > Do I have to create a single pool for every single day together with a > single entry for every day in the schedule definition? > > That would mean, that during labelling, I would assign the volume name > "monday", slot number "1" and pool "monday" ? > > IMHO - It is not required. best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] backing up windows via SMB ?
According to the bacula feature set it supports backing up a windows machine via SMB file share. How do you configure this? For example, I would imagine somewhere I need to specify \\machinename\c$ ? +-- |This was sent by sszret...@hotmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] diff between last backup and actual filesystem content
On 05/31/11 11:51, Radosław Korzeniewski wrote: > I think a simplest way to recover from above situation is to restore all > files from a backup to original location with option for never overwrite > an existing files. Something like this: True, 'never overwrite' would be even safer. There's always the chance something mucked with a timestamp in an unexpected way. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Newbie question about labelling tapes for certain days
Hello, I have a tapeloader with 8 slots, filled with 7 backup tapes and a cleaning tape. I already wrote the days Mon-Sun on the tapes. My question now is, who do I tell Bacula to use the "monday" tape in slot 1 for the backup on monday evening and so on? Do I have to create a single pool for every single day together with a single entry for every day in the schedule definition? That would mean, that during labelling, I would assign the volume name "monday", slot number "1" and pool "monday" ? Thanks for any help or suggestions, Stefan ___ Schon gehört? WEB.DE hat einen genialen Phishing-Filter in die Toolbar eingebaut! http://produkte.web.de/go/toolbar -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: diff between last backup and actual filesystem content
On Tue, May 31, 2011 at 11:56 AM, Phil Stracchino wrote: > On 05/31/11 10:44, John Drescher wrote: >> On Tue, May 31, 2011 at 10:11 AM, s ancelot wrote: >>> Hi everybody ! >>> I accidentally deleted some parts of a filesystem that is backed up >>> periodically, but I do not know exactly which files have been dropped >>> (rm -rf ,and CTRL C...) >>> >>> So, Is there is a way to compare what changed from the last backup and >>> the actual disk filesystem content in order to restore only these files >>> in a folder ? >>> >> >> How about restoring the folder to a different location then doing a >> diff to see what is different between the two locations? > > There's another, simpler approach: Restore the entire damaged > filesystem, with REPLACE set to 'only if newer'. > Hmm. I forgot about that. I do not restore often. Sorry about the wrong advice.. John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: diff between last backup and actual filesystem content
On 05/31/11 10:44, John Drescher wrote: > On Tue, May 31, 2011 at 10:11 AM, s ancelot wrote: >> Hi everybody ! >> I accidentally deleted some parts of a filesystem that is backed up >> periodically, but I do not know exactly which files have been dropped >> (rm -rf ,and CTRL C...) >> >> So, Is there is a way to compare what changed from the last backup and >> the actual disk filesystem content in order to restore only these files >> in a folder ? >> > > How about restoring the folder to a different location then doing a > diff to see what is different between the two locations? There's another, simpler approach: Restore the entire damaged filesystem, with REPLACE set to 'only if newer'. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] diff between last backup and actual filesystem content
Hello, 2011/5/31 s ancelot > I accidentally deleted some parts of a filesystem that is backed up > periodically, but I do not know exactly which files have been dropped > (rm -rf ,and CTRL C...) > > So, Is there is a way to compare what changed from the last backup and > the actual disk filesystem content in order to restore only these files > in a folder ? > > Why do you want to do that? I think a simplest way to recover from above situation is to restore all files from a backup to original location with option for never overwrite an existing files. Something like this: Using Catalog "MyCatalog" Run Restore job JobName: RestoreFiles Bootstrap: /var/bacula/working/debian-dir.restore.3.bsr Where: Replace: always FileSet: Full Set Backup Client: debian-fd Restore Client: debian-fd Storage: File When:2011-05-31 17:51:22 Catalog: MyCatalog Priority:10 Plugin Options: *None* OK to run? (yes/mod/no): mod Parameters to modify: 1: Level 2: Storage 3: Job 4: FileSet 5: Restore Client 6: When 7: Priority 8: Bootstrap 9: Where 10: File Relocation 11: Replace 12: JobId 13: Plugin Options Select parameter to modify (1-13): 11 Replace: 1: always 2: ifnewer 3: ifolder 4: never You can choose recommended option: never. If some file exist on filesystem (thus was not deleted) it will be skipped from restoration and you will restore everything else. best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula slow transfer / Compression latency / feature request
On 05/30/2011 02:11 PM, reiserfs wrote:
> Hello, im new with Bacula scene, i have used the HP Dataprotector with a HP
> Library fiber channel backup.
>
> With the Dataprotector i got 1gbps interfaces and switch and all jobs get
> done very fast, with transfer like 50-80MB/s.
>
> Now im using Bacula with a DELL TL2000 iSCSI, and with my first experience i
> got only 6MB/s transfer with 1gbps interfaces and switch.
>
> So what im missing
>
> Used to tes:
> Bacula Director runing on Slackware64 13.1
> Bacula Cliente Windows 2003 Server
Turning on software gzip compression on the client is definitely a major
performance killer, unfortunately, so that would be my first guess as
well. This looks like a good place to mention some testing I've done.
I've been doing some testing lately due to also being somewhat
aggravated as the apparently slow transfer rates I get during Bacula
backups, but it's starting to look like it's not really Bacula's fault
most of the time. Most of the time, it looks like the problem is just
how fast the client can read files off of the disk and send them. The
network (at least on Gb) is not usually the problem, nor even database
activity on the director (attribute spooling will help if you DO have
any problems with that).
Encryption and gzip compression by the client introduce major latency
that unavoidably slows down the transfer, and this isn't specifically a
bacula client issue. Other things I have seen that cause major
slowdowns are antivirus software on Windows (particularly "on-access
scanning") and active use of the computer while the backup is running.
Regarding compression, specifically, though - testing on my laptop here,
I tested just reading files from /usr and /home with "tar", piping them
through "pv" to get the transfer rate (and then dumping them directly to
/dev/null). I repeated the tests then with some different compression
schemes inserted.
for example:
tar -cf - /usr | pv -b -r -a > /dev/null ("No Compression")
tar -cf - /usr | gzip -c | pv -b -r -a > /dev/null ("GZIP")
tar -cf - /usr | gzip -1 -c | pv -b -r -a > /dev/null ("GZIP1")
tar -cf - /usr/ | lzop -c | pv -b -r -a > /dev/null ("LZO")
(and repeated for /home)
Here are my results:
/usr
No Compression: 5.58GB total data, Avg 13.1MB/s (436s to finish)
GZIP: 2.11GB Total data, Avg 2.97MB/s (727s to finish)
GZIP1: 2.36GB Total data, Avg 4.13MB/s (585s to finish)
LZO: 2.82GB Total Data, Avg 6.48MB/s (445s to finish)
/home (includes a lot of e.g. media files that are not very compressible)
No Compression: 91.56GB Total Data, 34.5MB/s Avg,, (~2700s to finish)
GZIP: 77.1GB Total Data, 9.78MB/s Avg, (8072s to finish)
GZIP1: 77.6GB Total Data, 11.7MB/s Avg, (~6790s to finish)
LZO: 80.6GB Total Data, 28.3MB/s Avg, (~2900s to finish)
So, yes, if you have gzip compression turned on, you'll almost certainly
see a huge increase in speed if you turn it off (I believe most tape
drives can or will do compression in hardware, so you don't need to
pre-compress at the client).
If you are backing up to disk as I am (or for some reason aren't doing
hardware compression on the tape drive), you can also get a small speed
increase by dropping the gzip compression down to the minimum
("Compress=GZIP1" in the FileSet), which seem to compress almost as well
overall but induces less latency.
FEATURE REQUEST:
However, assuming my tests so far are representative, it looks like LZO
compression can get backup jobs transferred in almost the same amount of
time as no compression at all, while still substantially reducing the
amount of data transferred and stored (not as much as GZIP does, but
still a noteworthy amount). Is it possible we could get a
"Compress=LZOP" capability added to bacula-fd?
tl;dr: Turn off compression until and unless an LZO compression option
is implemented, unless you are desperate for space on your backup media,
in which case you'll just have to cope with the slow backups.
--
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today.
http://p.sf.net/sfu/quest-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Clarification on Exchange plugin
On Wed, Jun 01, 2011 at 01:01:39AM +1000, James Harper wrote: > > The error I am getting is the following: > > > > bacula-dir Start Backup JobId 59, > Job=Backup_Exchange.2011-05-31_10.40.23_29 > > > > Using Device "FileStorage" > > > > > > sbs-fd Warning: VSS was not initialized properly. VSS support is > disabled. > > ERR=An attempt was made to reference a token that does not exist. > > > > Fatal error: /home/kern/bacula/k/bacula/src/filed/fd_plugins.c:223 > Command > > plugin "exchange:@EXCHANGE/Microsoft Information Store" requested, but > is not > > loaded. > > bacula-sd Volume "HERE" previously written, moving to end of data. > Ready to > > append to end of Volume "HERE" size=12959845363 > > bacula-dir > > > > Questions I should have asked you earlier... this looks a lot like you > are trying to run a 32 bit fd on a 64 bit windows system with those VSS > failures. Is that the case? If so, you probably aren't using Exchange > 2003, and I'm pretty sure that the plugin doesn't work on anything > newer. It was supposed to work on 2007 too: http://www.bacula.org/manuals/en/concepts/concepts/New_Features.html#SECTION00320 -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Moving a volume to a pool doens't inherit the correct Volume Use Duration
On 5/31/2011 8:50 AM, Mauro Colorio wrote:
>> I actually don't think it's a BUG, when you put your tapes on the Scratch
>> Pool using "label barcodes", the volumes will inherit any configuration on
>> that pool, and only if that volume gets cycled to the Daily Pool
>> automatically by Bacula using the "Scratch Pool = Scratch" parameter I told
>> you about before is when these parameters from the Daily Pool are set on the
>> Volume...
> For my management I label volumes with barcode like DAY001L4 DAY002L4
> WEK001L4 and so on
> while there is not a way to bring a volume from the Scratch pool by
> label mask (for example DAY*)
> I've to move them manually, and I think that when you move a volume to
> a pool (even manually)
> you *want* that the volume inherit configuration from the new Pool and
> not to keep old values,
> at least this is my opinion,
> otherwise which sense has to set this params in the Pool configuration
> and not on the Volume directly?
Or you can define multiple scratch pools in bacula-dir. For example,
pool Week could use volumes from the default Scratch pool and pool Day
could use volumes from an additional scratch pool named Day_Scratch. :
pool {
Name = "Scratch"
Pool Type = Backup
Recycle = yes
RecyclePool = Scratch
}
pool {
Name = "Day_Scratch"
Pool Type = Backup
Recycle = yes
RecyclePool = Day_Scratch
}
pool {
Name = "Week"
Pool Type = Backup
Recycle = yes
AutoPrune = yes
ScratchPool = Scratch
...
}
pool {
Name = "Day"
Pool Type = Backup
Recycle = yes
AutoPrune = yes
ScratchPool = "Day_Scratch"
...
}
--
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today.
http://p.sf.net/sfu/quest-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Clarification on Exchange plugin
> The error I am getting is the following: > > bacula-dir Start Backup JobId 59, Job=Backup_Exchange.2011-05-31_10.40.23_29 > > Using Device "FileStorage" > > > sbs-fd Warning: VSS was not initialized properly. VSS support is disabled. > ERR=An attempt was made to reference a token that does not exist. > > Fatal error: /home/kern/bacula/k/bacula/src/filed/fd_plugins.c:223 Command > plugin "exchange:@EXCHANGE/Microsoft Information Store" requested, but is not > loaded. > bacula-sd Volume "HERE" previously written, moving to end of data. Ready to > append to end of Volume "HERE" size=12959845363 > bacula-dir > Questions I should have asked you earlier... this looks a lot like you are trying to run a 32 bit fd on a 64 bit windows system with those VSS failures. Is that the case? If so, you probably aren't using Exchange 2003, and I'm pretty sure that the plugin doesn't work on anything newer. James -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] diff between last backup and actual filesystem content
On Tue, May 31, 2011 at 10:43 AM, s ancelot wrote: > On 31/05/2011 16:43, John Drescher wrote: >> On Tue, May 31, 2011 at 10:11 AM, s ancelot wrote: >> >>> Hi everybody ! >>> >>> >>> I have had following problem : >>> >>> I accidentally deleted some parts of a filesystem that is backed up >>> periodically, but I do not know exactly which files have been dropped >>> (rm -rf ,and CTRL C...) >>> >>> So, Is there is a way to compare what changed from the last backup and >>> the actual disk filesystem content in order to restore only these files >>> in a folder ? >>> >>> >> How about restoring the folder to a different location then doing a >> diff to see what is different between the two locations? >> >> John >> > Yes, I agrea it would be a solution, but it sounds to me an old and long > method, and need some disk space. > I had seen more powerful backups system in the past, are you sure there > are no other ways > You could also do a verify level disktocatalog. However I believe that would only work if the last backup you ran on client was the backup you want to compare. That is unless bacula fixed this bug. John -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] diff between last backup and actual filesystem content
On 31/05/2011 16:43, John Drescher wrote: > On Tue, May 31, 2011 at 10:11 AM, s ancelot wrote: > >> Hi everybody ! >> >> >> I have had following problem : >> >> I accidentally deleted some parts of a filesystem that is backed up >> periodically, but I do not know exactly which files have been dropped >> (rm -rf ,and CTRL C...) >> >> So, Is there is a way to compare what changed from the last backup and >> the actual disk filesystem content in order to restore only these files >> in a folder ? >> >> > How about restoring the folder to a different location then doing a > diff to see what is different between the two locations? > > John > Yes, I agrea it would be a solution, but it sounds to me an old and long method, and need some disk space. I had seen more powerful backups system in the past, are you sure there are no other ways Regards Steph -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: diff between last backup and actual filesystem content
-- Forwarded message -- From: John Drescher Date: Tue, May 31, 2011 at 10:43 AM Subject: Re: [Bacula-users] diff between last backup and actual filesystem content To: s ancelot On Tue, May 31, 2011 at 10:11 AM, s ancelot wrote: > Hi everybody ! > > > I have had following problem : > > I accidentally deleted some parts of a filesystem that is backed up > periodically, but I do not know exactly which files have been dropped > (rm -rf ,and CTRL C...) > > So, Is there is a way to compare what changed from the last backup and > the actual disk filesystem content in order to restore only these files > in a folder ? > How about restoring the folder to a different location then doing a diff to see what is different between the two locations? John -- John M. Drescher -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] diff between last backup and actual filesystem content
Hi everybody ! I have had following problem : I accidentally deleted some parts of a filesystem that is backed up periodically, but I do not know exactly which files have been dropped (rm -rf ,and CTRL C...) So, Is there is a way to compare what changed from the last backup and the actual disk filesystem content in order to restore only these files in a folder ? I am a little bit furious with my network administrator since he told me that is not possibleI don't think so... ? Regards S.Ancelot -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Clarification on Exchange plugin
On Tue, May 31, 2011 at 10:52:21AM +0100, Marc Goujon wrote:
> This is my client configurations, and in the Plugin directory I have
> exchange-fd.dll.
>
>
> FileDaemon {# this is me
> Name = sbs-fd
> FDport = 9102# where we listen for the director
> WorkingDirectory = "C:/Program Files/Bacula/working"
> Pid Directory = "C:/Program Files/Bacula/working"
> Plugin Directory = "C:/Program Files/Bacula/plugins"
> Maximum Concurrent Jobs = 10
> }
>
> My fileSet is the one you suggested:
>
>
> FileSet {
> Name = "Exchange"
> Include {
>Options {
> signature = MD5
> compression = GZIP9
> IgnoreCase = yes
> }
> Plugin = "exchange:@EXCHANGE/Microsoft Information Store"
>
> }
> }
>
>
>
>
> The error I am getting is the following:
>
> bacula-dir Start Backup JobId 59, Job=Backup_Exchange.2011-05-31_10.40.23_29
>
> Using Device "FileStorage"
>
>
> sbs-fd Warning: VSS was not initialized properly. VSS support is disabled.
> ERR=An attempt was made to reference a token that does not exist.
>
> Fatal error: /home/kern/bacula/k/bacula/src/filed/fd_plugins.c:223 Command
> plugin "exchange:@EXCHANGE/Microsoft Information Store" requested, but is not
> loaded.
> bacula-sd Volume "HERE" previously written, moving to end of data. Ready to
> append to end of Volume "HERE" size=12959845363
> bacula-dir
>
>
> I have taken note about the problem with the restore situation, but any help
> to sort this would be great.
Sorry, I think I have reached my limit of what I can help you with.
All I can suggest is that you check everything again and if everything looks
right to you, add some debug to relevant areas of the code.
It seems from the last error message that the exchange plugin wasn't loaded.
And upgrade to bacula-5.0.3 if you're not there already.
> marc
>
>
>
> On 26/05/11 14:24, Graham Keeling wrote:
> >On Thu, May 26, 2011 at 01:50:39PM +0100, Marc Goujon wrote:
> >>Hello,
> >>
> >>I know this might have been asked millions of times before, but I cannot
> >>seem to locate clear information via the archives or the official
> >>documentation and I feel I am almost there.
> >>
> >> From what I have understood, the Exchange plugin is basically that
> >>exchange-fd.dll file. The first question is: is that enough? I ask this
> >>because while reading the archives someone mentioned that bpipe plugin
> >>was needed, however the documentation says "The purpose of the plugin is
> >>to provide an interface to any system program for backup and restore".
> >>So... a plugin requires another plugin? Is bpipe just allowing to
> >>include plugin = "" expressions in the file sets?
> >>
> >>Secondly, my config for the director (a linux machine) says:
> >>
> >>FileSet {
> >>Name = "Exchange"
> >>#Enable VSS = yes
> >>Include {
> >>
> >>File = "C:\\Program Files\\Microsoft\\Exchange Server\\Mailbox"
> >>Plugin = "exchange:@EXCHANGE/Microsoft Information Store"
> >>
> >>}
> >>
> >>Exclude {
> >> File = "C:\\Program
> >>Files\\Microsoft\\Exchange\\Mailbox\\First Storage Group\\Mailbox
> >>Database.edb"
> >> File = "C:\\Program
> >>Files\\Microsoft\\Exchange\\Mailbox\\First Storage Group\\Mailbox
> >>Database.edb"
> >> File = "C:\\Program
> >>Files\\Microsoft\\Exchange\\Mailbox\\Second Storage Group\\Public Folder
> >>Database.edb"
> >>
> >> }
> >>}
> >>
> >>However when my job fails, I get the following error:
> >>
> >>sbs-fd Cannot open "C:\Program Files\Microsoft\Exchange
> >>Server\Mailbox/First Storage Group/Mailbox Database.edb": ERR=The
> >>process cannot access the file because it is being used by another process.
> >>
> >>sbs-fd Cannot open "C:\Program Files\Microsoft\Exchange
> >>Server\Mailbox/Second Storage Group/Public Folder Database.edb": ERR=The
> >>process cannot access the file because it is being used by another process.
> >>
> >> Fatal error: /home/kern/bacula/k/bacula/src/filed/fd_plugins.c:223
> >> Command plugin "exchange:@EXCHANGE/Microsoft Information Store" requested,
> >> but is not loaded.
> >>
> >>
> >>There must be something I am missing here, as although those files are
> >>explicitly excluded, they are still causing the error?
> >>
> >>Any tips or docs you can point me to would be greatly appreciated.
> >a) I think you should only use forward slashes ('/') in your filesets, not
> >backslashes.
> >
> >b) This is the fileset that I used to use:
> >
> >FileSet {
> > Name = "Windows:2k3-pt2:Windows Exchange Server data"
> > Include {
> > Options {
> > signature = MD5
> > compression = GZIP9
> > IgnoreCase = yes
> > }
> > Plugin = "exchange:/@EXCHANGE/Microsoft Information Store"
> > }
> >}
> >
> >c) Be very very careful with this. I believe that the plugin doesn't work
> >properly. Specifical
Re: [Bacula-users] How to disable Auto Pruning of Jobs older than 6 months.
Thanks Radoslaw. I was not aware that (1) client definitions in bacula-dir.conf
could specify their own file/job retention and pruning values and that (2)
bacula already had this default values for clients:
File Retention = 30 days# 30 days
Job Retention = 6 months# six months
AutoPrune = yes # Prune expired Jobs/Files
Problem solved!
Cheers,
Rodrigo
From: Radosław Korzeniewski [mailto:rados...@korzeniewski.net]
Sent: Tuesday, May 31, 2011 8:55 AM
To: rodrigo.fer...@pop.com.br
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] How to disable Auto Pruning of Jobs older than 6
months.
Hello,
2011/5/31 Rodrigo Ferraz
-> 30-May 23:25 br01 JobId 1227: Begin pruning Jobs older than 6 months .
-> 30-May 23:26 br01 JobId 1227: Pruned 1 Job for client mx01 from catalog.
-> 30-May 23:26 br01 JobId 1227: Begin pruning Jobs.
-> 30-May 23:26 br01 JobId 1227: No Files found to prune.
-> 30-May 23:26 br01 JobId 1227: End auto prune.
Pool {
Name = Mensal
Pool Type = Backup
Recycle = no
AutoPrune = no
Volume Use Duration = 5 days
Volume Retention = 5 years
LabelFormat = "M${Month:p/2/0/r}${Year}"
}
Check your config with console:
* show client=mx01
* show pool=Mensal
and correct it respectively.
best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net
--
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today.
http://p.sf.net/sfu/quest-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Recycling incremental
OA staff if you need to recycle a full pool and a piece of incremental contained in an HD possible? Is there any way to restore a number of incremental, but not all at once or have to follow the order of the incremental type and then restore the full icrementais in order? use the bconsole. Thanks -- Cleuson de Oliveira Alves Analista de Suporte Rio de Janeiro - RJ -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Moving a volume to a pool doens't inherit the correct Volume Use Duration
> I actually don't think it's a BUG, when you put your tapes on the Scratch > Pool using "label barcodes", the volumes will inherit any configuration on > that pool, and only if that volume gets cycled to the Daily Pool > automatically by Bacula using the "Scratch Pool = Scratch" parameter I told > you about before is when these parameters from the Daily Pool are set on the > Volume... For my management I label volumes with barcode like DAY001L4 DAY002L4 WEK001L4 and so on while there is not a way to bring a volume from the Scratch pool by label mask (for example DAY*) I've to move them manually, and I think that when you move a volume to a pool (even manually) you *want* that the volume inherit configuration from the new Pool and not to keep old values, at least this is my opinion, otherwise which sense has to set this params in the Pool configuration and not on the Volume directly? bye Mauro -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Network timeouts while running enormous backup
Hello, 2011/5/30 S H > Anyhow, I'm not sure Bacula is the right solution for this type of > backup: the attribute despool has been running for nearly three days > straight now. Does anybody else have experience backing up tons of > files? Any recommendations on making it not suck? > > Check your database performance and if your environment support batch inserts (HAVE_BATCH_FILE_INSERT in config.h). best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
Hello, 2011/5/31 Geert Stappers > > > >> > > Does exist any configuration option for that? > > > >> > > > > > >> > No. > > > >> > > [ delete files after backup ] > } } }} } And a backup tool should never ever delete files. > Well, you try to avoid a dangerous situation, but almost all existing backup tools (including bacula) can overwrite an existing files during restore process. This is dangerous too. > > > >> Not yet... :) > } } }} Notice the evil grin in that smiley > Why? "Not yet" means: developers are working hard to implement a such functionality. > > > > IMNSHO it allready exists, it is named 'RunAfterJob' > } } } Use that to shoot your self in the foot > } } } and surely don't come whining: "Archive option did destroy my data" > > Agreed. :) best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to disable Auto Pruning of Jobs older than 6 months.
On Tue, 31 May 2011 08:34:34 -0300 "Rodrigo Ferraz" wrote: > Hello > > We're facing this situation where all of our past jobs, such as > montly-based backups and anything older than 6 months, is getting > purged from the database. This su*cks a lot, since we need to rescan > a whole tape (with bscan) and reimport everything about it back to > the database to execute a simple restore. And to get worst: as soon > as this restore job is completed everything that was imported back to > the database with the bscan gets again automatically pruned, as below: [...] Check out retention period on your voulmes, using something like llist volume=M112010 in bconsole. The idea is that volumes only use their pool definition as a template when they are created there; once they get their retention period recorded, it won't change except by an operator. To change the retention period, use update volume=M112010 and follow the questions. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to disable Auto Pruning of Jobs older than 6 months.
Hello,
2011/5/31 Rodrigo Ferraz
> -> 30-May 23:25 br01 JobId 1227: Begin pruning Jobs older than 6 months .
> -> 30-May 23:26 br01 JobId 1227: Pruned 1 Job for client mx01 from catalog.
> -> 30-May 23:26 br01 JobId 1227: Begin pruning Jobs.
> -> 30-May 23:26 br01 JobId 1227: No Files found to prune.
> -> 30-May 23:26 br01 JobId 1227: End auto prune.
>
> Pool {
> Name = Mensal
> Pool Type = Backup
> Recycle = no
> AutoPrune = no
> Volume Use Duration = 5 days
> Volume Retention = 5 years
> LabelFormat = "M${Month:p/2/0/r}${Year}"
> }
>
>
Check your config with console:
* show client=mx01
* show pool=Mensal
and correct it respectively.
best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net
--
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today.
http://p.sf.net/sfu/quest-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] IBM TS2240 Tape Drive
Thanks Rodrigo... I will really see when my tape drive arrive. On Tue, May 31, 2011 at 12:28 AM, Rodrigo Renie Braga < rodrigore...@gmail.com> wrote: > Sorry, no experience on that specific Tape Drive, but if your OS support > that hardware (i.e the devices for bacula-sd to read/write on are created), > than Bacula will work without problems with it... > > 2011/5/30 Rickifer Barros > >> Hello Everyone, >> >> I would like to know if somebody here have used Bacula with the IBM TS2240 >> Tape Drive. I will buy this Tape Drive and I intend to use Bacula in it. The >> TD didn't arrive yet then I couldn't test it with Bacula. >> >> K R >> >> Thanks. >> >> >> -- >> vRanger cuts backup time in half-while increasing security. >> With the market-leading solution for virtual backup and recovery, >> you get blazing-fast, flexible, and affordable data protection. >> Download your free trial now. >> http://p.sf.net/sfu/quest-d2dcopy1 >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users >> >> > -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to disable Auto Pruning of Jobs older than 6 months.
Hello
We're facing this situation where all of our past jobs, such as montly-based
backups and anything older than 6 months, is getting purged from the
database. This su*cks a lot, since we need to rescan a whole tape (with
bscan) and reimport everything about it back to the database to execute a
simple restore. And to get worst: as soon as this restore job is completed
everything that was imported back to the database with the bscan gets again
automatically pruned, as below:
30-May 21:31 br01 JobId 1227: Start Restore Job
RestoreFiles.2011-05-30_21.31.56_04
30-May 21:32 br01 JobId 1227: Using Device "LTO-3"
30-May 21:32 br01 JobId 1227: Ready to read from volume "M112010" on device
"LTO-3" (/dev/nst0).
30-May 23:25 br01 JobId 1227: End of Volume at file 381 on device "LTO-3"
(/dev/nst0), Volume "M112010"
30-May 23:25 br01 JobId 1227: End of all volumes.
30-May 23:25 br01 JobId 1227: Bacula br01 5.0.3 (30Aug10): 30-May-2011
23:25:57
Build OS: x86_64-redhat-linux-gnu redhat
JobId: 1227
Job:RestoreFiles.2011-05-30_21.31.56_04
Restore Client: mx01
Start time: 30-May-2011 21:31:58
End time: 30-May-2011 23:25:57
Files Expected: 303
Files Restored: 303
Bytes Restored: 116,306,589
Rate: 17.0 KB/s
FD Errors: 0
FD termination status: OK
SD termination status: OK
Termination:Restore OK
-> 30-May 23:25 br01 JobId 1227: Begin pruning Jobs older than 6 months .
-> 30-May 23:26 br01 JobId 1227: Pruned 1 Job for client mx01 from catalog.
-> 30-May 23:26 br01 JobId 1227: Begin pruning Jobs.
-> 30-May 23:26 br01 JobId 1227: No Files found to prune.
-> 30-May 23:26 br01 JobId 1227: End auto prune.
So, there are two problems:
1) Backups older than 6 months are getting auto pruned from the database
2) Backups rescanned with bscan are also being auto pruned from the database
after a restore
I would like to ask your help or any tip on how to prevent these two things
from happening again. Is it a 'by-design' feature that we can't get rid of?
This is my pool configuration, which clearly states "no auto pruning" for
the Mensal ("monthly" in Portuguese) pool. (Is anything wrong with that?)
Pool {
Name = Default
Pool Type = Backup
Recycle = no
AutoPrune = no
Volume Retention = 5 years
}
Pool {
Name = Semanal
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Use Duration = 5 days
Volume Retention = 28 days
Recycle Oldest Volume = yes
#Purge Oldest Volume = yes
Maximum Volumes = 5
}
Pool {
Name = Mensal
Pool Type = Backup
Recycle = no
AutoPrune = no
Volume Use Duration = 5 days
Volume Retention = 5 years
LabelFormat = "M${Month:p/2/0/r}${Year}"
}
Pool {
Name = Scratch
Pool Type = Backup
}
And this is the list of tapes which jobs are not in the database anymore:
Pool: Mensal
+-++---+-+-+--+-
-+-+--+---+---+-
+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes| VolFiles |
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten
|
+-++---+-+-+--+-
-+-+--+---+---+-
+
| 16 | M072010| Used | 1 | 381,731,761,152 | 385 |
157,680,000 | 1 |0 | 0 | LTO-3 | 2010-07-06 01:53:04 |
| 19 | M082010| Used | 1 | 417,379,673,088 | 421 |
157,680,000 | 1 |0 | 0 | LTO-3 | 2010-08-04 11:28:41 |
| 22 | M092010| Used | 1 | 431,307,426,816 | 435 |
157,680,000 | 1 |0 | 0 | LTO-3 | 2010-09-07 02:15:09 |
| 24 | M102010| Used | 1 | 440,557,544,448 | 444 |
157,680,000 | 1 |0 | 0 | LTO-3 | 2010-10-05 18:07:07 |
| 35 | M112010| Read-Only | 1 | 450,581,448,268 | 455 |
157,680,000 | 1 |0 | 0 | LTO-3 | 2010-11-02 02:29:38 |
| 38 | M122010| Used | 1 | 514,146,769,920 | 518 |
157,680,000 | 1 |0 | 0 | LTO-3 | 2010-12-07 02:50:54 |
| 39 | M012011| Used | 1 | 458,172,610,560 | 462 |
157,680,000 | 0 |0 | 0 | LTO-3 | 2011-01-04 16:58:26 |
| 40 | M022011| Used | 1 | 467,344,281,600 | 472 |
157,680,000 | 0 |0 | 0 | LTO-3 | 2011-02-08 02:36:22 |
| 41 | M032011| Used | 1 | 472,022,756,352 | 476 |
157,680,000 | 0 |0 | 0 | LTO-3 | 2011-03-10 01:06:03 |
| 42 | M042011| Used | 1 | 475,821,739,008 | 480 |
157,680,000 | 0 |0 | 0 | LTO-3 | 2011-04-05 02:45:00 |
| 43 | M052011| Append| 1 | 477,475,375,104 |
Re: [Bacula-users] Clarification on Exchange plugin
This is my client configurations, and in the Plugin directory I have
exchange-fd.dll.
FileDaemon {# this is me
Name = sbs-fd
FDport = 9102# where we listen for the director
WorkingDirectory = "C:/Program Files/Bacula/working"
Pid Directory = "C:/Program Files/Bacula/working"
Plugin Directory = "C:/Program Files/Bacula/plugins"
Maximum Concurrent Jobs = 10
}
My fileSet is the one you suggested:
FileSet {
Name = "Exchange"
Include {
Options {
signature = MD5
compression = GZIP9
IgnoreCase = yes
}
Plugin = "exchange:@EXCHANGE/Microsoft Information Store"
}
}
The error I am getting is the following:
bacula-dir Start Backup JobId 59, Job=Backup_Exchange.2011-05-31_10.40.23_29
Using Device "FileStorage"
sbs-fd Warning: VSS was not initialized properly. VSS support is disabled.
ERR=An attempt was made to reference a token that does not exist.
Fatal error: /home/kern/bacula/k/bacula/src/filed/fd_plugins.c:223 Command
plugin "exchange:@EXCHANGE/Microsoft Information Store" requested, but is not
loaded.
bacula-sd Volume "HERE" previously written, moving to end of data. Ready to
append to end of Volume "HERE" size=12959845363
bacula-dir
I have taken note about the problem with the restore situation, but any help to
sort this would be great.
marc
On 26/05/11 14:24, Graham Keeling wrote:
> On Thu, May 26, 2011 at 01:50:39PM +0100, Marc Goujon wrote:
>> Hello,
>>
>> I know this might have been asked millions of times before, but I cannot
>> seem to locate clear information via the archives or the official
>> documentation and I feel I am almost there.
>>
>> From what I have understood, the Exchange plugin is basically that
>> exchange-fd.dll file. The first question is: is that enough? I ask this
>> because while reading the archives someone mentioned that bpipe plugin
>> was needed, however the documentation says "The purpose of the plugin is
>> to provide an interface to any system program for backup and restore".
>> So... a plugin requires another plugin? Is bpipe just allowing to
>> include plugin = "" expressions in the file sets?
>>
>> Secondly, my config for the director (a linux machine) says:
>>
>> FileSet {
>> Name = "Exchange"
>> #Enable VSS = yes
>> Include {
>>
>> File = "C:\\Program Files\\Microsoft\\Exchange Server\\Mailbox"
>> Plugin = "exchange:@EXCHANGE/Microsoft Information Store"
>>
>> }
>>
>> Exclude {
>> File = "C:\\Program
>> Files\\Microsoft\\Exchange\\Mailbox\\First Storage Group\\Mailbox
>> Database.edb"
>> File = "C:\\Program
>> Files\\Microsoft\\Exchange\\Mailbox\\First Storage Group\\Mailbox
>> Database.edb"
>> File = "C:\\Program
>> Files\\Microsoft\\Exchange\\Mailbox\\Second Storage Group\\Public Folder
>> Database.edb"
>>
>> }
>> }
>>
>> However when my job fails, I get the following error:
>>
>> sbs-fd Cannot open "C:\Program Files\Microsoft\Exchange
>> Server\Mailbox/First Storage Group/Mailbox Database.edb": ERR=The
>> process cannot access the file because it is being used by another process.
>>
>> sbs-fd Cannot open "C:\Program Files\Microsoft\Exchange
>> Server\Mailbox/Second Storage Group/Public Folder Database.edb": ERR=The
>> process cannot access the file because it is being used by another process.
>>
>>Fatal error: /home/kern/bacula/k/bacula/src/filed/fd_plugins.c:223
>> Command plugin "exchange:@EXCHANGE/Microsoft Information Store" requested,
>> but is not loaded.
>>
>>
>> There must be something I am missing here, as although those files are
>> explicitly excluded, they are still causing the error?
>>
>> Any tips or docs you can point me to would be greatly appreciated.
> a) I think you should only use forward slashes ('/') in your filesets, not
> backslashes.
>
> b) This is the fileset that I used to use:
>
> FileSet {
>Name = "Windows:2k3-pt2:Windows Exchange Server data"
>Include {
> Options {
>signature = MD5
>compression = GZIP9
>IgnoreCase = yes
> }
> Plugin = "exchange:/@EXCHANGE/Microsoft Information Store"
>}
> }
>
> c) Be very very careful with this. I believe that the plugin doesn't work
> properly. Specifically, it will restore from:
> * A full backup
> * A full backup, plus one incremental.
> But then it may not restore from:
> * A full backup, plus two incrementals.
> And be less and less likely to work for each incremental that you add.
> And without attempting to restore, it will seem as if it is working.
>
> See bacula bug number 0001647, which has the status "closed" with the
> resolution "won't fix":
> http://marc.info/?l=bacula-bugs&m=129690630228142&w=2
>
> You might be OK if you always did Full backups, but that defeats the point.
>
>
> -
Re: [Bacula-users] Bacula 5.0.3 Macintosh file daemon?
2011/5/27 Sean Clark : > On 05/27/2011 08:50 AM, Graham Keeling wrote: >> Hello, >> Does anybody know where I might be able to find a bacula-5.0.3 Mac file >> daemon? >> Or an installer? >> Thanks. > I recommend MacPort[1] for that. > > "port install bacula +client_only" > "port load bacula" (as I recall) > > [1] http://www.macports.org/install.php > > -- > vRanger cuts backup time in half-while increasing security. > With the market-leading solution for virtual backup and recovery, > you get blazing-fast, flexible, and affordable data protection. > Download your free trial now. > http://p.sf.net/sfu/quest-d2dcopy1 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > Take care with the ACL option if you need to backup ACL from your files. There is a bug with lasts OSX versions. Something may changed in the acl lib from Apple. Moreover I dont recomend to use port to install bacula because most of the time you are backing up a server. And on a server you dont have the need to install all the developper environnement ( Mac Port require XCode ) I think that the best way to install the osx FD is to install the XCode on a recent mac and then to compile and build it as a package. Never make a complete package with macport because if you want to keep the libraries that you used for compilation with mac port you will need to install all theses libraries via the package. If you want to deploy this same package on another machine that got port installed it will erase many directories of this port installation without warning. So use the sources from the github and ./configure then ./make -C ./platforms/osx Then you will have a package in the products subdirectory I hope you understood, I am not very good in english. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
Op 20110530 om 10:41 schreef Konstantin Khomoutov: > On Mon, 30 May 2011 09:24:06 +0200 Jérôme Blion wrote: > > >> > > [ delete files after backup ] > > >> > > Does exist any configuration option for that? > > >> > > > > >> > No. > > >> Not yet... :) > > > IMNSHO it allready exists, it is named 'RunAfterJob' > > That's not true. An archive function would only delete files which > > have been archived successfully. > > Performing an "simple" rm will not provide the same feature. As it > > will delete any file. > I don't see a real problem statement here: a job backs up a set of > files defined by a specific fileset, and if the said job completes > without errors, you're safe to `rm' every file referred to by that > fileset. I do see a serious design flaw. It is plain stupid to add data destruction to a backup tool. > P.S. > I'm not against the imaginary "archive function", just trying to clear > things up. To clear my mind, this is what I do read in this thread > > >> > > [ delete files after backup ] > > >> > > Does exist any configuration option for that? > > >> > > > > >> > No. } } }} } And a backup tool should never ever delete files. > > >> Not yet... :) } } }} Notice the evil grin in that smiley > > > IMNSHO it allready exists, it is named 'RunAfterJob' } } } Use that to shoot your self in the foot } } } and surely don't come whining: "Archive option did destroy my data" Cheers Geert Stappers http://m.xkcd.org/705 -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
