Re: [Bacula-users] Identifying volumes: suggestions for improvement
On Fri, Feb 27, 2009 at 1:14 PM, SZÉKELYI Szabolcs wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Hi, > > when Bacula (console) asks to specify a volume, it does so by requiring > the user to enter the label or the ID of the volume. This causes > problems if your tapes are labeled with numbers only, since from the > user's point of view it's ambiguous if it will interpret the entered > value as an ID or as a label. This actually happened when we wanted to > purge one of our volumes (irrelevant output truncated): > >> *purge jobs volume >> Defined Pools: >> 7: bacula-super-full-tape-Pool >> Select the Pool (1-9): 7 >> +-++---+ >> | MediaId | VolumeName | ... >> +-++---+ >> | 48 | 40 | Full | >> | 49 | 41 | Append | >> +-++---+ >> Enter MediaId or Volume name: 41 >> 1 File on Volume "08" purged from catalog. >> There are no more Jobs associated with Volume "08". Marking it purged. > > We wanted to purge the volume with label "41" (MediaId 49), and the > volume with label "08" (MediaId 41) got purged. > > There are two surprising things in this story: > > First, looking back, it's unclear if Bacula interprets the input as a > MediaId or a Label. A solution could be not using labels of numbers > only, however, this should be mentioned in the documentation (I couldn't > find it). A cleaner solution would be dropping the ambiguous question > and asking just the Label or just the MediaId, not in an "as it gets" > manner. > > Second, in the above example, Bacula purged a tape that was not part of > the selected pool. I understand why this happened (the list of volumes > is just informational), but as a naive user, I found it strange for the > first time. IMHO this should be checked before purging the tape. > > - -- I do not have time to look but there was a discussion on the list about this a few weeks ago. John -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] storage directories based on job names
On Fri, Feb 27, 2009 at 4:03 PM, Wolf wrote: >> -Original Message- >> From: John Drescher [mailto:dresche...@gmail.com] >> Sent: Friday, February 27, 2009 10:22 AM >> To: Wolf; bacula-users@lists.sourceforge.net >> Subject: Re: [Bacula-users] storage directories based on job names >> >> How about a different storage resource for each Job then you can put >> the storage where ever you want. >> >> John >> > > Correct me if I am wrong, but wouldn't that require making job specific > Storage, in bacula-dir.conf, and Device, in bacula-sd.conf, entries? > Yes it would. John -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] storage directories based on job names
> -Original Message- > From: John Drescher [mailto:dresche...@gmail.com] > Sent: Friday, February 27, 2009 10:22 AM > To: Wolf; bacula-users@lists.sourceforge.net > Subject: Re: [Bacula-users] storage directories based on job names > > How about a different storage resource for each Job then you can put > the storage where ever you want. > > John > Correct me if I am wrong, but wouldn't that require making job specific Storage, in bacula-dir.conf, and Device, in bacula-sd.conf, entries? -Adam -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Howto Backup Oracle with Bacula
Hello Everyone , I have writing/working in a howto to backup Oracle DB... and this is the first draft you can read it and send me yours comment and corrections ?? and if possible test this procedure ??? :-) thanks This Howto describe how run a backup Oracle Databases with Bacula without downtime. the principle of idea: In production environment downtimes of DB isn't allowed, for around this problem, we will need: 1 - Configure Oracle DB in backup mode 2 - Create a Snapshot from files 3 - Run a backup from files with bacula 4 - Configure Oracle DB in backup mode off. 5 - Destroy the Snapshot Our scenery is: Linux ;-) Bacula Oracle DB (version 10.2.0.0 or superior) In Linux we have: * 2 Logical Volumes - /dev/VG_DATA/oraappl - /dev/VG_DATA/oradata * Oracle Data is mounted in /var/oradata * Oracle Applicative is mounted in /opt/oraappl * Oracle Archive Logs is created in /var/respaldo/oracle/arch * and two folders for snapshots in /mnt/snapshots/ - /mnt/snapshots/var/oradata/ - /mnt/snapshots/opt/oraappl/ * Bacula client * Snapshots In Bacula we have: * RunBeforeJob and RunAfterJob directives that run commands/scripts before and after execute jobs. In Oracle we have: * Archive Log modes that "freeze" DBF files and send changes in database for "others" files (/var/backup/oracle/arch), allowed copy DBF files without data lost. * "ALTER DATABASE [BEGIN|END] BACKUP" command that configure "ALL" database in backup mode (before version 9i was necessary configure the tablespace individually). Well, now to work STEP 1 - Setup Oracle DB in backup and preparing files for backup --- 1.1 - Archive Log Mode First step is configure your Oracle DB for work in Archive Log modes, you can read this document: http://lbdwww.epfl.ch/f/teaching/courses/oracle9i/server.920/a96521/archredo.htm#6768 In my case, I send archive logs to folder /var/backup/oracle/arch 1.2 - Oracle DB backup mode Now, we need create a script called "start-backup-mode.sh" in /opt/oraappl/scripts with this content: #!/bin/bash sqlplus /nolog
[Bacula-users] Identifying volumes: suggestions for improvement
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, when Bacula (console) asks to specify a volume, it does so by requiring the user to enter the label or the ID of the volume. This causes problems if your tapes are labeled with numbers only, since from the user's point of view it's ambiguous if it will interpret the entered value as an ID or as a label. This actually happened when we wanted to purge one of our volumes (irrelevant output truncated): > *purge jobs volume > Defined Pools: > 7: bacula-super-full-tape-Pool > Select the Pool (1-9): 7 > +-++---+ > | MediaId | VolumeName | ... > +-++---+ > | 48 | 40 | Full | > | 49 | 41 | Append| > +-++---+ > Enter MediaId or Volume name: 41 > 1 File on Volume "08" purged from catalog. > There are no more Jobs associated with Volume "08". Marking it purged. We wanted to purge the volume with label "41" (MediaId 49), and the volume with label "08" (MediaId 41) got purged. There are two surprising things in this story: First, looking back, it's unclear if Bacula interprets the input as a MediaId or a Label. A solution could be not using labels of numbers only, however, this should be mentioned in the documentation (I couldn't find it). A cleaner solution would be dropping the ambiguous question and asking just the Label or just the MediaId, not in an "as it gets" manner. Second, in the above example, Bacula purged a tape that was not part of the selected pool. I understand why this happened (the list of volumes is just informational), but as a naive user, I found it strange for the first time. IMHO this should be checked before purging the tape. - -- cc -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) iEYEARECAAYFAkmoLXkACgkQGJRwVVqzMkO79wCglCyNTD/kYGW0APLhspC+Wy+W xR4Ani6oMJFtP4oXdUSBL1L952eXeL8h =mPOL -END PGP SIGNATURE- -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Do your VXA tapes lose their label?
Brian Debelius wrote: > Hi Dan, > > > Dan Langille wrote: >> Brian Debelius wrote: >>> Hi, >>> >>> Over the couple of years that I have been using two VXA-172 drives, I >>> have noticed that my VXA tapes occasionally lose their label. Once >>> this week, on each of two different backup systems, I have had to >>> intervene because bacula said to put in a specific tape >> >> NOTE: said tape is a suggestion only. >> >> Bacula will accept another tape, provided it can be appended to or >> overwritten. >> >> > or label a new one. The >>> tape bacula wants is already loaded into the drive. If I then read >>> the label with btape, btape says there is no label. So I then label >>> the tape again and go on my merry way. >>> >>> If this is the case, I think I will have to come up with a way to >>> read the label during a load, and if its not there, then see if the >>> tape exists in the catalog, and if it does exist, then relabel it. >> >> >> > > Thanks, But, I also said ... "If I then read the label with btape, > btape says there is no label". The tape was labeled and used before. Yes, I read that and I understood this completely. I was addressing the word 'specific' and ensuring that you, or anyone else reading, understood that the tape requested by Bacula is a suggestion. -- Dan Langille BSDCan - The Technical BSD Conference : http://www.bsdcan.org/ PGCon - The PostgreSQL Conference: http://www.pgcon.org/ -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Do your VXA tapes lose their label?
Brian Debelius wrote: > Hi, > > Over the couple of years that I have been using two VXA-172 drives, I > have noticed that my VXA tapes occasionally lose their label. Once this > week, on each of two different backup systems, I have had to intervene > because bacula said to put in a specific tape NOTE: said tape is a suggestion only. Bacula will accept another tape, provided it can be appended to or overwritten. > or label a new one. The > tape bacula wants is already loaded into the drive. If I then read the > label with btape, btape says there is no label. So I then label the > tape again and go on my merry way. > > If this is the case, I think I will have to come up with a way to read > the label during a load, and if its not there, then see if the tape > exists in the catalog, and if it does exist, then relabel it. -- Dan Langille BSDCan - The Technical BSD Conference : http://www.bsdcan.org/ PGCon - The PostgreSQL Conference: http://www.pgcon.org/ -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Do your VXA tapes lose their label?
Hi, Over the couple of years that I have been using two VXA-172 drives, I have noticed that my VXA tapes occasionally lose their label. Once this week, on each of two different backup systems, I have had to intervene because bacula said to put in a specific tape or label a new one. The tape bacula wants is already loaded into the drive. If I then read the label with btape, btape says there is no label. So I then label the tape again and go on my merry way. If this is the case, I think I will have to come up with a way to read the label during a load, and if its not there, then see if the tape exists in the catalog, and if it does exist, then relabel it. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Disk space optimalisation
Hi! I would like to have backup available on disk for last 360 days. Backup should be incremental with full backups on every 1st day of month. Exception is the latest month where I would like to have 3 additional full backups on 8th, 15th and 22th day of the month and incremental backups between those full backup (including incremental backups between 1st and 8th day of the month). Beside disk backups I would like to do DVD backups in 2 copies every time I'm at company head office (it's about 3 or 4 times a year). I would like those backups be just a full backup with incremental backups till day I decided to arrive. After writing to DVDs I would like this backup to be cleared completely so it could start backing up with full backup again and incremental next day. Is it possible to define those backups so they could occupy one disk space or I should define 2 or even 3 different jobs for them? How should I define jobs for manual DVD backups I plan to do? Regards, -- Rafał Cygnarowski rafilists [at] gmail [dot] com signature.asc Description: This is a digitally signed message part. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] storage directories based on job names
On Fri, Feb 27, 2009 at 9:18 AM, Wolf wrote:
> Going to try this again, since I didn't realized I wasn't sending in plain
> text beforemy apologies.
>
> I have bacula configured to use an attached storage array mounted as
> /bk_vol_1. I've ran some tests and I have bacula dynamically naming the
> volumes based on the full, unique, job names using the internal bacula
> variables, ${JobName} in this case.
>
> The question I have is can I make the storage director create a new
> directory for each job name using the same method?
>
> Example of current file location would be:
> /bk_vol_1/Inc-ldh0500.p1.2009-02-26_10.07.42.03
>
> Example of the file location I would like to have:
> /bk_vol_1/ldh0500.p1/Inc-ldh0500.p1.2009-02-26_10.07.42.03
>
> We're trying to make syncing the data to a remote site more manageable and
> efficient.
>
How about a different storage resource for each Job then you can put
the storage where ever you want.
John
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] storage directories based on job names
Going to try this again, since I didn't realized I wasn't sending in plain
text beforemy apologies.
I have bacula configured to use an attached storage array mounted as
/bk_vol_1. I've ran some tests and I have bacula dynamically naming the
volumes based on the full, unique, job names using the internal bacula
variables, ${JobName} in this case.
The question I have is can I make the storage director create a new
directory for each job name using the same method?
Example of current file location would be:
/bk_vol_1/Inc-ldh0500.p1.2009-02-26_10.07.42.03
Example of the file location I would like to have:
/bk_vol_1/ldh0500.p1/Inc-ldh0500.p1.2009-02-26_10.07.42.03
We're trying to make syncing the data to a remote site more manageable and
efficient.
Thanks,
-Adam
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Restoring from volumes on multiple storages
On Thu, Feb 26, 2009 at 02:23:04PM +, Graham Keeling wrote: > I've now looked at the bacula code a bit, and what I think it does is this > (bear in mind that I'm not one of the proper bacula development guys, so I > might be talking utter rubbish here): > > When you tell it to restore something, it creates a single .bsr file. > Though the director knows the Storage that has each volume, the .bsr file > does not contain that information. > The director then takes that .bsr file and sends a "run job=" command back > through the bconsole interface, like this (with the %s bits filled in - > src/dird/ua_restore.c): > > "run job=\"%s\" client=\"%s\" restoreclient=\"%s\" storage=\"%s\"" > " bootstrap=\"%s\" files=%u catalog=\"%s\"" > > As you can see, the Storage is set outside of the bootstrap file, and I think > you can only specify one of them. So, that single Storage gets told to restore > from all of the volumes, even if the director knows that some of the volumes > shouldn't be there. > I suppose that it's possible that if there was a volume in that place with the > correct label, it would happily restore from it and give you odd files. > > One kludgy solution that I may have a go at trying is to make the director > write out a separate .bsr file containing the correct set of volumes that it > needs for each Storage, and then doing multiple "run job=" commands. This > will set off multiple restores and you'd end up with multiple confirmation > messages. > It might all go horribly wrong if you're using plugins, mind. ...and another thing: I just noticed that the Virtual Backup / Consolidation stuff seems to work in a similar fashion. Unless I'm missing something, it looks like it just creates a single .bsr file and sends it off to a single Storage. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] cloning tapes for offsite storage
On Thu, 2009-02-26 at 20:28 +0100, Thomas wrote: > Hi List, > > i'm currently evaluating cloning of tapes with a two drive autochanger. > has someone suggestions or experience with that? > > currently i'm playing with bcopy for cloning and bextract/bscan to read the > data from the offsite tape > > Best Regards > > Thomas > Hello We are running CopyDiskToTape since about 6 months, see http://www.bacula.org/manuals/en/concepts/concepts/New_Features.html#SECTION0052 Weeky cron job runs bcopy (tape to tape) for offsite storage. This is "half production setup" :-), no major problems till now. I am using the latest svn 2.5.x on the server side. bcopy is not very fast (because not bufferd nor multithreaded). LTO-4 copy runs 5 hours at 40MB/s speed. bextract/bscan is a very time consuming process, i have only done very basic tests. Now i think about a CopyTapeToOffsiteTape, because i like to manage all from bacula and mostly automated. OffsiteTape pool will have long retention time (1-2 year) Tapes will be manually purged, (6-12 weekly tape sets first year, 4 tape sets second year) Ulrich -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Accurate restoration of renamed/deleted file
Hi all, is there any way (at the moment) to do Accurate restoration of renamed/deleted files with differenziell and full backups? If die differenziell ist the last one. maybe for mail servers? many thanks michael -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
