Re: [Bacula-users] Multi-cores compression
Am 05.03.2012 15:28, schrieb Kleber l: > 2012/3/5 Gael Guilmin >> On 05/03/12 14:00, Gael Guilmin wrote: >>> I'd like to know if there is a way to allow the use of multi-cores >> during a backup and especially for the compression of the data? >> >> Why do you want compression? > No, you dont need software compression to save space on LTO drive. > LTO drives are hardware compression enabled. > You will need software compression only for file based volumes. And how should the tape drive compress pki encrypted files? I'm sorry, but it's true, soft compression ist needed before the data from the client will encrypt the files to save file space. My systems all have different pki certificats so only the client can decrypt the files. So I'm interested for an answer, too. Cheers... Pierre -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removing tape from library
On Thu, Mar 29, 2012 at 1:49 PM, John Drescher wrote: >> What I'm after is a more hands-off approach. A simple set-it and forget-it >> feature. I need Bacula to "make these decisions" without any human >> intervention. >> >> If the last tape with Append status is not available bacula should do the >> following: >> >> 1. Notify the backup admin >> 2. Then wait 2 hours for remedy >> 3. If the tape in question is still not available after 2 hours, use the >> next available tape. >> >> This way my backup still continues even if I neglect/forget to change >> volume status to Full. > > You will most likely have to script this yourself since bacula does > not support this feature. One way could be to intercept the mail > commands, parse them and take action by sending out bconsole commands. > An easier option may be to have a cron job periodically parse the bacula logs looking for mount requests. Then take action via scripted bconsole commands. John -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removing tape from library
> What I'm after is a more hands-off approach. A simple set-it and forget-it > feature. I need Bacula to "make these decisions" without any human > intervention. > > If the last tape with Append status is not available bacula should do the > following: > > 1. Notify the backup admin > 2. Then wait 2 hours for remedy > 3. If the tape in question is still not available after 2 hours, use the > next available tape. > > This way my backup still continues even if I neglect/forget to change > volume status to Full. You will most likely have to script this yourself since bacula does not support this feature. One way could be to intercept the mail commands, parse them and take action by sending out bconsole commands. John -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removing tape from library
What I'm after is a more hands-off approach. A simple set-it and forget-it feature. I need Bacula to "make these decisions" without any human intervention. If the last tape with Append status is not available bacula should do the following: 1. Notify the backup admin 2. Then wait 2 hours for remedy 3. If the tape in question is still not available after 2 hours, use the next available tape. This way my backup still continues even if I neglect/forget to change volume status to Full. From: John Drescher [dresche...@gmail.com] Sent: Thursday, March 29, 2012 12:46 PM To: Conrad Lawes Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Removing tape from library > What is process for removing tapes that are not yet full from that tape > library? > When I remove a not-yet-full tape from tape library and neglect to change > its status to "Full", Bacula does not alert me that it's waiting for that > tape to be mounted. Furthermore, it does not attempt to use another tape. It > just patiently waits indefinitely. > > Is there a way to correct this behaviour? > > I want Bacula to automatically use another tape after a given amount of time > if the preferred "Append" tape is not available . > When I do this I mark the tape Full or used using bconsole. And then it does not give me problems as long as its retention period is not over. John -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - pg_dump
On 28/03/12 18.32, Thomas Bennett wrote: > I am having some hardware issues because of several HVAC outages. So if > I am doing a pg_dump of the bacula database on PostgreSQL, do I need to > include oids? You don't need them for Bacula. andrea -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removing tape from library
> What is process for removing tapes that are not yet full from that tape > library? > When I remove a not-yet-full tape from tape library and neglect to change > its status to "Full", Bacula does not alert me that it's waiting for that > tape to be mounted. Furthermore, it does not attempt to use another tape. It > just patiently waits indefinitely. > > Is there a way to correct this behaviour? > > I want Bacula to automatically use another tape after a given amount of time > if the preferred "Append" tape is not available . > When I do this I mark the tape Full or used using bconsole. And then it does not give me problems as long as its retention period is not over. John -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Removing tape from library
What is process for removing tapes that are not yet full from that tape library? When I remove a not-yet-full tape from tape library and neglect to change its status to "Full", Bacula does not alert me that it's waiting for that tape to be mounted. Furthermore, it does not attempt to use another tape. It just patiently waits indefinitely. Is there a way to correct this behaviour? I want Bacula to automatically use another tape after a given amount of time if the preferred "Append" tape is not available . Conrad Lawes | Systems Administrator | cla...@navtech.aero | Phone: 519-747-1170 ext 254 | Skype: conrad.lawes | Website: http://www.navtech.aero -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mixing incremental & full volume pools (disk based) during restore
On Thu, Mar 29, 2012 at 10:40:07AM -0400, Phil Stracchino wrote: > I don't think you should need to do either of those. I have a total of > five pools - Full-Disk, Diff-Disk, Incr-Disk, and Full-Tape, plus a > scratch pool - but all of my disk volumes are in the same /spool/bacula > directory regardless of the four possible disk pools they belong to. > For me, this Just Works. I have never had Bacula fail to find a volume > as you've described. Bacula knows which volumes belong in which pools, > so I don't see a need to keep them separate. > I've now moved all my physical disk volumes into a single directory and have changed the sd config accordingly. Thanks again for your kind help. All the best, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mixing incremental & full volume pools (disk based) during restore
On 03/29/2012 09:59 AM, Uwe Schuerkamp wrote:
> On Thu, Mar 29, 2012 at 09:41:40AM -0400, Phil Stracchino wrote:
>
>> I confess I don't see why you'd need to do that. But then, I keep all
>> my disk-based volumes in one place to start with, and have simply never
>> had a problem.
>
> Hi Phil,
>
> the reasons are mostly historical: I started doing incrementals to
> disk with fulls to tape, so I had a separate incremental disk pool and
> then simply added a 2nd disk pool for the full backups. This way, I
> can also later separate the pools to different disk devices
>
> I can also live with symlinks as I have a limited number of
> incr. volumes, but it sure would be nicer to have bacula select the
> correct pool automatically.
>
> I changed the media type in the sd config and the Storage definition
> in bacula-dir.conf like so:
>
> Device {
> Name = FileStorage_incremental
> Media Type = File-Diff
> Archive Device = /mnt/disk/online_backup_incremental
> LabelMedia = yes;
> Random Access = Yes;
> AutomaticMount = yes;
> RemovableMedia = no;
> AlwaysOpen = no;
> }
>
> Storage {
> Name = FileStorage_incremental
> Address = bacula-server
> SDPort = 9103
> Password = "X"
> Device = FileStorage_incremental
> Media Type = File-Diff
> Maximum Concurrent Jobs = 4
> }
>
> and restarted bacula. I then updated "pool from resource" for the
> incr. pool and "all volumes in pool", but the media type is still
> listed as "File" when I select "list media" in bconsole. Do I need to
> update the media table in mysql? Would it be simpler to merge both
> pools into a single one?
I don't think you should need to do either of those. I have a total of
five pools - Full-Disk, Diff-Disk, Incr-Disk, and Full-Tape, plus a
scratch pool - but all of my disk volumes are in the same /spool/bacula
directory regardless of the four possible disk pools they belong to.
For me, this Just Works. I have never had Bacula fail to find a volume
as you've described. Bacula knows which volumes belong in which pools,
so I don't see a need to keep them separate.
Of course, you're doing a number of things differently than I am,
starting with having a separate Device for Full, Differential and
Incremental. Still, I would just try putting all the volumes in the
same directory and adjusting the Archive Device settings accordingly.
There's really no difference between the different File storage devices;
if you don't try to separate them, you could even end up with more
flexibility because you can just let any Job use whichever device is
available to mount the volumes it needs.
--
Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org
Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater
It's not the years, it's the mileage.
--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net/sfu/sfd2d-msazure
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mixing incremental & full volume pools (disk based) during restore
On Thu, Mar 29, 2012 at 09:41:40AM -0400, Phil Stracchino wrote:
> I confess I don't see why you'd need to do that. But then, I keep all
> my disk-based volumes in one place to start with, and have simply never
> had a problem.
Hi Phil,
the reasons are mostly historical: I started doing incrementals to
disk with fulls to tape, so I had a separate incremental disk pool and
then simply added a 2nd disk pool for the full backups. This way, I
can also later separate the pools to different disk devices
I can also live with symlinks as I have a limited number of
incr. volumes, but it sure would be nicer to have bacula select the
correct pool automatically.
I changed the media type in the sd config and the Storage definition
in bacula-dir.conf like so:
Device {
Name = FileStorage_incremental
Media Type = File-Diff
Archive Device = /mnt/disk/online_backup_incremental
LabelMedia = yes;
Random Access = Yes;
AutomaticMount = yes;
RemovableMedia = no;
AlwaysOpen = no;
}
Storage {
Name = FileStorage_incremental
Address = bacula-server
SDPort = 9103
Password = "X"
Device = FileStorage_incremental
Media Type = File-Diff
Maximum Concurrent Jobs = 4
}
and restarted bacula. I then updated "pool from resource" for the
incr. pool and "all volumes in pool", but the media type is still
listed as "File" when I select "list media" in bconsole. Do I need to
update the media table in mysql? Would it be simpler to merge both
pools into a single one?
All the best, Uwe
--
NIONEX --- Ein Unternehmen der Bertelsmann AG
--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net/sfu/sfd2d-msazure
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mixing incremental & full volume pools (disk based) during restore
On 03/29/2012 09:19 AM, Uwe Schuerkamp wrote: > On Thu, Mar 29, 2012 at 08:59:05AM -0400, Craig Van Tassle wrote: > >> I had this issue in the past as well. The solution was to change what >> type of media. Here is an example out of my SD configuration file. >> >> Device = Differential >> Media Type = File-Diff >> > > Hi Craig, > > thanks much for your reply. So the key is to have *different* media > types for the full and differential pool? I confess I don't see why you'd need to do that. But then, I keep all my disk-based volumes in one place to start with, and have simply never had a problem. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - pg_dump
I would check the source of the catalog backup script and see what options it uses. -- Jeff MacDonald j...@terida.com 902 880 7375 On 2012-03-29, at 10:15 AM, Jose Ildefonso Camargo Tolosa wrote: > Hi! > > I don't think bacula uses oids, however, it doesn't hurt if you > include them (I think). > > What pgsql version are you using? (you said 8, but: 8.0, 8.1, 8.2, 8.3, 8.4). > > You could also use online backups, and do WAL archiving (maybe even > continuous WAL archiving), here: > http://www.postgresql.org/docs/8.0/static/backup-online.html (that's > for 8.0), or here: > http://www.postgresql.org/docs/8.4/static/continuous-archiving.html > (for 8.4). Depending on your DB size, this method will save you some > time for daily backups (because you can just "add" WAL files, like an > incremental backup). > > Ildefonso. > > 2012/3/28 Thomas Bennett : >> I am having some hardware issues because of several HVAC outages. So if I >> am doing a pg_dump of the bacula database on PostgreSQL, do I need to >> include oids? >> >> From pg_dump man >> >> -o >>--oids Dump object identifiers (OIDs) as part of the data for >> every table. Use this option if your application references the OID >> columns in some way (e.g., in a foreign key constraint). >> Otherwise, this option should not be used. >> >> This is Bacula 3 PostgreSQL 8. >> >> >> >> Thanks, >> >> Thomas >> >> >> Thomas McMillan Grant Bennett Appalachian State University >> Operations & Systems AnalystP O Box 32026 >> University LibraryBoone, North Carolina >> 28608 >> (828) 262 6587 >> Library Systems http://www.library.appstate.edu >> >> >> >> -- >> This SF email is sponsosred by: >> Try Windows Azure free for 90 days Click Here >> http://p.sf.net/sfu/sfd2d-msazure >> ___ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users >> > > -- > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mixing incremental & full volume pools (disk based) during restore
On Thu, Mar 29, 2012 at 08:59:05AM -0400, Craig Van Tassle wrote: > I had this issue in the past as well. The solution was to change what > type of media. Here is an example out of my SD configuration file. > > Device = Differential > Media Type = File-Diff > Hi Craig, thanks much for your reply. So the key is to have *different* media types for the full and differential pool? All the best, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - pg_dump
Hi! I don't think bacula uses oids, however, it doesn't hurt if you include them (I think). What pgsql version are you using? (you said 8, but: 8.0, 8.1, 8.2, 8.3, 8.4). You could also use online backups, and do WAL archiving (maybe even continuous WAL archiving), here: http://www.postgresql.org/docs/8.0/static/backup-online.html (that's for 8.0), or here: http://www.postgresql.org/docs/8.4/static/continuous-archiving.html (for 8.4). Depending on your DB size, this method will save you some time for daily backups (because you can just "add" WAL files, like an incremental backup). Ildefonso. 2012/3/28 Thomas Bennett : > I am having some hardware issues because of several HVAC outages. So if I > am doing a pg_dump of the bacula database on PostgreSQL, do I need to > include oids? > > From pg_dump man > > -o > --oids Dump object identifiers (OIDs) as part of the data for > every table. Use this option if your application references the OID > columns in some way (e.g., in a foreign key constraint). > Otherwise, this option should not be used. > > This is Bacula 3 PostgreSQL 8. > > > > Thanks, > > Thomas > > > Thomas McMillan Grant Bennett Appalachian State University > Operations & Systems Analyst P O Box 32026 > University Library Boone, North Carolina > 28608 > (828) 262 6587 > Library Systems http://www.library.appstate.edu > > > > -- > This SF email is sponsosred by: > Try Windows Azure free for 90 days Click Here > http://p.sf.net/sfu/sfd2d-msazure > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mixing incremental & full volume pools (disk based) during restore
On Thu, 29 Mar 2012 14:08:11 +0200 Uwe Schuerkamp wrote: > Hi folks, > > we recently changed our backup policy from tape- to disk-based, so I > created two pools based on separate filestorage devices (two separate > dirs) to hold the full and incremental backup volumes. > > Today I tried a restore job using both incr. and full volumes, and > when bacula (5.2.6 on centos 6) needed to access the incremental > volumes, it tried to open them in the full filestorage directory as > opposed to the incremental filestorage directory. > > I worked around the situation by creating symlinks in the full > filestorage directory pointing to the incremental backup volume files > and bacula readily accepted those links and read the incremental stuff > off the volumes. > > I wonder if this is the expected behaviour, or would it be better to > keep both pools in a single directory (if that's even possible)? > Should I have modified the Storage resource before starting the > restore job (alhough the restore job needed both full and incremental > volumes)? > > All the best & thanks in advance, Uwe > > I had this issue in the past as well. The solution was to change what type of media. Here is an example out of my SD configuration file. Device = Differential Media Type = File-Diff I had to update my pools to reflect the new media type and backups and restores work with out having to use the symlinks. -- Craig Van Tassle HUBzero.org System Administrator YONG 1006 Desk Phone : (765)496-6413 -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Mixing incremental & full volume pools (disk based) during restore
Hi folks, we recently changed our backup policy from tape- to disk-based, so I created two pools based on separate filestorage devices (two separate dirs) to hold the full and incremental backup volumes. Today I tried a restore job using both incr. and full volumes, and when bacula (5.2.6 on centos 6) needed to access the incremental volumes, it tried to open them in the full filestorage directory as opposed to the incremental filestorage directory. I worked around the situation by creating symlinks in the full filestorage directory pointing to the incremental backup volume files and bacula readily accepted those links and read the incremental stuff off the volumes. I wonder if this is the expected behaviour, or would it be better to keep both pools in a single directory (if that's even possible)? Should I have modified the Storage resource before starting the restore job (alhough the restore job needed both full and incremental volumes)? All the best & thanks in advance, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann AG -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Pool/Job File retention : question :)
Hi all, I create a pool, and 3 jobs which works on that pool (a full, base and incremental job). My question is : How make file retention and job retention differents for the 3 jobs, but on the same pool ? I see I can give file retention parameter on pool, but not on jobs. Can I do that ? Thanks -- Nicolas http://www.shivaserv.fr -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
