[Bacula-users] feature request for better support of vacation/holiday scheduling

2010-05-10 Thread Olaf Zevenboom
Feature Request

Item: implement Vacation/Holiday scheduling *within* Bacula(director)
Date: 10 May 2010
Origin: Olaf Zevenboom (o...@artefact.nl)
Status:

What:
A pre-job option to check to see if the current date (or the day before 
when jobs are run after 24.00) is a holiday/vacation. Currently this can 
be done by calling an external script, however this has some drawbacks 
as described below.

Why:
It's easy to use an external script to check for holidays/vacation 
however implementing it with a configurable config file directly into 
the director is probably not that hard either. For script implementation 
with configurable file see also: 
http://wiki.bacula.org/doku.php?id=hints_tips:scheduling_vacation_holidays

Advantages of direct implementation within Bacula:
- current implementation using an external script leads to Bacula 
messages reporting errors on holidays as the job is canceled while 
behavior is expected as it is. Implementation in Director will eliminate 
the need to falsely call these jobs erroneous. If errors are reported by 
email or even a pager/SMS this can be annoying.
- this feature is a must for all of those with a single-slot tapedrive 
so having this feature eliminates the need for administrators with such 
an hardware environment to implement an external solution
- external solutions are OS specific

Notes:
Maybe it is also an option to support ics files or even icalendar-servers.
See: http://www.mozilla.org/projects/calendar/holidays.html


--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Configuration issue

2010-05-10 Thread McCann, Brian
Hi all.  I've got a configuration issue that's been driving me nuts for weeks 
now.  I backup several Windows machines using Bacula, to a large disk array.  
Each workstation gets its own pool.  My problem is that I have the pool 
theoretically set to keep 15 days of backups, but currently it's got 26 days 
of files in it.  Here's a pool configuration:

Pool {
  Name = ftsstudents2
  Use Volume Once = yes
  Pool Type = Backup
  LabelFormat = ftsstudents2
  Auto Prune = yes
  Volume Retention = 15d
  Recycle = yes
}

I've read the documentation, but for the life of me I can't see why it's not 
deleting files/backups older than 15 days.  Can anyone point me in the right 
direction and tell me what the heck I'm doing wrong here?  I'm currently on 
Bacula 3.0.3.

Thanks!
--Brian

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration issue

2010-05-10 Thread Sean M Clark
On 2010May10 10:48 AM, McCann, Brian wrote:
 Hi all.  I've got a configuration issue that's been driving me nuts
 for weeks now.  I backup several Windows machines using Bacula, to a
 large disk array.  Each workstation gets its own pool.  My problem is
 that I have the pool theoretically set to keep 15 days of backups,
 but currently it's got 26 days of files in it.  Here's a pool
 configuration:
 
 [...]Volume Retention = 15d
 Recycle = yes 
 [...]
 I've read the documentation, but for the life of me I can't see why
 it's not deleting files/backups older than 15 days.  Can anyone point
 me in the right direction and tell me what the heck I'm doing wrong
 here?  I'm currently on Bacula 3.0.3.
 
 Thanks! --Brian

I'm pretty sure Volume Retention is a MINIMUM, and Bacula will
always prefer to use empty, appendable volumes before recycling older
volumes.

There is a Volume use duration setting that gives Bacula a MAXIMUM
time to use a Volume, but even though you can then set the volume to
be marked Used (and therefore available for recycling) after, say, 15
days, I'm not sure if you can force bacula to recycle automatically if
there are still emtpy, appendable volumes available instead...

http://www.bacula.org/5.0.x-manuals/en/main/main/Automatic_Volume_Recycling.html

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration issue

2010-05-10 Thread John Drescher
On Mon, May 10, 2010 at 11:48 AM, McCann, Brian bmcc...@andmore.com wrote:
 Hi all.  I've got a configuration issue that's been driving me nuts for weeks 
 now.  I backup several Windows machines using Bacula, to a large disk array.  
 Each workstation gets its own pool.  My problem is that I have the pool 
 theoretically set to keep 15 days of backups, but currently it's got 26 
 days of files in it.  Here's a pool configuration:

 Pool {
  Name = ftsstudents2
  Use Volume Once = yes
  Pool Type = Backup
  LabelFormat = ftsstudents2
  Auto Prune = yes
  Volume Retention = 15d
  Recycle = yes
 }

 I've read the documentation, but for the life of me I can't see why it's not 
 deleting files/backups older than 15 days.  Can anyone point me in the right 
 direction and tell me what the heck I'm doing wrong here?  I'm currently on 
 Bacula 3.0.3.

You need to limit the volume usage so that the volumes are marked Full
or Used. Once the volumes are marked Full or Used the retention period
begins. Since you do not have any of the 4 limiting commands you
volumes will never recycle:

Use Volume Once = yes
Volume Use Duration = ttt
Maximum Volume Jobs = nnn
Maximum Volume Bytes = mmm


See here 
http://bacula.org/5.0.x-manuals/en/main/main/Automatic_Volume_Recycling.html


John

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Windows 2008/2008r2 Server backup

2010-05-10 Thread Michael Da Cova
Hi 

anyone have any tips recommendation on how to backup and restore windows
2008 system state, do you need to if using VSS

Michael



--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Verify Job Error

2010-05-10 Thread ikkysleepy

I am having some problem with the verify Job. The job always fails when 
scheduled but if I run the job manually then it works fine. 

Here is my job:

Job #123;
nbsp; Name = Backup-Drive1-Verify
nbsp; Type = Verify
nbsp; Level = Volume To Catalog
nbsp; Client = Backup-fd
nbsp; FileSet = BackupSet
nbsp; Schedule = ScheduleBackupVerify
nbsp; Messages = Standard
nbsp; Pool = Default
nbsp; Storage = Backup-sd
nbsp; Verify Job = Backup-Drive1
nbsp; Priority = 11 # Run After Full/Inc. Backup
#125;


and here is the Console Results:

2010-05-07 23#58;55#58;01
bacula-dir
Error#58; Bacula bacula-dir 5.0.1 #40;24Feb10#41;#58; 07-May-2010 
23#58;55#58;01
nbsp; Build#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; 
x86_64-unknown-linux-gnu ubuntu 9.10
nbsp; JobId#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; 
155
nbsp; Job#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; 
nbsp; Backup-Drive2-Verify.2010-05-07_23.55.00_21
nbsp; FileSet#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; 
BackupSet
nbsp; Verify Level#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp;Incremental
nbsp; Client#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; 
nbsp;Backup-fd
nbsp; Verify JobId#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp;0
nbsp; Verify Job#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; 
nbsp;Backup-Drive2
nbsp; Start time#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; 
nbsp;07-May-2010 23#58;55#58;00
nbsp; End time#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; 
nbsp;07-May-2010 23#58;55#58;01
nbsp; Files Examined#58;nbsp; nbsp; nbsp; nbsp; nbsp;0
nbsp; Non-fatal FD errors#58;nbsp; nbsp; 0
nbsp; FD termination status#58;nbsp; 
nbsp; Termination#58;nbsp; nbsp; nbsp; nbsp; nbsp; nbsp; *** Verify 
Error ***


Fatal error#58; verify.c#58;88 Unimplemented Verify level 73#40;I#41;

For some reason the Verify Level is being set to Incremental. Do I need to 
specify Verify  Level = Volume To Catalog ? Is this a bug in 5.0.1?

Thanks!

+--
|This was sent by ikkysle...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Understanding Action On Purge = Truncate

2010-05-10 Thread Christopher Strider Cook
I have the same questions as the unanswered questioner below.

Also 5.0.1

update volume=SJL02-0078 ActionOnPurge=Truncate
New ActionOnPurge is: Truncate
New ActionOnPurge is: Truncate
purge volume=SJL02-0078 action=truncate pool=SJL02 storage=SJL02
No volume founds to perform truncate action(s)
update volume=SJL02-0078 volstatus=Used recyclepool=
New Volume status is: Used
New RecyclePool is: *None*
New Volume status is: Used
New RecyclePool is: *None*
purge volume=SJL02-0078 action=truncate pool=SJL02 storage=SJL02
No volume founds to perform truncate action(s)



On 3/1/10 11:05 AM, Marc Schiffbauer wrote:
 Hi all,

 I am using bacula 5.0.1 and I am trying to use the new Action On
 Purge = Truncate feature - without success so far :-/

 Like I understood it: If i run a purge volume=Ftp-0033 and
 Action On Purge = Truncate is set for that pool, the SD should set
 the file to 0 bytes on disk, right?

 This is my pool ressource:

 Pool {
Name = FileFtp
Storage = somehost-sd
Pool Type = Backup
Recycle = yes
AutoPrune = yes
Volume Retention = 4 months
Action On Purge = Truncate
Label Format = FtpVol-
Maximum Volume Bytes = 1073639424
Maximum Volumes = 50
 }

 + I have updated the pool from the ressource.
(update pool=...)

 + I have read the docs at
http://www.bacula.org/5.0.x-manuals/en/main/main/New_Features_in_5_0_1.html
and tried the commands that are listed there which should truncate all 
 volumes
with status Purged:

*update volume=Ftp-0033 ActionOnPurge=Truncate
*purge volume action=truncate storage=FileFtp allpools


 I tried several things but my disk files never get truncated when I
 purge a volume.

 This is the device ressource from the bacula-sd.conf:

 Device {
Name = FtpFileStorage
Device Type = File
Media Type = File
Archive Device = /mnt/backup

Requires Mount = Yes
Mount Point = /mnt/backup
Mount Command = /usr/bin/curlftpfs -o allow_root [snip] %m
Unmount Command = /usr/bin/fusermount -u %m

Label Media = Yes # lets Bacula label unlabeled media
Random Access = Yes
Automatic Mount = Yes # mount new volumes automatically
Removable Media = No
 }


 Any hints someone?

 What can I check? What might be wrong?



 TIA
 -Marc



--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Windows 2008/2008r2 Server backup

2010-05-10 Thread Kevin Keane
There is no such thing as system state backup any more in Windows 2008. It's 
always the whole C: drive. I'm not sure how well bacula handles it in the end. 
There also is the issue that Windows 2008 relies heavily on junction points, 
which bacula doesn't handle well.

I'm using Windows backup to an iSCSI drive, and then use bacula to back up a 
snapshot of that iSCSI volume. 

 -Original Message-
 From: Michael Da Cova [mailto:mdac...@equiinet.com]
 Sent: Monday, May 10, 2010 9:47 AM
 To: bacula-users@lists.sourceforge.net
 Subject: [Bacula-users] Windows 2008/2008r2 Server backup
 
 Hi
 
 anyone have any tips recommendation on how to backup and restore
 windows
 2008 system state, do you need to if using VSS
 
 Michael
 
 
 
 --
 
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] 5.0.2 status of Restore jobs bytes read

2010-05-10 Thread Stephen Thompson


Hello all,

I can't say this with certainty, but I've believe I've been experiencing 
a new oddity with bacula ever since I upgraded from 3.X to 5.X.

After launching a restore job, the status of the job via bconsole is 
always is waiting on Storage Device.  This continues on long past 
the loading and forwarding of tapes until job completion.  I could swear 
that there used to be more granular status messages, if only that it 
switched to running when not sending mtx commands.

Am I mistaken?

Also a status of the Storage Daemon does not display bytes out for a 
Restore job the way it does bytes in for a Backup job.  I don't know if 
this is how it's always been or not, but seems like a bytes read back 
out would be pretty handy to have.

thanks!!!
Stephen
-- 
Stephen Thompson   Berkeley Seismological Laboratory
step...@seismo.berkeley.edu215 McCone Hall # 4760
404.538.7077 (phone)   University of California, Berkeley
510.643.5811 (fax) Berkeley, CA 94720-4760

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Windows 2008/2008r2 Server backup

2010-05-10 Thread James Harper
With full VSS support, VSS defines the files that make up the system  
state backup - it's a flag on the writer. Bacula handles junction  
points perfectly.

Sent from my iPhone

On 11/05/2010, at 4:13, Kevin Keane subscript...@kkeane.com wrote:

 There is no such thing as system state backup any more in Windows  
 2008. It's always the whole C: drive. I'm not sure how well bacula  
 handles it in the end. There also is the issue that Windows 2008  
 relies heavily on junction points, which bacula doesn't handle well.

 I'm using Windows backup to an iSCSI drive, and then use bacula to  
 back up a snapshot of that iSCSI volume.

 -Original Message-
 From: Michael Da Cova [mailto:mdac...@equiinet.com]
 Sent: Monday, May 10, 2010 9:47 AM
 To: bacula-users@lists.sourceforge.net
 Subject: [Bacula-users] Windows 2008/2008r2 Server backup

 Hi

 anyone have any tips recommendation on how to backup and restore
 windows
 2008 system state, do you need to if using VSS

 Michael



 --- 
 --- 
 --- 
 -

 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

 --- 
 --- 
 --- 
 -

 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Feature idea feeler - bconsole include / grep

2010-05-10 Thread mark . bergman


In the message dated: Mon, 10 May 2010 13:26:51 +1000,
The pithy ruminations from Norberto Meijome on 
Re: [Bacula-users] Feature idea feeler - bconsole include / grep were:

= 
= (and to the list.. Apologies Gavin for private reply...)
= 
= On 7 May 2010 19:19, Gavin McCullagh gavin.mccull...@gcd.ie wrote:
= 
=  On Thu, 06 May 2010, Steve Polyack wrote:
= 

[SNIP!]

=   bconsole session.  However, perhaps a solution would be to have bconsol=
= e
=   parse the pipe character and feed output into the command that follows
=   which could be any arbitrary *nix command (as opposed to
=   writing/including our own version of grep).
= 

I think that's a great suggestion, and the cleanest way to do this. I'd add one 
thing, which is to have bconsole detect  in a command as well. The logic 
would be (in bad pseudo-code):

if [ bconsole_cmd =~ /|/ OR bconsole_cmd =~ // ]
beforeredirect=[part of bconsole_cmd before redirection char]
afterredirect=[part of bconsole_cmd after redirection char]

if [ redirectchar = | ] then
echo $beforeredirect | bconsole | $afterredirect
else
echo $beforeredirect | bconsole  $afterredirect
fi
else
exec bconsole_command
fi

=  For comparison, the Postgresql and MySQL command line interfaces include
=  something similar to this.
= 
=  MySQL offers the pager command which can be set to less or grep =
= ,
=  etc. as well as the tee command to also send output to a file.  Postgresq=
= l
=  offers a single:
= 
=   \o [FILE]  send all query results to file or |pipe
= 
=  Neither allow anything as simple as
= 
= SELECT ... ; | grep blah
= 
= 
= my $0.02,
= 
= Bconsole already performs SQL queries for all commands that would issue a
= long listing, right?
= 
= SQL was meant for filtering  relating data ... Why not add some filter
= param that is added to the SQL being sent to the backend? something like th=
= e

That's great...if you already know SQL.

I'm guessing that most system administrators who are managing bacula are much 
more familiar with shell tools  paradigms than with SQL. I wish I knew SQL, 
but even more, I'd prefer to send the output of bconsole to tools that I 
already know (grep, perl, awk, etc.).

= original suggestion,but simply as an extra parameter to the existing
= command. for example:
= 
= *list files jobid=999 incFile=%budget%2009% excFile=%.doc
= 

You mean something like:
echo list jobs jobid=999 | bconsole | sed -ne /\.doc/d -e 
/budget.*2009/p



:)

= to include all *budget*2009* files, except *.doc .
= Similar extensions:
=  - case sensitive , or not.
=  - paths instead of file
=  - client names
=  - etc
= 
= The tricky bit may be avoiding SQL injection attacks, but there should be
= some libraries / standard practices for dealing with this.

I think that may be a large understatement...

= 
= I think this may be a cleaner approach for then end user.

Personally, as an end user unfamiliar with SQL, I disagree.

= 
= This may not apply if you have 1,000 clients, 'list clients' may not benefi=
= t
= from this as it doesnt query SQL...
= 
= B
= _
= {Beto|Norberto|Numard} Meijome
= 


Mark Bergman  voice: 215-662-7310
mark.berg...@uphs.upenn.edu fax: 215-614-0266
System Administrator Section of Biomedical Image Analysis
Department of RadiologyUniversity of Pennsylvania
  PGP Key: https://www.rad.upenn.edu/sbia/bergman 




The information contained in this e-mail message is intended only for the 
personal and confidential use of the recipient(s) named above. If the reader of 
this message is not the intended recipient or an agent responsible for 
delivering it to the intended recipient, you are hereby notified that you have 
received this document in error and that any review, dissemination, 
distribution, or copying of this message is strictly prohibited. If you have 
received this communication in error, please notify us immediately by e-mail, 
and delete the original message.

--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Feature idea feeler - bconsole include / grep

2010-05-10 Thread Norberto Meijome


 =
 = Bconsole already performs SQL queries for all commands that would issue
 a
 = long listing, right?
 =
 = SQL was meant for filtering  relating data ... Why not add some filter
 = param that is added to the SQL being sent to the backend? something like
 th=
 = e

 That's great...if you already know SQL.


Makes sense, though I hardly think most people would think it's voodoo to
use a limited subset of SQL bits in include / exclude. But i could be wrong.


 I'm guessing that most system administrators who are managing bacula are
 much
 more familiar with shell tools  paradigms than with SQL. I wish I knew
 SQL,
 but even more, I'd prefer to send the output of bconsole to tools that I
 already know (grep, perl, awk, etc.).



How would this integrate with a tool like bat ? ie, it wouldn't allow you to
integrate it easily with bat (for on-the-server processing of the
filtering), would it?

Regards,


{Beto|Norberto|Numard} Meijome

I detest people who take short­cuts rather than do things right, because
they leave shit for the rest of us to clean up.
PHK
--

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users