Re: [Bacula-users] Archive function ?

2011-05-30 Thread Geert Stappers
Op 20110527 om 20:44 schreef Radosław Korzeniewski:
 2011/5/27 John Drescher dresche...@gmail.com
  2011/5/27 Robert Kromoser robert.kromo...@kinamu.com:
   [ delete files after backup ]
   Does exist any configuration option for that?
  
  No.
 
 Not yet... :)

IMNSHO it allready exists, it is named 'RunAfterJob'


Stappers
--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Archive function ?

2011-05-30 Thread Jérôme Blion
On Mon, 30 May 2011 09:05:21 +0200, Geert Stappers
geert.stapp...@vanadgroup.com wrote:
 Op 20110527 om 20:44 schreef Radosław Korzeniewski:
 2011/5/27 John Drescher dresche...@gmail.com
  2011/5/27 Robert Kromoser robert.kromo...@kinamu.com:
   [ delete files after backup ]
   Does exist any configuration option for that?
  
  No.
 
 Not yet... :)
 
 IMNSHO it allready exists, it is named 'RunAfterJob'
 
 
 Stappers

Hello, 

That's not true. An archive function would only delete files which have
been archived successfully.
Performing an simple rm will not provide the same feature. As it will
delete any file.

HTH.
Jérôme Blion.

--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Archive function ?

2011-05-30 Thread Marcello Romani
Il 27/05/2011 16:32, Robert Kromoser ha scritto:
 Hi folks.

 Does exist any archive function in bacula.

 What do I mean?

 On a Backup the backed up data from a Fileset will stay on the
 filesystem after the backup.

 With an archive function the backed up data from the Fileset will be
 removed from the filesystem.

 Does exist any configuration option for that?

 br Robert



 --
 vRanger cuts backup time in half-while increasing security.
 With the market-leading solution for virtual backup and recovery,
 you get blazing-fast, flexible, and affordable data protection.
 Download your free trial now.
 http://p.sf.net/sfu/quest-d2dcopy1



 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

I think you should look into file and job retention periods.

-- 
Marcello Romani

--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Archive function ?

2011-05-30 Thread Konstantin Khomoutov
On Mon, 30 May 2011 09:24:06 +0200
Jérôme Blion jerome.bl...@free.fr wrote:

[ delete files after backup ]
Does exist any configuration option for that?
   
   No.
  Not yet... :)
  IMNSHO it allready exists, it is named 'RunAfterJob'
 That's not true. An archive function would only delete files which
 have been archived successfully.
 Performing an simple rm will not provide the same feature. As it
 will delete any file.
I don't see a real problem statement here: a job backs up a set of
files defined by a specific fileset, and if the said job completes
without errors, you're safe to `rm' every file referred to by that
fileset.

P.S.
I'm not against the imaginary archive function, just trying to clear
things up.

--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Archive function ?

2011-05-30 Thread Jérôme Blion
On Mon, 30 May 2011 12:41:14 +0400, Konstantin Khomoutov
flatw...@users.sourceforge.net wrote:
 On Mon, 30 May 2011 09:24:06 +0200
 Jérôme Blion jerome.bl...@free.fr wrote:
 
[ delete files after backup ]
Does exist any configuration option for that?
   
   No.
  Not yet... :)
  IMNSHO it allready exists, it is named 'RunAfterJob'
 That's not true. An archive function would only delete files which
 have been archived successfully.
 Performing an simple rm will not provide the same feature. As it
 will delete any file.
 I don't see a real problem statement here: a job backs up a set of
 files defined by a specific fileset, and if the said job completes
 without errors, you're safe to `rm' every file referred to by that
 fileset.
 
 P.S.
 I'm not against the imaginary archive function, just trying to clear
 things up.

Hello, 

If a file to archive has been created after the files list creation, you
will remove it without archiving it.

HTH.
Jerome Blion.

--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Archive function ?

2011-05-30 Thread Konstantin Khomoutov
On Mon, 30 May 2011 11:41:38 +0200
Jérôme Blion jerome.bl...@free.fr wrote:

 [ delete files after backup ]
 Does exist any configuration option for that?

No.
   Not yet... :)
   IMNSHO it allready exists, it is named 'RunAfterJob'
  That's not true. An archive function would only delete files which
  have been archived successfully.
  Performing an simple rm will not provide the same feature. As it
  will delete any file.
  I don't see a real problem statement here: a job backs up a set of
  files defined by a specific fileset, and if the said job completes
  without errors, you're safe to `rm' every file referred to by that
  fileset.
[...]
 If a file to archive has been created after the files list creation,
 you will remove it without archiving it.
Well, isn't it just about not using `rm *' or whatever?

To present a real example: among other things, I'm using Bacula to back
up an ever-growing set of voice conversation records created by the
call-center software we're using. The job of archiving freshly created
records is performed once a day and it goes like this:
1) A run before job script uses `find' to create a list of files to
   archive--the list is just a plain text file with one filename per
   line.
2) The fileset resource for the job uses  the  notation to include
   the filelist created on step (1).  The name of the filelist is fixed
   so this works just OK.
3) A run after job uses the filelist to move the files just archived
   to another location on a filesystem.  Note that I could as well run
   something like `cat $filelist | xargs -n 100 rm -f` on the filelist
   instead of rsync'ing the files using it.
   Then in my case the filelist is renamed to include the job's unique
   ID and moved to a special directory, but in a simpler case I
   could just remove it.

--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Moving a volume to a pool doens't inherit the correct Volume Use Duration

2011-05-30 Thread Rodrigo Renie Braga
How do you move the tapes from Scratch to the Daily Pool? You're supposed to
have a Scratch Pool = Scratch entry on your Daily Pool so Bacula gets the
tape automatically from the Scratch Pool when running the Jobs...


2011/5/27 Mauro Colorio mauro.colo...@gmail.com

 I've a scratch pool defined as

 Pool {
  Name = Scratch
  Pool Type = Backup
 }

 and daily one

 Pool {
  Name = Daily
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 5 days
  Maximum Volume Bytes = 800G
  Volume Use Duration = 23h
  Maximum Volumes = 5
 }


 so noticed that there is not a Volume Use Duration in the Scratch
 pool, when I label new volumes with the command
 label barcode pool=Scratch i put volumes in the Scratch, they have
 value 0 for Volume Use Duration,
 pool then I move some of them in the Daily pool they keeps 0 for
 Volume Use Duration, I was expecting that they takes the correct
 value,
 of course I can run update volume, but I think it's a bug, isn't?

 ciao
 Mauro


 --
 vRanger cuts backup time in half-while increasing security.
 With the market-leading solution for virtual backup and recovery,
 you get blazing-fast, flexible, and affordable data protection.
 Download your free trial now.
 http://p.sf.net/sfu/quest-d2dcopy1
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Moving a volume to a pool doens't inherit the correct Volume Use Duration

2011-05-30 Thread Rodrigo Renie Braga
Please, do not forget to reply to the list also, not only directly to me...

I actually don't think it's a BUG, when you put your tapes on the Scratch
Pool using  label barcodes, the volumes will inherit any configuration on
that pool, and only if that volume gets cycled to the Daily Pool
automatically by Bacula using the Scratch Pool = Scratch parameter I told
you about before is when these parameters from the Daily Pool are set on the
Volume...

Try doing that, I really recommended it...

2011/5/30 Mauro Colorio mauro.colo...@gmail.com

  How do you move the tapes from Scratch to the Daily Pool? You're supposed
 to
  have a Scratch Pool = Scratch entry on your Daily Pool so Bacula gets
 the
  tape automatically from the Scratch Pool when running the Jobs...

 with the update command, or for example with webacula, I've defined
 the scratch volume but I don't use really it,
 I'm using something like a GFS schedule and I put 5 volumes in the
 Daily pool 2 volumes in the weekly and so on..
 but when I add a new volume I use the label barcode command putting it
 into the Scratch pool, I discovered
 that when I move the volume, it keeps the Volume Use Duration value of
 the original pool, I think this is a bug

 ciao
 Mauro

--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] IBM TS2240 Tape Drive

2011-05-30 Thread Rickifer Barros
Hello Everyone,

I would like to know if somebody here have used Bacula with the IBM TS2240
Tape Drive. I will buy this Tape Drive and I intend to use Bacula in it. The
TD didn't arrive yet then I couldn't test it with Bacula.

K R

Thanks.
--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Network timeouts while running enormous backup

2011-05-30 Thread S H
On Thu, May 26, 2011 at 4:58 PM, S H shdashb...@gmail.com wrote:
 Hello,

 I've got a very large backup set (55M files, 1TB of data) that's
 simply not backing up. This is always the failure message:

 26-May 16:35 buny1-dir JobId 5223: Fatal error: Network error with FD
 during Backup: ERR=Connection timed out
 26-May 16:35 buny1-dir JobId 5223: Fatal error: No Job status returned from 
 FD.

 I've set Heartbeat Interval = 1 minute on the FD, the SD, and the
 Director to no avail. This was happening at random times during the
 backup job until I enabled spooling -- then the job ran for 27 hours,
 spooled up all of its data to the SD and failed with the above message
 when it started to despool. It was heartbreaking to watch a terabyte
 of data and 20+GB of attribute spool just disappear.

 The Director and SD both run on the same server: OpenBSD 4.6 (32-bit)
 with Bacula 2.4.4. The client is FreeBSD 8.1 (64-bit) with Bacula
 2..4.4. I know these are outdated versions; I just inherited the
 environment and they're working for everything else so I haven't
 wanted to go through the pain of upgrading until I have some spare
 cycles to dedicate to it.

 Compression and FD encryption are off but network traffic runs over
 TLS everywhere.

 Is there anything I can possibly check that might help?

 -SH


I added a network interface to the backup server on the same segment
as the client and the timeout disappeared, so it seems my firewall was
expiring a TCP session somewhere along the line. Unsure whether it's a
configuration problem on the Bacula or firewall side -- I expected the
heartbeat to prevent this.

Anyhow, I'm not sure Bacula is the right solution for this type of
backup: the attribute despool has been running for nearly three days
straight now. Does anybody else have experience backing up tons of
files? Any recommendations on making it not suck?

-SH

--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula Verification

2011-05-30 Thread Rickifer Barros
Hi,

I'm reading about the verification File Set options so, how I could
understand, there are three modes: basejob (for Full Backups), accurate (for
Incr/Diff) and verify (for Catalog). Is that right? If it is, what options
are the best for a reliable verification and don't overhead the backup time.
Is it enough check only the md5 hash?

Thanks in advance.
--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] scripts for holding configuration in database

2011-05-30 Thread Yuri Timofeev
2011/5/28 Silver Salonen sil...@ultrasoft.ee

 I have named the Ruby classes beginning with 'BaculaConf' and they are:
 ... - BaculaConfFileParser - backend for parsing configuration from files
 (eg. for importing configuration into MySQL)



I already wrote here in 2010:

During development the prototype of the my new system (Webacula 5.5),
I tried to parse the bacula-dir.conf.
However, this is probably not possible with simple regexp's.
It turned out that some applications, for example, Webmin does this
with a regexp.

But they're doing it wrong!

For example, here is test configuration (which is written according to
Bacula Main Reference: Customizing the Configuration Files)
contains no errors in terms of Bacula (I checked it) but it would be
wrong parsed (I have not tested it, but I'm sure of it) by 3rd parties
parsers (not native) :

-
# comment1
 # comment2

   c  o n s o l e
{ Name=name1; Password = p; \\\a s s w o rd; J o b A C L = *all\*
}Con sole { N a m e = name 2; Pass word = password; JobACL =
job/\1, job2, job3
}

-


I.e. in other words to parse with regexp any Bacula configuration will
be very difficult.




Stefan Muenkner suggested:

a better solution still would be to enable bacula to dump its
configuration as a  (e.g.) XML or JSON file, probably in a rather generic
way so that future changes to the structure/content of the config files
would not need additional work on behalf of the bacula developers. XML or
JSON - as examples -  could be easily picked up by php, ruby, perl,
python, java you name it whatever.
--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO5 not filling

2011-05-30 Thread Juan Pablo Lorier
Hi guys,

First my apologize for such a newbbie thing. I had my pool configured
for 50GB which was the size bacula used in the tapes.
Thanks Ralf for your appreciation, you where right!! :-).
Thanks to everyone.
Regards, 




-- Toda la información contenida en este correo electrónico es confidencial y 
para conocimiento exclusivo de su destinatario. Agradeceremos que Ud. nos 
comunique inmediatamente si ha recibido este correo por error. En tal caso, 
evite hacer uso del mismo en forma alguna y elimínelo inmediatamente de su 
sistema.
--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula slow transfer

2011-05-30 Thread reiserfs
Hello, im new with Bacula scene, i have used the HP Dataprotector with a HP 
Library fiber channel backup.

With the Dataprotector i got 1gbps interfaces and switch and all jobs get done 
very fast, with transfer like 50-80MB/s.

Now im using Bacula with a DELL TL2000 iSCSI, and with my first experience i 
got only 6MB/s transfer with 1gbps interfaces and switch.

So what im missing

Used to tes:
Bacula Director runing on Slackware64 13.1
Bacula Cliente Windows 2003 Server

+--
|This was sent by thiagomel...@hotmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--



--
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery, 
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now. 
http://p.sf.net/sfu/quest-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO5 not filling

2011-05-30 Thread John Drescher
 First my apologize for such a newbbie thing. I had my pool configured for
 50GB which was the size bacula used in the tapes.
 Thanks Ralf for your appreciation, you where right!! :-).

I am glad he thought of that. I would have had to ask you for your
complete configs before figuring that out...

John

--
Simplify data backup and recovery for your virtual environment with vRanger. 
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today. 
http://p.sf.net/sfu/quest-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula slow transfer

2011-05-30 Thread John Drescher
On Mon, May 30, 2011 at 3:11 PM, reiserfs
bacula-fo...@backupcentral.com wrote:
 Hello, im new with Bacula scene, i have used the HP Dataprotector with a HP 
 Library fiber channel backup.

 With the Dataprotector i got 1gbps interfaces and switch and all jobs get 
 done very fast, with transfer like 50-80MB/s.

 Now im using Bacula with a DELL TL2000 iSCSI, and with my first experience i 
 got only 6MB/s transfer with 1gbps interfaces and switch.

 So what im missing


Do you have software compression turned on? If so remove that for a tape drive.

John

--
Simplify data backup and recovery for your virtual environment with vRanger. 
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today. 
http://p.sf.net/sfu/quest-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] IBM TS2240 Tape Drive

2011-05-30 Thread Rodrigo Renie Braga
Sorry, no experience on that specific Tape Drive, but if your OS support
that hardware (i.e the devices for bacula-sd to read/write on are created),
than Bacula will work without problems with it...

2011/5/30 Rickifer Barros rickiferbar...@gmail.com

 Hello Everyone,

 I would like to know if somebody here have used Bacula with the IBM TS2240
 Tape Drive. I will buy this Tape Drive and I intend to use Bacula in it. The
 TD didn't arrive yet then I couldn't test it with Bacula.

 K R

 Thanks.


 --
 vRanger cuts backup time in half-while increasing security.
 With the market-leading solution for virtual backup and recovery,
 you get blazing-fast, flexible, and affordable data protection.
 Download your free trial now.
 http://p.sf.net/sfu/quest-d2dcopy1
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
Simplify data backup and recovery for your virtual environment with vRanger. 
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today. 
http://p.sf.net/sfu/quest-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Network timeouts while running enormous backup

2011-05-30 Thread John Drescher
 I added a network interface to the backup server on the same segment
 as the client and the timeout disappeared, so it seems my firewall was
 expiring a TCP session somewhere along the line. Unsure whether it's a
 configuration problem on the Bacula or firewall side -- I expected the
 heartbeat to prevent this.

 Anyhow, I'm not sure Bacula is the right solution for this type of
 backup: the attribute despool has been running for nearly three days
 straight now.

That is not normal. I have seen 30 minutes for 5 or so TB backup with
a few million files but never days. Do you have your database on a
server with at least 8GB of ram? Is your database on a raid 10 or SSD?

 Does anybody else have experience backing up tons of
 files?

There are users that backup 30 TB containing millions of files in one
job on this list.

Any recommendations on making it not suck?

Not without any system information.


John

--
Simplify data backup and recovery for your virtual environment with vRanger. 
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today. 
http://p.sf.net/sfu/quest-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] SHA1 digest warning on Copy Jobs

2011-05-30 Thread Rodrigo Renie Braga
Just to give a feedback, I believe it was a physical error on the tape, i
bought brand new ones and ran again the same Copy Job and now the job
terminated without errors!


2011/5/16 John Drescher dresche...@gmail.com

  Any thoughts on this? It is still happening and I have no idea why...
 

 Do a test restore if possible from the original source and see if it
 complains about SHA1 mismatches.

 John

--
Simplify data backup and recovery for your virtual environment with vRanger. 
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Data protection magic?
Nope - It's vRanger. Get your free trial download today. 
http://p.sf.net/sfu/quest-sfdev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users