Re: [Bacula-users] Backup/Delete/Restore subsequent backups
Steve, You have incremental and differential schedules defined, however you don't use them in the incremental and differential job blocks. In fact, you don't call out ANY schedule in either of those jobs. What's it defaulting to? I'd think a bacula restart would error out in starting bacula-dir. Mehma -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup/Delete/Restore subsequent backups
Steve Costaras schrieb:
I've been diving into Bacula the past 2-3 weeks to come up with a backup
system here for some small server count but very large data store sizes
(30+TiB per server).
In the coarse of my testing I have noticed something and want to know if
it's by design (in which case it would be very wasteful of tapes); a
misconfiguration on my part (possible as I said I've only been playing
with it for the past 2-3 weeks), or a bug.
Ok, what I'm seeing is that I do a full backup of the client machine,
that runs well; I then delete an entire subdirectory say
/var/ftp/{DIRA} which has say 10,000 files or about 1TiB or data. I
then do a restore of that directory from tape (last backup was a full).
Now I am seeing that the next incremental I do has the full
/var/ftp/{DIRA} being backed up again as if it were all new files,
likewise a differential will also back up this directory in full again
as well.In my mind at least since this directory was in the full
backup and I have accurate mode on, the backup system should KNOW that
the files are already on tape (the full backup that was used to do the
restore) and should only back up /NEW/ files added to that directory
since that last backup not the entire directory structure after a
restore.
Can anyone comment?
Did you run a backup when all the files in /var/ftp/{DIRA} were
deleted? Or was the next incremental run after all files were restored
again?
Maybe you are looking for the upcoming Basejob feature?
http://sourceforge.net/apps/wordpress/bacula/2009/09/30/new-basejob-feature/
Ralf
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup/Delete/Restore subsequent backups
No, no backup was run between the full backup when the files were there
and the next backup AFTER the files were restored.
I've read a bit about the basejob feature though not in detail, it
sounds more like a data de-duplication feature which would be useful
later on, are you suggesting that I would need that in order to avoid
this problem?
On 01/04/2010 03:05, Ralf Gross wrote:
Steve Costaras schrieb:
I've been diving into Bacula the past 2-3 weeks to come up with a backup
system here for some small server count but very large data store sizes
(30+TiB per server).
In the coarse of my testing I have noticed something and want to know if
it's by design (in which case it would be very wasteful of tapes); a
misconfiguration on my part (possible as I said I've only been playing
with it for the past 2-3 weeks), or a bug.
Ok, what I'm seeing is that I do a full backup of the client machine,
that runs well; I then delete an entire subdirectory say
/var/ftp/{DIRA} which has say 10,000 files or about 1TiB or data. I
then do a restore of that directory from tape (last backup was a full).
Now I am seeing that the next incremental I do has the full
/var/ftp/{DIRA} being backed up again as if it were all new files,
likewise a differential will also back up this directory in full again
as well.In my mind at least since this directory was in the full
backup and I have accurate mode on, the backup system should KNOW that
the files are already on tape (the full backup that was used to do the
restore) and should only back up /NEW/ files added to that directory
since that last backup not the entire directory structure after a
restore.
Can anyone comment?
Did you run a backup when all the files in /var/ftp/{DIRA} were
deleted? Or was the next incremental run after all files were restored
again?
Maybe you are looking for the upcoming Basejob feature?
http://sourceforge.net/apps/wordpress/bacula/2009/09/30/new-basejob-feature/
Ralf
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Backup/Delete/Restore subsequent backups
I've been diving into Bacula the past 2-3 weeks to come up with a backup
system here for some small server count but very large data store sizes
(30+TiB per server).
In the coarse of my testing I have noticed something and want to know if
it's by design (in which case it would be very wasteful of tapes); a
misconfiguration on my part (possible as I said I've only been playing
with it for the past 2-3 weeks), or a bug.
Ok, what I'm seeing is that I do a full backup of the client machine,
that runs well; I then delete an entire subdirectory say
/var/ftp/{DIRA} which has say 10,000 files or about 1TiB or data. I
then do a restore of that directory from tape (last backup was a
full). Now I am seeing that the next incremental I do has the full
/var/ftp/{DIRA} being backed up again as if it were all new files,
likewise a differential will also back up this directory in full again
as well.In my mind at least since this directory was in the full
backup and I have accurate mode on, the backup system should KNOW that
the files are already on tape (the full backup that was used to do the
restore) and should only back up /NEW/ files added to that directory
since that last backup not the entire directory structure after a restore.
Can anyone comment?
Thanks.
Steve
--- (data for reference)--
bacula 3.0.3 compiled under ubuntu 8.04.3 LTS server (64bit).
Compile-time flags for reference:
./configure --prefix=/opt/bacula --enable-smartalloc --with-sqlite3
--with-openssl --enable-batch-insert
Backup size for a single test system is ~29TiB/4,600,000 files (sql
database size is ~1GiB)
---bacula-dir snip---
Job {
Name = loki-FullBackup
Type = Backup
Level = Full
Client = loki-fd
FileSet = loki-FileSet
Schedule = loki-Schedule
Accurate = yes
Storage = LTO4
Messages = Standard
Pool = BackupSetAA
Priority = 10
}
FileSet {
Name = loki-FileSet
Ignore FileSet Changes = yes
Include {
Options {
signature=MD5
Accurate=mcs5
Verify=pin5
onefs=yes
recurse=yes
sparse=yes
noatime=yes
hardlinks=yes
checkfilechanges=yes
}
File = /
File = /boot
File = /home
File = /var/ftp
}
Exclude {
File = /cdrom
File = /dev
File = /lost+found
File = /media
File = /opt/bacula/var/bacula/spool
File = /opt/bacula/var/bacula/working
File = /proc
File = /sys
File = /tmp
File = /var/ftp/tmp
File = /var/lock
File = /var/run
File = /var/tmp
File = /.fsck
File = /.journal
}
}
bacula-dir snip--
--
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
