Re: [Bacula-users] Accurate restoration of renamed/deleted file
Craig Ringer wrote: Craig Ringer wrote: Frank Sweetser wrote: Craig Ringer wrote: Frank Sweetser wrote: [deleted file tracking] has been implemented in the current development code base. Oh, I also meant to ask: Does deleted file tracking require the cooperation of the fd? Or will I be able to keep on using 2.4 fds on my clients? It'd be helpful not to have to run 2.4 and 2.5 fds in parallel on the clients. I haven't played with it, but I believe that it requires 2.5 FDs. Yes, looking at the sources, it does look like a 2.5 FD would be required. However, I'm not having any luck getting it working even with a 2.5 (today's SVN) director and FD. Aah, never mind. Had to add the Accurate directive to the job definition, it's right there in TFM. With: Accurate = yes it all works as expected (despite the TODO/FIXME notes in the code). I must've missed something in the fd code :S Excellent! Now, to see how it performs with my Maildir-like Cyrus IMAPd spool (67Gb, ~ 500,000 files, daily incrementals over weekly differentials and monthly full backups). I'm sure the developers would love to hear how the accurate code works in that kind of a real world test. -- Frank Sweetser fs at wpi.edu | For every problem, there is a solution that WPI Senior Network Engineer | is simple, elegant, and wrong. - HL Mencken GPG fingerprint = 6174 1257 129E 0D21 D8D4 E8A3 8E39 29E3 E2E8 8CEC -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Accurate restoration of renamed/deleted file
Frank Sweetser wrote: [deleted file tracking] has been implemented in the current development code base. Oh, I also meant to ask: Does deleted file tracking require the cooperation of the fd? Or will I be able to keep on using 2.4 fds on my clients? It'd be helpful not to have to run 2.4 and 2.5 fds in parallel on the clients. -- Craig Ringer -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Accurate restoration of renamed/deleted file
Frank Sweetser wrote: Craig Ringer wrote: I note that deleted/renamed file tracking is no longer shown on the sf.net bacula projects document: http://bacula.svn.sourceforge.net/viewvc/bacula/trunk/bacula/projects?view=markup Is it complete? I haven't seen anything about it on the site, ML, or in the ChangeLog in current SVN. The FAQ still says deleted files aren't tracked. It has been implemented in the current development code base. Thanks for pointing that out, as I wouldn't have known based on published info. I've pulled svn, butchered Ubuntu's source package for 2.4 to build 2.5 instead, and am testing it now. Is bacula SVN stable enough to be worth considering for production backups? ie - is there a test suite run regularly, etc? I'm in *serious* need of deleted file tracking, but nervous about using a prerelease. I'm planning on running backups of the deleted-file-handling-critical stuff in parallel with 2.5svn on a smaller scale for a while before I even consider moving anything important over to it exclusively. I'm curious to know what you think of using 2.5, with suitable testing, though. -- Craig Ringer -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Accurate restoration of renamed/deleted file
Craig Ringer wrote: Frank Sweetser wrote: Craig Ringer wrote: I note that deleted/renamed file tracking is no longer shown on the sf.net bacula projects document: http://bacula.svn.sourceforge.net/viewvc/bacula/trunk/bacula/projects?view=markup Is it complete? I haven't seen anything about it on the site, ML, or in the ChangeLog in current SVN. The FAQ still says deleted files aren't tracked. It has been implemented in the current development code base. Thanks for pointing that out, as I wouldn't have known based on published info. I've pulled svn, butchered Ubuntu's source package for 2.4 to build 2.5 instead, and am testing it now. Is bacula SVN stable enough to be worth considering for production backups? ie - is there a test suite run regularly, etc? I'm in *serious* need of deleted file tracking, but nervous about using a prerelease. It's pretty close, but it also hasn't been officially blessed yet, either. I'm planning on running backups of the deleted-file-handling-critical stuff in parallel with 2.5svn on a smaller scale for a while before I even consider moving anything important over to it exclusively. I'm curious to know what you think of using 2.5, with suitable testing, though. Luckily, there's a testing framework that you can easily grab and run your own suite of regression tests! You can find instructions on how to set up the test suite here: http://bacula.org/en/developers/Bacula_Regression_Testing.html and you can see the latest test results here: http://regress.bacula.org/ -- Frank Sweetser fs at wpi.edu | For every problem, there is a solution that WPI Senior Network Engineer | is simple, elegant, and wrong. - HL Mencken GPG fingerprint = 6174 1257 129E 0D21 D8D4 E8A3 8E39 29E3 E2E8 8CEC -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Accurate restoration of renamed/deleted file
Craig Ringer wrote: Frank Sweetser wrote: [deleted file tracking] has been implemented in the current development code base. Oh, I also meant to ask: Does deleted file tracking require the cooperation of the fd? Or will I be able to keep on using 2.4 fds on my clients? It'd be helpful not to have to run 2.4 and 2.5 fds in parallel on the clients. I haven't played with it, but I believe that it requires 2.5 FDs. -- Frank Sweetser fs at wpi.edu | For every problem, there is a solution that WPI Senior Network Engineer | is simple, elegant, and wrong. - HL Mencken GPG fingerprint = 6174 1257 129E 0D21 D8D4 E8A3 8E39 29E3 E2E8 8CEC -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Accurate restoration of renamed/deleted file
Frank Sweetser wrote:
Craig Ringer wrote:
Frank Sweetser wrote:
[deleted file tracking] has been implemented in the current
development code base.
Oh, I also meant to ask:
Does deleted file tracking require the cooperation of the fd? Or will
I be able to keep on using 2.4 fds on my clients? It'd be helpful not
to have to run 2.4 and 2.5 fds in parallel on the clients.
I haven't played with it, but I believe that it requires 2.5 FDs.
Yes, looking at the sources, it does look like a 2.5 FD would be required.
However, I'm not having any luck getting it working even with a 2.5
(today's SVN) director and FD.
I create:
/deltest
/deltest/always
/deltest/del_before_incr
then run a full backup. I then remove:
/deltest/del_before_incr
and create:
/deltest/created_after_incr
and run an incremental.
When `restore' is invoked in the console (selected most recent for
client, then the client used, then the DeletionTest job I created),
the mark list shows all three files. When I mark * in the root and
approve the restore to a temporary location that didn't previously
exist, all three files are created.
Taking a (quick) look at the source, it looks like Bacula should be
recording deleted file records, but the file daemon isn't doing anything
with them yet:
src/filed/restore.c:301
/* TODO: manage deleted files */
if (rctx.type == FT_DELETED) { /* deleted file */
continue;
}
... and I didn't see any sign of the FT_DELETED filetype attribute
seeing use in the director.
bextract should list any deleted files:
src/stored/bextract.c:
if (attr-type == FT_DELETED) {
Jmsg(jcr, M_INFO, 0, _(%s was deleted.\n), attr-fname);
extract = false;
return true;
}
... so given that no such was deleted messages appear when I run
bextract on a volume that should contain deleted file records, I guess
they're not being recorded in the first place.
The filed does call accurate_send_deleted_list(...) from backup.c:140 .
I'm not quite sure what's going wrong yet... I'll try to trace things.
In the mean time, if anyone knows something that's required to enable
deleted file tracking or the degree of completeness of the feature, I'd
love to hear about it.
Job definition:
Job {
Name = BackupDT
JobDefs = DefaultJob
Schedule = SystemCycle# very similar to the default
Client = backup-fd
Storage = File
FileSet = DeletionTest
}
FileSet {
Name = DeletionTest
Include {
File = /deltest
}
}
JobDefs defaults to incremental. It doesn't do anything of much interest.
--
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Accurate restoration of renamed/deleted file
Craig Ringer wrote: Frank Sweetser wrote: Craig Ringer wrote: Frank Sweetser wrote: [deleted file tracking] has been implemented in the current development code base. Oh, I also meant to ask: Does deleted file tracking require the cooperation of the fd? Or will I be able to keep on using 2.4 fds on my clients? It'd be helpful not to have to run 2.4 and 2.5 fds in parallel on the clients. I haven't played with it, but I believe that it requires 2.5 FDs. Yes, looking at the sources, it does look like a 2.5 FD would be required. However, I'm not having any luck getting it working even with a 2.5 (today's SVN) director and FD. Aah, never mind. Had to add the Accurate directive to the job definition, it's right there in TFM. With: Accurate = yes it all works as expected (despite the TODO/FIXME notes in the code). I must've missed something in the fd code :S Now, to see how it performs with my Maildir-like Cyrus IMAPd spool (67Gb, ~ 500,000 files, daily incrementals over weekly differentials and monthly full backups). -- Craig Ringer -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Accurate restoration of renamed/deleted file
michael riehemann wrote: Hi all, is there any way (at the moment) to do Accurate restoration of renamed/deleted files with differenziell and full backups? I note that deleted/renamed file tracking is no longer shown on the sf.net bacula projects document: http://bacula.svn.sourceforge.net/viewvc/bacula/trunk/bacula/projects?view=markup Is it complete? I haven't seen anything about it on the site, ML, or in the ChangeLog in current SVN. The FAQ still says deleted files aren't tracked. Also: Item 14 (Add an override in Schedule for Pools based on backup types) is actually covered now by the FullPool=, IncrementalPool= and DifferentialPool= directives in the schedule, since pools may specify storage devices using the Storage directive. It's a bit roundabout, but since in general when a backup is upgraded you want its retention periods etc to be upgraded too, it probably makes more sense. Item 25 can already be done with scripting, and Item 24 can already be done by splitting the fileset up appropriately and using multiple concurrent jobs on the same fd. -- Craig Ringer -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Accurate restoration of renamed/deleted file
Craig Ringer wrote: michael riehemann wrote: Hi all, is there any way (at the moment) to do Accurate restoration of renamed/deleted files with differenziell and full backups? I note that deleted/renamed file tracking is no longer shown on the sf.net bacula projects document: http://bacula.svn.sourceforge.net/viewvc/bacula/trunk/bacula/projects?view=markup Is it complete? I haven't seen anything about it on the site, ML, or in the ChangeLog in current SVN. The FAQ still says deleted files aren't tracked. It has been implemented in the current development code base. -- Frank Sweetser fs at wpi.edu | For every problem, there is a solution that WPI Senior Network Engineer | is simple, elegant, and wrong. - HL Mencken GPG fingerprint = 6174 1257 129E 0D21 D8D4 E8A3 8E39 29E3 E2E8 8CEC -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Accurate restoration of renamed/deleted file
Hi all, is there any way (at the moment) to do Accurate restoration of renamed/deleted files with differenziell and full backups? If die differenziell ist the last one. maybe for mail servers? many thanks michael -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
