Re: [Bacula-users] Use modify time, not access time
On 17/11/2012 3:05 AM, Dan Langille wrote: > You mention that you checked mtime, and atime. What about ctime? FYI, > Bacula, to my knowledge, does not backup depending up on atime. Thinking about it - if you "mv" a directory somewhere, and then "mv" it back, you have, effectively, created a new directory tree. Without looking at the source code, if I was writing the scanner, at *this* point I would mark that directory tree to be backed up, even if the name is the same you cannot know that the content is identical, for all you know that three was deleted and re-created. Why bother walking a tree that is new, once you know it is new, you back it up. And, after backing up computers on-and-off for three decades, I worry about not *enough* data being backed up, if I saw more than I had expected, I would assume I had unrealistic expectations, examine my assumptions again, and realise something like, "Such and such a process touches (huge set of files) and tacks a line on the end of each, so of course they all get backed up." Or whatever. The list of files getting backed up would be interesting, as would the Job definitions and so on. Cheers, GaryB-) -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Use modify time, not access time
Zitat von Dan Langille : > On 2012-11-15 23:46, Gary R, Schmidt wrote: >> On 16.11.2012 13:52, Wouter van Marle wrote: >> [SNIP] >>> Result: yesterday I moved a big mail folder with subfolders, causing >>> the >> You *moved* a directory, and you are surprised that the files in it >> are >> being backed up? > > If I recall correctly, this has long been described as a 'bug' by some, > but not as you describe. > > From > http://www.bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html > > "In addition, if you move a directory rather than copy it, the files in > it do > not have their modification time (st_mtime) or their attribute change > time > (st_ctime) changed. As a consequence, those files will probably not be > backed > up by an Incremental or Differential backup which depend solely on > these time > stamps. If you move a directory, and wish it to be properly backed up, > it is > generally preferable to copy it, then delete the original." > > What we are seeing here is the opposite of that. > >> Bacula has never seen these files in that location before, if it >> *didn't* back them up that would be a total failure. > > What is described above is not the expected behavior. In fact, it's > the opposite > of the expected behavior, given that Bacula, by default, use mtime to > decide what > to backup with an incremental/differential. It does not use 'have I > seen this file > here before'. I believe that's an 'accurate backup' option. You are right. On second thought it is more obvious that st_ctime is *not* changed because the inode pointing to the directory is changed on move, not the directory inode itself i guess. So maybe the OP has done a "mv" across mount points? On what filesystem was this behaviour observed by the way? Regards Andreas -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with backup: always full backup started
Am Fri, 16 Nov 2012 10:53:44 -0500 schrieb Dan Langille : > All OK now? Yes, thanks! I forgot to say it... Regards -- Luca Bertoncello Programmierer FrischerGehts.net GmbH & Co. KG Schützenplatz 14 01067 Dresden Tel.: +49(0)351 / 30 70 66 21 E-Mail: bertonce...@frischergehts.net Geschäftsführung: Michael Noack Handelsregister: Amtsgericht Dresden HRA 8151 USt.-ID: DE276174185 Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese Mail. Das Kopieren sowie die Weitergabe dieser E-Mail ist nicht gestattet. This E-Mail contains confidential and/or legally protected information. If you are not the correct addressee or have received this E-Mail erroneously, please inform the sender immediately and delete this mail. The copying as well as the transmitting of this E-Mail is not permitted. signature.asc Description: PGP signature -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Use modify time, not access time
On 2012-11-15 21:52, Wouter van Marle wrote: > Hi, > > I have a big problem with Bacula and the backup of my Cyrus mail > store: > it is backing up way too much. > > When doing incremental it's supposed to look at modify time (which > for > many mails - one file per e-mail - is months or years past), but it > appears to look at the access time instead. > > Result: yesterday I moved a big mail folder with subfolders, causing > the > access time but not the modify time of all contents to change, and > now > Bacula is backing up everything. Looking at the restore function in > bconsole, I see the file time given is the access time, not the > modify > time. > > When doing `ls -la` I see the original modify time, long time ago. > When doing `ls -lu` I see the access time, which is the time these > mail > boxes were moved (yesterday). > And when doing `dir` in `bconsole` the time that I see is the access > time; not the modify time! > > How to stop this unnecessary backup? It's annoying and wasting disk > space. From: http://www.bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html "The File daemon (Client) decides which files to backup for an Incremental backup by comparing start time of the prior Job (Full, Differential, or Incremental) against the time each file was last "modified" (st_mtime) and the time its attributes were last "changed"(st_ctime). If the file was modified or its attributes changed on or after this start time, it will then be backed up." You mention that you checked mtime, and atime. What about ctime? FYI, Bacula, to my knowledge, does not backup depending up on atime. -- Dan Langille - http://langille.org/ -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Use modify time, not access time
On 2012-11-15 23:46, Gary R, Schmidt wrote: > On 16.11.2012 13:52, Wouter van Marle wrote: > [SNIP] >> Result: yesterday I moved a big mail folder with subfolders, causing >> the > You *moved* a directory, and you are surprised that the files in it > are > being backed up? If I recall correctly, this has long been described as a 'bug' by some, but not as you describe. From http://www.bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html "In addition, if you move a directory rather than copy it, the files in it do not have their modification time (st_mtime) or their attribute change time (st_ctime) changed. As a consequence, those files will probably not be backed up by an Incremental or Differential backup which depend solely on these time stamps. If you move a directory, and wish it to be properly backed up, it is generally preferable to copy it, then delete the original." What we are seeing here is the opposite of that. > Bacula has never seen these files in that location before, if it > *didn't* back them up that would be a total failure. What is described above is not the expected behavior. In fact, it's the opposite of the expected behavior, given that Bacula, by default, use mtime to decide what to backup with an incremental/differential. It does not use 'have I seen this file here before'. I believe that's an 'accurate backup' option. -- Dan Langille - http://langille.org/ -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem with backup: always full backup started
On 2012-11-14 07:52, Luca Bertoncello wrote: > Am Wed, 14 Nov 2012 13:42:00 +0100 > schrieb lst_ho...@kwsoft.de: > > Hello, > >> have you checked if the fileset has not been altered after starting >> the Full backup? Try to start a incremental by hand after a full >> backup to see what's happen. > > I added two directories to the fileset... > And now, that you said it, I discovered a paragraph in the > documentation, that said, the a change to the fileset force a full > backup... > > Let us see, what this night happens... > All OK now? -- Dan Langille - http://langille.org/ -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Use modify time, not access time
On 2012-11-16 00:57, Wouter van Marle wrote:
>> You should include the Job {} in question, and any JobDefs in use.
>>
>> I suspect you are doing accurate backups.
>>
> That I switched off already; may have been the cause. I always got
> excessive incremental backup sizes, 500 MB while expecting 10-50 MB.
>
> Issue at hand is that I moved a mailbox, then moved it back (original
> location) and it's still being backuped. That's not good.
I still think you should include the Job and JobDefs, and the
FileSet
--
Dan Langille - http://langille.org/
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
On 11/16/2012 3:33 AM, Cejka Rudolf wrote: > Wolfgang Denk wrote (2012/11/16): >> I did the same (to test the drives individualy, to make sure these are >> actually available and working); see the full configuration I posted >> before here: >> http://article.gmane.org/gmane.comp.sysutils.backup.bacula.general/72107 > Hi, change > Device = LTO3-0, LTO3-1 > to > Device = Autochanger > What does say status storage=LTOLIB then? Nice catch, Cejka. This is almost certainly the problem. That mismatch should probably be caught as a config error during startup, since resource LTOLIB is defined with autochanger=yes in bacula-dir.conf and the Device= is listing devices that are not defined as autochangers in bacula-sd.conf. However, I don't think that is possible, because bacula-dir does not know the configuration of bacula-sd, which is why it must be also defined in bacula-dir to begin with. -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Hello,
2012/11/15 Wolfgang Denk
> director - bacula-dir.conf :
>
>
> # Definition of LTO(3) autoloader
> Storage {
> Name = LTOLIB
Address = xxx
> SDPort= 9103
> Password = yyy
> Device= LTO3-0, LTO3-1
>
Here should be a Device = Autochanger
> Media Type= LTO-3
> Autochanger = yes
> Maximum Concurrent Jobs = 6
> }
> Storage server xxx - bacula-sd.conf:
>
> Autochanger {
> Name = Autochanger
> Device = LTO3-0
> Device = LTO3-1
> Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
> Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0
> }
>
You current sertup is a kind of round-robin virtual Storage resource which
is working as expected.
best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Use modify time, not access time
Zitat von Wouter van Marle : > On Fri, 2012-11-16 at 15:46 +1100, Gary R, Schmidt wrote: >> On 16.11.2012 13:52, Wouter van Marle wrote: >> [SNIP] >> > Result: yesterday I moved a big mail folder with subfolders, causing >> > the >> You *moved* a directory, and you are surprised that the files in it are >> being backed up? > > Sorry I was incomplete. > Files were accidentally moved, and subsequently moved back to the exact > original location. > > Wouter. From the manual: The File daemon (Client) decides which files to backup for an Incremental backup by comparing start time of the prior Job (Full, Differential, or Incremental) against the time each file was last "modified" (st_mtime) and the time its attributes were last "changed"(st_ctime). If the file was modified or its attributes changed on or after this start time, it will then be backed up. And as far as i understand http://www.kernel.org/doc/man-pages/online/pages/man2/stat.2.html st_ctime is changed by changing inode information, which is used to set the location in the directory tree. So i guess moving around a directory indeed will include it in the next backup. Regards Andreas -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Wolfgang Denk wrote (2012/11/16):
> > > Autochanger {
> > >Name = Autochanger
> > >Device = LTO3-0
> > >Device = LTO3-1
> > >Changer Command = "/usr/libexec/bacula/mtx-changer %c %o %S %a %d"
> > >Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0
> > > }
> >
> > Try replacing the two Device= lines with one line:
> > Device = LT03-0,LT02-1
^^
LTO3-1
> Thanks for the idea - done, but unfortunately this does not change the
> behaviour in any way.
And this is good, because Bacula manual explicitly says, that "You may
specify multiple device names on a single line separated by commas,
and/or you may specify multiple Device directives. This directive is
required." for Autochanger resource.
Best regards.
--
Rudolf Cejka http://www.fit.vutbr.cz/~cejkar
Brno University of Technology, Faculty of Information Technology
Bozetechova 2, 612 66 Brno, Czech Republic
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
John Drescher wrote (2012/11/15): > > However, no matter what I enter at the prompt "Enter autochanger > > drive[0]:", the director will always send a command to access drive > > index 0. > > Where do you get this prompt? I have never ever been asked this and I > have had an autochanger at work since 2006 and I used it with bacula > from the start since I was already using bacula for years before I got > the changer.. And do you have two or more drives? -- Rudolf Cejka http://www.fit.vutbr.cz/~cejkar Brno University of Technology, Faculty of Information Technology Bozetechova 2, 612 66 Brno, Czech Republic -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to specify drive of Autochanger?
Wolfgang Denk wrote (2012/11/16): > I did the same (to test the drives individualy, to make sure these are > actually available and working); see the full configuration I posted > before here: > http://article.gmane.org/gmane.comp.sysutils.backup.bacula.general/72107 Hi, change Device = LTO3-0, LTO3-1 to Device = Autochanger What does say status storage=LTOLIB then? Best regards. -- Rudolf Cejka http://www.fit.vutbr.cz/~cejkar Brno University of Technology, Faculty of Information Technology Bozetechova 2, 612 66 Brno, Czech Republic -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ownership of restores
Op 20121115 om 14:07 schreef Christoph Litauer: > Am 13.11.2012 um 09:09 schrieb Geert Stappers : > > Op 20121112 om 13:55 schreef Christoph Litauer: > >> Yes, I am restoring to the same server the backup was taken from. > >> Parts of the restore got the correct user and group mapping ... > > > > Could it be that Samba or another file ownership remapping technique is > > involved? > > > > If so, goes a restore the same way back, as a backup came? > > > > no, the server is a SuSE Enterprise Linux running the bacula-fd. No > samba etc. involved. Data goes same way there and back. Parts of the > data is restored with correct ownership and there is no different > handling on the erroneous restored data. Okay. And now is this interresting problem back on the mailinglist. Cheers Geert Stappers -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
