Re: [Bacula-users] Incremental is really a full on FC6
Well, after doing a stat on many, many files, it appears that Nautilus
or some other application (possibly updatedb) is modifying the
timestamps on every file on the system. There is no virus checker as
this is a Linux system.
Placing mtimeonly=yes in the Options seems to take care of the problem.
On Fri, 2007-03-30 at 05:31 -0600, Ridley wrote:
I have Bacula backing up only /home on a Linux workstation running FC6.
This is the Fileset:
FileSet {
Name = Home Set
Include {
Options {
signature = MD5
compression = GZIP
Exclude = yes
WildFile = /home/*/.mozilla/firefox/*/Cache/*
WildFile = /home/*/.mozilla/default/*/Cache/*
WildFile = /home/*/.mozilla/eclipse/Cache/*
WildFile = /home/*/.gnome2/epiphany/mozilla/epiphany/Cache/*
WildDir = /home/*/.beagle/TextCache
WildDir = /home/*/.evolution/cache
WildDir = /home/*/.java/deployment/cache
}
File = /home
}
# Exclude {
# }
}
And this is the Schedule:
Schedule {
Name = WeeklyCycle
Run = Full 1st sun at 23:05
Run = Differential 2nd-5th sun at 23:05
Run = Incremental mon-sat at 23:05
}
Unfortunately, even though the Job says it is supposed to perform
Incrementals mon-sat and the messages say it is an incremental, it uses
nearly the same amount of space every time:
Job run manually:
...
Backup Level: Full (upgraded from Incremental)
...
FD Bytes Written: 32,908,099,036 (32.90 GB)
SD Bytes Written: 32,921,345,734 (32.92 GB)
...
Job run automatically later in day:
...
Backup Level: Incremental, since=2007-03-29 14:05:18
...
FD Bytes Written: 31,923,730,782 (31.92 GB)
SD Bytes Written: 31,930,104,420 (31.93 GB)
...
What gives? I know all 32 GB didn't change as they are mostly digital
pictures in the home directory? Is there something in gnome or FC6 that
changes the atime on every file?
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/bacula-users
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Incremental is really a full on FC6
Well, after doing a stat on many, many files, it appears that Nautilus
or some other application (possibly updatedb) is modifying the
timestamps on every file on the system. There is no virus checker as
this is a Linux system.
Placing mtimeonly=yes in the Options seems to take care of the problem.
On Fri, 2007-03-30 at 05:31 -0600, Ridley wrote:
I have Bacula backing up only /home on a Linux workstation running FC6.
This is the Fileset:
FileSet {
Name = Home Set
Include {
Options {
signature = MD5
compression = GZIP
Exclude = yes
WildFile = /home/*/.mozilla/firefox/*/Cache/*
WildFile = /home/*/.mozilla/default/*/Cache/*
WildFile = /home/*/.mozilla/eclipse/Cache/*
WildFile = /home/*/.gnome2/epiphany/mozilla/epiphany/Cache/*
WildDir = /home/*/.beagle/TextCache
WildDir = /home/*/.evolution/cache
WildDir = /home/*/.java/deployment/cache
}
File = /home
}
# Exclude {
# }
}
And this is the Schedule:
Schedule {
Name = WeeklyCycle
Run = Full 1st sun at 23:05
Run = Differential 2nd-5th sun at 23:05
Run = Incremental mon-sat at 23:05
}
Unfortunately, even though the Job says it is supposed to perform
Incrementals mon-sat and the messages say it is an incremental, it uses
nearly the same amount of space every time:
Job run manually:
...
Backup Level: Full (upgraded from Incremental)
...
FD Bytes Written: 32,908,099,036 (32.90 GB)
SD Bytes Written: 32,921,345,734 (32.92 GB)
...
Job run automatically later in day:
...
Backup Level: Incremental, since=2007-03-29 14:05:18
...
FD Bytes Written: 31,923,730,782 (31.92 GB)
SD Bytes Written: 31,930,104,420 (31.93 GB)
...
What gives? I know all 32 GB didn't change as they are mostly digital
pictures in the home directory? Is there something in gnome or FC6 that
changes the atime on every file?
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Incremental is really a full on FC6
* Ridley schrieb am 30.03.07 um 22:52 Uhr:
What you've said makes sense to me too, but when I check the logs, it
shows that the files that were saved were compressed. Here's the full
log for the incremental:
[...]
JobId: 4
Job:gandalf.2007-03-29_23.05.00
Backup Level: Incremental, since=2007-03-29 14:05:18
Client: gandalf 2.0.3 (06Mar07)
i686-redhat-linux-gnu,redhat,(Zod)
FileSet:Home Set 2007-03-29 11:54:17
Pool: Default (From Job resource)
Storage:File (From Job resource)
Scheduled time: 29-Mar-2007 23:05:00
Start time: 29-Mar-2007 23:05:03
End time: 30-Mar-2007 00:14:40
Elapsed time: 1 hour 9 mins 37 secs
Priority: 10
FD Files Written: 38,621
SD Files Written: 38,621
FD Bytes Written: 31,923,730,782 (31.92 GB)
SD Bytes Written: 31,930,104,420 (31.93 GB)
Rate: 7642.7 KB/s
Software Compression: 7.8 %
VSS:no
Encryption: no
Volume name(s): Vol-0002|Vol-0003|Vol-0004
Volume Session Id: 4
Volume Session Time:1175188894
Last Volume Bytes: 1,040,824,645 (1.040 GB)
Non-fatal FD errors:0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination:Backup OK
Indeed.
As it should be (or is?) possible to apply things like
compression only to files selected by a wild = or regx= option this is
a bit strange.
Kern can you clarify this? Are the following FileSets not correct?
Maybe this is only possible by creating more Include{} resources.
I dont know... maybe like this:
# 1. compress only *.txt and *.TXT files:
FileSet {
Name = OnlyCompressTxtFiles
Include {
Options {
compression = yes
regex = ^.*\.(txt|TXT)$
}
File = /home
}
}
# 2. compress all but gzip'ed files
FileSet {
Name = CompressAllButGzipFiles
Include {
Options {
compression = no
regex = ^.*\.(gz|tgz)$
}
Options {
compression = yes
}
File = /home
}
}
30-Mar 00:14 backup-dir: Begin pruning Jobs.
30-Mar 00:14 backup-dir: No Jobs found to prune.
30-Mar 00:14 backup-dir: Begin pruning Files.
30-Mar 00:14 backup-dir: No Files found to prune.
30-Mar 00:14 backup-dir: End auto prune.
But the real problem is why the system is requiring a full backup even
though it says it's an incremental. As far as I can tell, every single
file was backed up on the incremental which tells me that something in
FC6 is modifying something that Bacula looks at. I should note that when
I was setting the configuration files up, I simply backed up /etc and
the full and incremental backups worked as expected.
Bacula makes a full backup after you modified a FileSet, may this be
the cause?
Or may it be that all your files have a modification time in the future?
In this situation, I manually ran the job after modifying the bacula-dir
file to make sure it would work. I then let the system do an automatic
backup last night and was suprized that over 30GB of data were backed
up. I'm gonna run out of disk space in a hurry at this rate :-)
Yes. have a deeper look at the files. And use
estimate job=jobname level=Incremental listing
in bconsole to test what would be done.
-Marc
--
begin LOVE-LETTER-FOR-YOU.txt.vbs
I am a signature virus. Distribute me until the bitter
end
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Incremental is really a full on FC6
Are you running an antivirus scan?
I ran into a problem a few years ago where a certain antivirus product
was modifying the dates on files..
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Ridley
Sent: Friday, March 30, 2007 1:53 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Incremental is really a full on FC6
What you've said makes sense to me too, but when I check the logs, it
shows that the files that were saved were compressed. Here's the full
log for the incremental:
29-Mar 23:05 backup-dir: Start Backup JobId 4,
Job=gandalf.2007-03-29_23.05.00
29-Mar 23:05 backup-sd: Volume Vol-0002 previously written, moving to
end of data.
29-Mar 23:25 backup-sd: User defined maximum volume capacity
21,474,836,480 exceeded on device File (/tmp).
29-Mar 23:25 backup-sd: End of medium on Volume Vol-0002
Bytes=21,474,832,835 Blocks=332,882 at 29-Mar-2007 23:25.
29-Mar 23:25 backup-dir: Created new Volume Vol-0003 in catalog.
29-Mar 23:25 backup-sd: Labeled new Volume Vol-0003 on device
File (/tmp).
29-Mar 23:25 backup-sd: Wrote label to prelabeled Volume Vol-0003 on
device File (/tmp)
29-Mar 23:25 backup-sd: New volume Vol-0003 mounted on device
File (/tmp) at 29-Mar-2007 23:25.
30-Mar 00:08 backup-sd: User defined maximum volume capacity
21,474,836,480 exceeded on device File (/tmp).
30-Mar 00:08 backup-sd: End of medium on Volume Vol-0003
Bytes=21,474,818,876 Blocks=332,881 at 30-Mar-2007 00:08.
30-Mar 00:08 backup-dir: Created new Volume Vol-0004 in catalog.
30-Mar 00:08 backup-sd: Labeled new Volume Vol-0004 on device
File (/tmp).
30-Mar 00:08 backup-sd: Wrote label to prelabeled Volume Vol-0004 on
device File (/tmp)
30-Mar 00:08 backup-sd: New volume Vol-0004 mounted on device
File (/tmp) at 30-Mar-2007 00:08.
30-Mar 00:14 backup-sd: Job write elapsed time = 01:09:35, Transfer rate
= 7.647 M bytes/second
30-Mar 00:14 backup-dir: Bacula 2.0.3 (06Mar07): 30-Mar-2007 00:14:40
JobId: 4
Job:gandalf.2007-03-29_23.05.00
Backup Level: Incremental, since=2007-03-29 14:05:18
Client: gandalf 2.0.3 (06Mar07)
i686-redhat-linux-gnu,redhat,(Zod)
FileSet:Home Set 2007-03-29 11:54:17
Pool: Default (From Job resource)
Storage:File (From Job resource)
Scheduled time: 29-Mar-2007 23:05:00
Start time: 29-Mar-2007 23:05:03
End time: 30-Mar-2007 00:14:40
Elapsed time: 1 hour 9 mins 37 secs
Priority: 10
FD Files Written: 38,621
SD Files Written: 38,621
FD Bytes Written: 31,923,730,782 (31.92 GB)
SD Bytes Written: 31,930,104,420 (31.93 GB)
Rate: 7642.7 KB/s
Software Compression: 7.8 %
VSS:no
Encryption: no
Volume name(s): Vol-0002|Vol-0003|Vol-0004
Volume Session Id: 4
Volume Session Time:1175188894
Last Volume Bytes: 1,040,824,645 (1.040 GB)
Non-fatal FD errors:0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination:Backup OK
30-Mar 00:14 backup-dir: Begin pruning Jobs.
30-Mar 00:14 backup-dir: No Jobs found to prune.
30-Mar 00:14 backup-dir: Begin pruning Files.
30-Mar 00:14 backup-dir: No Files found to prune.
30-Mar 00:14 backup-dir: End auto prune.
But the real problem is why the system is requiring a full backup even
though it says it's an incremental. As far as I can tell, every single
file was backed up on the incremental which tells me that something in
FC6 is modifying something that Bacula looks at. I should note that when
I was setting the configuration files up, I simply backed up /etc and
the full and incremental backups worked as expected.
In this situation, I manually ran the job after modifying the bacula-dir
file to make sure it would work. I then let the system do an automatic
backup last night and was suprized that over 30GB of data were backed
up. I'm gonna run out of disk space in a hurry at this rate :-)
On Fri, 2007-03-30 at 14:04 +0200, Marc Schiffbauer wrote:
...
Not really about your Problem:
If I understand the docs correctly, your Options signature,
and compression do *not* apply to your files, but instead to your
excluded files only, which makes no sense.
I think yout have to add seperate
Options {
signature = MD5
compression = GZIP
}
before the current one.
Kern ist this right what I say?
About your Problem: Are you really sure that attributes of the files
or something like that have changed for example?
-Marc
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share
your
opinions on IT business topics through brief surveys-and earn cash
Re: [Bacula-users] Incremental is really a full on FC6
* Ridley schrieb am 30.03.07 um 13:31 Uhr:
I have Bacula backing up only /home on a Linux workstation running FC6.
This is the Fileset:
FileSet {
Name = Home Set
Include {
Options {
signature = MD5
compression = GZIP
Exclude = yes
WildFile = /home/*/.mozilla/firefox/*/Cache/*
WildFile = /home/*/.mozilla/default/*/Cache/*
WildFile = /home/*/.mozilla/eclipse/Cache/*
WildFile = /home/*/.gnome2/epiphany/mozilla/epiphany/Cache/*
WildDir = /home/*/.beagle/TextCache
WildDir = /home/*/.evolution/cache
WildDir = /home/*/.java/deployment/cache
}
File = /home
}
# Exclude {
# }
}
Not really about your Problem:
If I understand the docs correctly, your Options signature,
and compression do *not* apply to your files, but instead to your
excluded files only, which makes no sense.
I think yout have to add seperate
Options {
signature = MD5
compression = GZIP
}
before the current one.
Kern ist this right what I say?
About your Problem: Are you really sure that attributes of the files
or something like that have changed for example?
-Marc
--
+--+
| -- http://www.links2linux.de -- |
| |
+---Registered-Linux-User-#136487http://counter.li.org +
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Incremental is really a full on FC6
What you've said makes sense to me too, but when I check the logs, it
shows that the files that were saved were compressed. Here's the full
log for the incremental:
29-Mar 23:05 backup-dir: Start Backup JobId 4,
Job=gandalf.2007-03-29_23.05.00
29-Mar 23:05 backup-sd: Volume Vol-0002 previously written, moving to
end of data.
29-Mar 23:25 backup-sd: User defined maximum volume capacity
21,474,836,480 exceeded on device File (/tmp).
29-Mar 23:25 backup-sd: End of medium on Volume Vol-0002
Bytes=21,474,832,835 Blocks=332,882 at 29-Mar-2007 23:25.
29-Mar 23:25 backup-dir: Created new Volume Vol-0003 in catalog.
29-Mar 23:25 backup-sd: Labeled new Volume Vol-0003 on device
File (/tmp).
29-Mar 23:25 backup-sd: Wrote label to prelabeled Volume Vol-0003 on
device File (/tmp)
29-Mar 23:25 backup-sd: New volume Vol-0003 mounted on device
File (/tmp) at 29-Mar-2007 23:25.
30-Mar 00:08 backup-sd: User defined maximum volume capacity
21,474,836,480 exceeded on device File (/tmp).
30-Mar 00:08 backup-sd: End of medium on Volume Vol-0003
Bytes=21,474,818,876 Blocks=332,881 at 30-Mar-2007 00:08.
30-Mar 00:08 backup-dir: Created new Volume Vol-0004 in catalog.
30-Mar 00:08 backup-sd: Labeled new Volume Vol-0004 on device
File (/tmp).
30-Mar 00:08 backup-sd: Wrote label to prelabeled Volume Vol-0004 on
device File (/tmp)
30-Mar 00:08 backup-sd: New volume Vol-0004 mounted on device
File (/tmp) at 30-Mar-2007 00:08.
30-Mar 00:14 backup-sd: Job write elapsed time = 01:09:35, Transfer rate
= 7.647 M bytes/second
30-Mar 00:14 backup-dir: Bacula 2.0.3 (06Mar07): 30-Mar-2007 00:14:40
JobId: 4
Job:gandalf.2007-03-29_23.05.00
Backup Level: Incremental, since=2007-03-29 14:05:18
Client: gandalf 2.0.3 (06Mar07)
i686-redhat-linux-gnu,redhat,(Zod)
FileSet:Home Set 2007-03-29 11:54:17
Pool: Default (From Job resource)
Storage:File (From Job resource)
Scheduled time: 29-Mar-2007 23:05:00
Start time: 29-Mar-2007 23:05:03
End time: 30-Mar-2007 00:14:40
Elapsed time: 1 hour 9 mins 37 secs
Priority: 10
FD Files Written: 38,621
SD Files Written: 38,621
FD Bytes Written: 31,923,730,782 (31.92 GB)
SD Bytes Written: 31,930,104,420 (31.93 GB)
Rate: 7642.7 KB/s
Software Compression: 7.8 %
VSS:no
Encryption: no
Volume name(s): Vol-0002|Vol-0003|Vol-0004
Volume Session Id: 4
Volume Session Time:1175188894
Last Volume Bytes: 1,040,824,645 (1.040 GB)
Non-fatal FD errors:0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination:Backup OK
30-Mar 00:14 backup-dir: Begin pruning Jobs.
30-Mar 00:14 backup-dir: No Jobs found to prune.
30-Mar 00:14 backup-dir: Begin pruning Files.
30-Mar 00:14 backup-dir: No Files found to prune.
30-Mar 00:14 backup-dir: End auto prune.
But the real problem is why the system is requiring a full backup even
though it says it's an incremental. As far as I can tell, every single
file was backed up on the incremental which tells me that something in
FC6 is modifying something that Bacula looks at. I should note that when
I was setting the configuration files up, I simply backed up /etc and
the full and incremental backups worked as expected.
In this situation, I manually ran the job after modifying the bacula-dir
file to make sure it would work. I then let the system do an automatic
backup last night and was suprized that over 30GB of data were backed
up. I'm gonna run out of disk space in a hurry at this rate :-)
On Fri, 2007-03-30 at 14:04 +0200, Marc Schiffbauer wrote:
...
Not really about your Problem:
If I understand the docs correctly, your Options signature,
and compression do *not* apply to your files, but instead to your
excluded files only, which makes no sense.
I think yout have to add seperate
Options {
signature = MD5
compression = GZIP
}
before the current one.
Kern ist this right what I say?
About your Problem: Are you really sure that attributes of the files
or something like that have changed for example?
-Marc
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
