Longish answer below...
On Fri, Sep 1, 2017 at 3:22 AM, Gandalf Corvotempesta <
gandalf.corvotempe...@gmail.com> wrote:
> 2017-08-31 16:33 GMT+02:00 Ray Frush <fr...@rams.colostate.edu>:
> > The values you'll want to check:
> > $Conf{IncrKeepCnt} = 26; # This is the number of total 'unfilled'
> > backups kept.
> >
> > $Conf{FillCycle} = 7; # This is how often a filled backup is kept (1
> per
> > week) which strongly influences the next setting
> >
> > $Conf{FullKeepCnt} = [ 4, 3, 0, ]; # This defines how many 'filled'
> > backups are retained.
> >
> > The combination of filled and unfilled backups result in ~32 days of
> daily
> > backups plus a couple of older ones just in case a user needs a file from
> > more than a month ago.
>
> So, to archieve a 7 days of daily backups with 1 filled backup every 4
> months, the following would be ok ?
>
> $Conf{IncrKeepCnt} = 7; # 7 days of incrementals
> $Conf{FillCycle} = 120; # 1 filled every 120 days (4 months)
> $Conf{FullKeepCnt} = [ 0 ]; # keep only the latest full
>
>
BackupPC's retention rules are not necessarily the easiest to understand.
Your proposed schedule would result in having only 7 days of backups, which
is probably not what you want.
Here are some examples from my schedule (shown above). Our goal (SLA
actually) is to keep a month of daily resolution backups, I keep a couple
of extra weeks around just in case, since the incremental storage cost is
really really low. Note the "duration" of the backups. 'filled' backups
don't cost time, as they are still an 'incremental' backup.
Here's a newly added host. The retention schedule isn't even fully filled
in yet.
You can see the "full" backup taken the first time, and the the subsequent
'filled' backups controlled by the "$Conf{FillCycle} = 7;" setting.
Once a backup is 'filled' it is treated the same whether it was a full, or
a 'filled' incremental.
Backup# Type Filled Level Start Date Duration/mins Age/days
Server Backup Path
0 full yes 0 8/7 10:39 20.9 24.9
/mnt/backups/BackupPC/pc/[hostname]/0
1 incr no 1 8/8 10:02 1.7 23.9
/mnt/backups/BackupPC/pc/[hostname]/1
2 incr no 1 8/9 10:00 2.0 22.9
/mnt/backups/BackupPC/pc/[hostname]/2
3 incr no 1 8/10 10:00 2.0 21.9
/mnt/backups/BackupPC/pc/[hostname]/3
4 incr no 1 8/11 10:00 3.9 20.9
/mnt/backups/BackupPC/pc/[hostname]/4
5 incr no 1 8/12 10:00 2.0 19.9
/mnt/backups/BackupPC/pc/[hostname]/5
6 incr no 1 8/13 10:00 1.6 18.9
/mnt/backups/BackupPC/pc/[hostname]/6
7 incr yes 1 8/14 18:00 2.5 17.6
/mnt/backups/BackupPC/pc/[hostname]/7
----- (your proposed schedule would cut off here) ----
8 incr no 1 8/15 19:03 2.9 16.6
/mnt/backups/BackupPC/pc/[hostname]/8
9 incr no 1 8/16 19:03 3.2 15.6
/mnt/backups/BackupPC/pc/[hostname]/9
10 incr no 1 8/17 19:05 3.8 14.6
/mnt/backups/BackupPC/pc/[hostname]/10
11 incr no 1 8/18 19:11 3.0 13.6
/mnt/backups/BackupPC/pc/[hostname]/11
12 incr no 1 8/19 19:05 3.0 12.6
/mnt/backups/BackupPC/pc/[hostname]/12
13 incr no 1 8/20 19:06 3.1 11.6
/mnt/backups/BackupPC/pc/[hostname]/13
14 incr yes 1 8/21 19:05 3.0 10.6
/mnt/backups/BackupPC/pc/[hostname]/14
15 incr no 1 8/22 19:10 2.4 9.6
/mnt/backups/BackupPC/pc/[hostname]/15
16 incr no 1 8/23 19:10 2.8 8.6
/mnt/backups/BackupPC/pc/[hostname]/16
17 incr no 1 8/24 19:11 2.8 7.6
/mnt/backups/BackupPC/pc/[hostname]/17
18 incr no 1 8/25 19:24 3.2 6.6
/mnt/backups/BackupPC/pc/[hostname]/18
19 incr no 1 8/26 19:25 2.3 5.5
/mnt/backups/BackupPC/pc/[hostname]/19
20 incr no 1 8/27 19:17 2.4 4.6
/mnt/backups/BackupPC/pc/[hostname]/20
21 incr yes 1 8/28 19:16 2.7 3.6
/mnt/backups/BackupPC/pc/[hostname]/21
22 incr no 1 8/29 19:14 2.4 2.6
/mnt/backups/BackupPC/pc/[hostname]/22
23 incr no 1 8/30 19:12 2.9 1.6
/mnt/backups/BackupPC/pc/[hostname]/23
24 incr yes 1 8/31 19:14 2.9 0.6
/mnt/backups/BackupPC/pc/[hostname]/24
Notice that the most recent backup is always 'filled'.
This system has been in long enough that the original 'full' backup has
been aged out.
$Conf{FullKeepCnt} = [ 4, 3, 0, ]; suggests that a total of 7 filled
backups (excluding the most recent backup) are retained in addition to the
26 unfilled ($Conf{IncrKeepCnt} = 26;) The total schedule, I believe can
get up to about 70 days total.
Backup# Type Filled Level Start Date Duration/mins Age/days
Server Backup Path
42 incr yes 1 7/3 19:05 2.3 59.6
/mnt/backups/BackupPC/pc/[hostname]/42
56 incr yes 1 7/17 19:03 1.4 45.6
/mnt/backups/BackupPC/pc/[hostname]/56
69 incr no 1 7/30 19:07 1.4 32.6
/mnt/backups/BackupPC/pc/[hostname]/69
70 incr yes 1 7/31 19:07 1.6 31.6
/mnt/backups/BackupPC/pc/[hostname]/70
71 incr no 1 8/1 19:09 1.4 30.6
/mnt/backups/BackupPC/pc/[hostname]/71
73 incr no 1 8/3 19:13 0.8 28.6
/mnt/backups/BackupPC/pc/[hostname]/73
74 incr no 1 8/4 19:57 1.4 27.5
/mnt/backups/BackupPC/pc/[hostname]/74
75 incr no 1 8/5 19:18 1.6 26.6
/mnt/backups/BackupPC/pc/[hostname]/75
76 incr no 1 8/6 19:10 1.6 25.6
/mnt/backups/BackupPC/pc/[hostname]/76
77 incr no 1 8/7 19:10 1.2 24.6
/mnt/backups/BackupPC/pc/[hostname]/77
78 incr no 1 8/8 19:10 1.5 23.6
/mnt/backups/BackupPC/pc/[hostname]/78
79 incr yes 1 8/9 19:09 1.4 22.6
/mnt/backups/BackupPC/pc/[hostname]/79
80 incr no 1 8/10 19:11 1.4 21.6
/mnt/backups/BackupPC/pc/[hostname]/80
81 incr no 1 8/11 19:43 3.1 20.5
/mnt/backups/BackupPC/pc/[hostname]/81
82 incr no 1 8/12 19:16 1.5 19.6
/mnt/backups/BackupPC/pc/[hostname]/82
83 incr no 1 8/13 19:10 1.5 18.6
/mnt/backups/BackupPC/pc/[hostname]/83
84 incr no 1 8/14 19:07 1.4 17.6
/mnt/backups/BackupPC/pc/[hostname]/84
85 incr no 1 8/15 19:08 1.5 16.6
/mnt/backups/BackupPC/pc/[hostname]/85
86 incr yes 1 8/16 19:08 1.6 15.6
/mnt/backups/BackupPC/pc/[hostname]/86
87 incr no 1 8/17 19:11 1.4 14.6
/mnt/backups/BackupPC/pc/[hostname]/87
88 incr no 1 8/18 19:17 1.6 13.6
/mnt/backups/BackupPC/pc/[hostname]/88
89 incr no 1 8/19 19:08 1.5 12.6
/mnt/backups/BackupPC/pc/[hostname]/89
90 incr no 1 8/20 19:07 1.6 11.6
/mnt/backups/BackupPC/pc/[hostname]/90
91 incr no 1 8/21 19:06 1.5 10.6
/mnt/backups/BackupPC/pc/[hostname]/91
92 incr no 1 8/22 19:06 1.4 9.6
/mnt/backups/BackupPC/pc/[hostname]/92
93 incr yes 1 8/23 19:06 1.4 8.6
/mnt/backups/BackupPC/pc/[hostname]/93
94 incr no 1 8/24 19:08 1.2 7.6
/mnt/backups/BackupPC/pc/[hostname]/94
95 incr no 1 8/25 19:16 1.6 6.6
/mnt/backups/BackupPC/pc/[hostname]/95
96 incr no 1 8/26 19:12 1.1 5.6
/mnt/backups/BackupPC/pc/[hostname]/96
97 incr no 1 8/27 19:09 1.4 4.6
/mnt/backups/BackupPC/pc/[hostname]/97
98 incr no 1 8/28 19:07 1.4 3.6
/mnt/backups/BackupPC/pc/[hostname]/98
99 incr no 1 8/29 19:05 1.4 2.6
/mnt/backups/BackupPC/pc/[hostname]/99
100 incr yes 1 8/30 19:04 1.4 1.6
/mnt/backups/BackupPC/pc/[hostname]/100
101 incr yes 1 8/31 19:08 1.2 0.6
/mnt/backups/BackupPC/pc/[hostname]/101
In this final example, the parameter "$Conf{FullPeriod} = 90.9;" has
triggered a new "full" to be taken after 90 days. Though this could as
easily been 180, or even 365 days, depending on your comfort level.
(Honestly, I believe that the schedule I have actually triggers the full a
little more frequently because I don't retain enough 'filled' backups to
reach 90 days, but you get the idea).
Note that the 'full' didn't actually take very long to run (7.5 minutes)
compared to the first example (backup #0 = 20 minutes) demonstrating that
while checksumming took some extra time, it took less time than
transferring all the files.
Backup# Type Filled Level Start Date Duration/mins Age/days
Server Backup Path
47 incr yes 1 6/29 19:23 1.6 63.6
/mnt/backups/BackupPC/pc/[hostname]/47
61 incr yes 1 7/13 19:14 1.6 49.6
/mnt/backups/BackupPC/pc/[hostname]/61
75 incr yes 1 7/27 19:28 3.1 35.6
/mnt/backups/BackupPC/pc/[hostname]/75
79 incr no 1 7/31 20:07 2.0 31.5
/mnt/backups/BackupPC/pc/[hostname]/79
80 incr no 1 8/1 20:06 2.5 30.5
/mnt/backups/BackupPC/pc/[hostname]/80
81 incr no 1 8/2 20:06 3.2 29.5
/mnt/backups/BackupPC/pc/[hostname]/81
82 incr no 1 8/3 20:09 2.6 28.5
/mnt/backups/BackupPC/pc/[hostname]/82
83 incr no 1 8/4 20:38 2.8 27.5
/mnt/backups/BackupPC/pc/[hostname]/83
84 incr yes 1 8/5 20:09 2.7 26.5
/mnt/backups/BackupPC/pc/[hostname]/84
85 incr no 1 8/6 20:10 1.7 25.5
/mnt/backups/BackupPC/pc/[hostname]/85
86 incr no 1 8/7 20:10 2.0 24.5
/mnt/backups/BackupPC/pc/[hostname]/86
87 incr no 1 8/8 20:07 3.5 23.5
/mnt/backups/BackupPC/pc/[hostname]/87
88 incr no 1 8/9 20:06 3.1 22.5
/mnt/backups/BackupPC/pc/[hostname]/88
89 incr no 1 8/10 20:09 2.8 21.5
/mnt/backups/BackupPC/pc/[hostname]/89
90 incr no 1 8/11 20:37 2.6 20.5
/mnt/backups/BackupPC/pc/[hostname]/90
91 incr yes 1 8/12 20:07 2.9 19.5
/mnt/backups/BackupPC/pc/[hostname]/91
92 incr no 1 8/13 20:12 1.5 18.5
/mnt/backups/BackupPC/pc/[hostname]/92
93 incr no 1 8/14 20:06 2.6 17.5
/mnt/backups/BackupPC/pc/[hostname]/93
94 incr no 1 8/15 20:05 3.0 16.5
/mnt/backups/BackupPC/pc/[hostname]/94
95 incr no 1 8/16 20:05 3.2 15.5
/mnt/backups/BackupPC/pc/[hostname]/95
96 incr no 1 8/17 19:26 2.9 14.6
/mnt/backups/BackupPC/pc/[hostname]/96
97 incr no 1 8/18 19:38 2.5 13.5
/mnt/backups/BackupPC/pc/[hostname]/97
98 incr yes 1 8/19 19:22 2.5 12.6
/mnt/backups/BackupPC/pc/[hostname]/98
99 incr no 1 8/20 19:19 2.0 11.6
/mnt/backups/BackupPC/pc/[hostname]/99
100 incr no 1 8/21 19:19 1.8 10.6
/mnt/backups/BackupPC/pc/[hostname]/100
101 incr no 1 8/22 19:19 2.9 9.6
/mnt/backups/BackupPC/pc/[hostname]/101
102 incr no 1 8/23 19:19 2.7 8.6
/mnt/backups/BackupPC/pc/[hostname]/102
103 incr no 1 8/24 19:20 2.5 7.6
/mnt/backups/BackupPC/pc/[hostname]/103
104 incr no 1 8/25 19:44 2.6 6.5
/mnt/backups/BackupPC/pc/[hostname]/104
105 incr yes 1 8/26 19:40 1.8 5.5
/mnt/backups/BackupPC/pc/[hostname]/105
106 incr no 1 8/27 19:30 1.4 4.6
/mnt/backups/BackupPC/pc/[hostname]/106
107 full yes 0 8/28 19:27 7.5 3.6
/mnt/backups/BackupPC/pc/[hostname]/107
108 incr no 1 8/29 19:23 2.2 2.6
/mnt/backups/BackupPC/pc/[hostname]/108
109 incr no 1 8/30 19:20 2.5 1.6
/mnt/backups/BackupPC/pc/[hostname]/109
110 incr yes 1 8/31 19:23 2.4 0.6
/mnt/backups/BackupPC/pc/[hostname]/110
--
Ray Frush
Time flies like an arrow, but fruit flies like a banana.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
