Re: [BackupPC-users] rsyncd excludes problem (3.2.1)

2016-04-13 Thread Michael Stowe
On 2016-04-13 03:29, Benjamin Redling wrote:
> Sadly coming back for the same reason:
> 
> On 03/29/2016 19:57, Michael Stowe wrote:
>> On 2016-03-29 10:17, Benjamin Redling wrote:
>>> my exclude list seems to be defunct [...] XferMethod is rsyncd,
>>> shouldn't '*/tmp' avoid this?
> 
>> No,
> [...]
>> If you want to exclude anything in a subdirectory named tmp, then 
>> 'tmp/'
>> should do the trick.
> 
> No variant works in my case -- tmp/, tmp/***, */tmp/*, home =>
> /tmp/
> 
> If anybody is using the same package successfully I would be happy to
> not annoy the package maintainer and keep trying to understand what I 
> am
> doing wrong.

Start with the basics:  xferlog.  You'll want to review your excludes in 
two ways.  First, you'll want to confirm that they show up here:


Sent exclude: Users/*/AppData/Local/Temp/*


If you don't see that, or it's munged, the problem isn't the syntax or 
format of your exclusions, so much as your config file isn't expressing 
exclusions to rsync.  Once you do that, you should see (or perhaps fail 
to see) lower in the file, lines that correspond to the regular 
expression:


create d 770544/18   0 
Users/Administrator.Luffy/AppData/Local/Temp


As you see from the above, this is NOT a match for the regex, but any 
files IN the directory would be.  This happens to be what we want, since 
on a recovery of the user, we probably want to recover the directory but 
we don't care about temp files.  We confirm below that no files within 
the directory are backed up.

If we selected a more restrictive exclude, such as ending at "Temp", we 
wouldn't expect this line to appear at all.


--
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] rsyncd excludes problem (3.2.1)

2016-04-13 Thread Benjamin Redling
Sadly coming back for the same reason:

On 03/29/2016 19:57, Michael Stowe wrote:
> On 2016-03-29 10:17, Benjamin Redling wrote:
>> my exclude list seems to be defunct [...] XferMethod is rsyncd, 
>> shouldn't '*/tmp' avoid this?

> No,
[...]
> If you want to exclude anything in a subdirectory named tmp, then 'tmp/'
> should do the trick.

No variant works in my case -- tmp/, tmp/***, */tmp/*, home =>
/tmp/

If anybody is using the same package successfully I would be happy to
not annoy the package maintainer and keep trying to understand what I am
doing wrong.

>> Did a restart of backuppc after every change.
> 
> That's unnecessary.

I avoided that at first. But when all variants (tmp/, */tmp/* tmp/***)
failed I made sure no process was running an restarted backuppc.

Benjamin
-- 
FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html
vox: +49 3641 9 44323 | fax: +49 3641 9 44321

--
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] rsyncd excludes problem (3.2.1)

2016-03-30 Thread Benjamin Redling
On 2016-03-29 19:57, Michael Stowe wrote:
> On 2016-03-29 10:17, Benjamin Redling wrote:
>> [...] /tmp subdirectories and absolute
>> paths (/anonuser... see below) are filling up the discs.
>> XferMethod is rsyncd, shouldn't '*/tmp' avoid this?

> No, '*/tmp' will avoid backing up any files named "tmp" or any empty
> subdirectories named "tmp" as long as they are NOT in the root of the
> share -- but it will not exclude any files IN directories named "tmp",
> which, from your description, is probably what you want.

Ok, I reread the section "INCLUDE/EXCLUDE PATTERN RULES" of the rsync
man page in hope to grasp the patterns.

There it says:
"
a  trailing "dir_name/***" will match both the directory (as if
"dir_name/" had been specified) and everything in the directory (as
if  "dir_name/**"  had been specified). This behavior was added in
version 2.6.7.
"

So, to my understanding tmp/*** (and all the other dirs accordingly)
should be the correct pattern.

[...]
> Also note that exclude paths are relative, so if you want to match /tmp
> in the root of the share, the proper exclude to use is simply 'tmp'.
[...]
> If you want to exclude anything in a subdirectory named tmp, then 'tmp/'
> should do the trick.

I need the later case, tmp in the home dirs.
Thanks for pointing to the importance of the trailing slash!
Maybe I changed more that I am willing to admit to myself and even
worse: this wasn't part of config. management /version control
-- really bad.

Regards,
Benjamin
-- 
FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html
vox: +49 3641 9 44323 | fax: +49 3641 9 44321

--
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] rsyncd excludes problem (3.2.1)

2016-03-29 Thread Michael Stowe
On 2016-03-29 10:17, Benjamin Redling wrote:
> Hello everybody,
> 
> my exclude list seems to be defunct since adding a few absolute paths
> via the web interface. Recently(?) /tmp subdirectories and absolute
> paths (/anonuser... see below) are filling up the discs.
> XferMethod is rsyncd, shouldn't '*/tmp' avoid this?

No, '*/tmp' will avoid backing up any files named "tmp" or any empty 
subdirectories named "tmp" as long as they are NOT in the root of the 
share -- but it will not exclude any files IN directories named "tmp", 
which, from your description, is probably what you want.

It may help to imagine that rsync makes a list of files and directories 
relative to the share, and then applies your excludes to it to eliminate 
things from that list.  As you might guess, */tmp doesn't match a lot of 
things on that list such as tmp/filename.

Also note that exclude paths are relative, so if you want to match /tmp 
in the root of the share, the proper exclude to use is simply 'tmp'.

If you want to exclude anything in a subdirectory named tmp, then 'tmp/' 
should do the trick.

> Did a restart of backuppc after every change.

That's unnecessary.

>> From the config.pl:
> 
> $Conf{BackupFilesExclude} = {
>   '*' => [
> '*/tmp',
> '*/.cache',
> '*/temp',
> '*/Cache',
> '*/cache',
> '/anonuser1/usenet-de/per-group',
> '/anonuser2/sub-dir1/sub-dir2/models',
> '/anonuser3/downloads',
> '*/privat*',
> '*/ImapMail',
> '*.iso',
> '*.ISO',
> '*/.macromedia',
> '*/.local/share/Trash',
> '*.ogg',
> '*.OGG',
> '*.mp3',
> '*.MP3',
> '*.mp4',
> '*.MP4'
>   ]
> };
> 
> I've also tried putting the new paths to an explicitly defined share:
> $Conf{BackupFilesExclude} = {
>   '*' => [
> '*/tmp',
> '*/.cache',
> '*/temp',
> '*/Cache',
> '*/cache'
>   ],
>   'home' => [
> '/anonuser1/usenet-de/per-group',
> '/anonuser2/sub-dir1/sub-dir2/models',
> '/anonuser3/downloads',
> '*/privat*',
> '*/ImapMail',
> '*.iso',
> '*.ISO',
> '*/.macromedia',
> '*/.local/share/Trash',
> '*.ogg',
> '*.OGG',
> '*.mp3',
> '*.MP3',
> '*.mp4',
> '*.MP4'
>   ]
> };
> 
> BackupPC 3.2.1-2ubuntu1.1 on Ubuntu 12.04 LTS, x86_64
> 
> What am I doing wrong?

(see above)  I assume the extension exclusions are more-or-less working 
as you expect them to.  You may want to review the Xferlog.

> Regards,
> Benjamin

--
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] rsyncd excludes problem (3.2.1)

2016-03-29 Thread Benjamin Redling
Hello everybody,

my exclude list seems to be defunct since adding a few absolute paths
via the web interface. Recently(?) /tmp subdirectories and absolute
paths (/anonuser... see below) are filling up the discs.
XferMethod is rsyncd, shouldn't '*/tmp' avoid this?
Did a restart of backuppc after every change.

>From the config.pl:

$Conf{BackupFilesExclude} = {
  '*' => [
'*/tmp',
'*/.cache',
'*/temp',
'*/Cache',
'*/cache',
'/anonuser1/usenet-de/per-group',
'/anonuser2/sub-dir1/sub-dir2/models',
'/anonuser3/downloads',
'*/privat*',
'*/ImapMail',
'*.iso',
'*.ISO',
'*/.macromedia',
'*/.local/share/Trash',
'*.ogg',
'*.OGG',
'*.mp3',
'*.MP3',
'*.mp4',
'*.MP4'
  ]
};

I've also tried putting the new paths to an explicitly defined share:
$Conf{BackupFilesExclude} = {
  '*' => [
'*/tmp',
'*/.cache',
'*/temp',
'*/Cache',
'*/cache'
  ],
  'home' => [
'/anonuser1/usenet-de/per-group',
'/anonuser2/sub-dir1/sub-dir2/models',
'/anonuser3/downloads',
'*/privat*',
'*/ImapMail',
'*.iso',
'*.ISO',
'*/.macromedia',
'*/.local/share/Trash',
'*.ogg',
'*.OGG',
'*.mp3',
'*.MP3',
'*.mp4',
'*.MP4'
  ]
};

BackupPC 3.2.1-2ubuntu1.1 on Ubuntu 12.04 LTS, x86_64

What am I doing wrong?

Regards,
Benjamin
-- 
FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html
vox: +49 3641 9 44323 | fax: +49 3641 9 44321

--
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/