Re: [BackupPC-users] rsyncd excludes problem (3.2.1)
On 2016-04-13 03:29, Benjamin Redling wrote: > Sadly coming back for the same reason: > > On 03/29/2016 19:57, Michael Stowe wrote: >> On 2016-03-29 10:17, Benjamin Redling wrote: >>> my exclude list seems to be defunct [...] XferMethod is rsyncd, >>> shouldn't '*/tmp' avoid this? > >> No, > [...] >> If you want to exclude anything in a subdirectory named tmp, then >> 'tmp/' >> should do the trick. > > No variant works in my case -- tmp/, tmp/***, */tmp/*, home => > /tmp/ > > If anybody is using the same package successfully I would be happy to > not annoy the package maintainer and keep trying to understand what I > am > doing wrong. Start with the basics: xferlog. You'll want to review your excludes in two ways. First, you'll want to confirm that they show up here: Sent exclude: Users/*/AppData/Local/Temp/* If you don't see that, or it's munged, the problem isn't the syntax or format of your exclusions, so much as your config file isn't expressing exclusions to rsync. Once you do that, you should see (or perhaps fail to see) lower in the file, lines that correspond to the regular expression: create d 770544/18 0 Users/Administrator.Luffy/AppData/Local/Temp As you see from the above, this is NOT a match for the regex, but any files IN the directory would be. This happens to be what we want, since on a recovery of the user, we probably want to recover the directory but we don't care about temp files. We confirm below that no files within the directory are backed up. If we selected a more restrictive exclude, such as ending at "Temp", we wouldn't expect this line to appear at all. -- Find and fix application performance issues faster with Applications Manager Applications Manager provides deep performance insights into multiple tiers of your business applications. It resolves application problems quickly and reduces your MTTR. Get your free trial! https://ad.doubleclick.net/ddm/clk/302982198;130105516;z ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd excludes problem (3.2.1)
Sadly coming back for the same reason: On 03/29/2016 19:57, Michael Stowe wrote: > On 2016-03-29 10:17, Benjamin Redling wrote: >> my exclude list seems to be defunct [...] XferMethod is rsyncd, >> shouldn't '*/tmp' avoid this? > No, [...] > If you want to exclude anything in a subdirectory named tmp, then 'tmp/' > should do the trick. No variant works in my case -- tmp/, tmp/***, */tmp/*, home => /tmp/ If anybody is using the same package successfully I would be happy to not annoy the package maintainer and keep trying to understand what I am doing wrong. >> Did a restart of backuppc after every change. > > That's unnecessary. I avoided that at first. But when all variants (tmp/, */tmp/* tmp/***) failed I made sure no process was running an restarted backuppc. Benjamin -- FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html vox: +49 3641 9 44323 | fax: +49 3641 9 44321 -- Find and fix application performance issues faster with Applications Manager Applications Manager provides deep performance insights into multiple tiers of your business applications. It resolves application problems quickly and reduces your MTTR. Get your free trial! https://ad.doubleclick.net/ddm/clk/302982198;130105516;z ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd excludes problem (3.2.1)
On 2016-03-29 19:57, Michael Stowe wrote: > On 2016-03-29 10:17, Benjamin Redling wrote: >> [...] /tmp subdirectories and absolute >> paths (/anonuser... see below) are filling up the discs. >> XferMethod is rsyncd, shouldn't '*/tmp' avoid this? > No, '*/tmp' will avoid backing up any files named "tmp" or any empty > subdirectories named "tmp" as long as they are NOT in the root of the > share -- but it will not exclude any files IN directories named "tmp", > which, from your description, is probably what you want. Ok, I reread the section "INCLUDE/EXCLUDE PATTERN RULES" of the rsync man page in hope to grasp the patterns. There it says: " a trailing "dir_name/***" will match both the directory (as if "dir_name/" had been specified) and everything in the directory (as if "dir_name/**" had been specified). This behavior was added in version 2.6.7. " So, to my understanding tmp/*** (and all the other dirs accordingly) should be the correct pattern. [...] > Also note that exclude paths are relative, so if you want to match /tmp > in the root of the share, the proper exclude to use is simply 'tmp'. [...] > If you want to exclude anything in a subdirectory named tmp, then 'tmp/' > should do the trick. I need the later case, tmp in the home dirs. Thanks for pointing to the importance of the trailing slash! Maybe I changed more that I am willing to admit to myself and even worse: this wasn't part of config. management /version control -- really bad. Regards, Benjamin -- FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html vox: +49 3641 9 44323 | fax: +49 3641 9 44321 -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd excludes problem (3.2.1)
On 2016-03-29 10:17, Benjamin Redling wrote: > Hello everybody, > > my exclude list seems to be defunct since adding a few absolute paths > via the web interface. Recently(?) /tmp subdirectories and absolute > paths (/anonuser... see below) are filling up the discs. > XferMethod is rsyncd, shouldn't '*/tmp' avoid this? No, '*/tmp' will avoid backing up any files named "tmp" or any empty subdirectories named "tmp" as long as they are NOT in the root of the share -- but it will not exclude any files IN directories named "tmp", which, from your description, is probably what you want. It may help to imagine that rsync makes a list of files and directories relative to the share, and then applies your excludes to it to eliminate things from that list. As you might guess, */tmp doesn't match a lot of things on that list such as tmp/filename. Also note that exclude paths are relative, so if you want to match /tmp in the root of the share, the proper exclude to use is simply 'tmp'. If you want to exclude anything in a subdirectory named tmp, then 'tmp/' should do the trick. > Did a restart of backuppc after every change. That's unnecessary. >> From the config.pl: > > $Conf{BackupFilesExclude} = { > '*' => [ > '*/tmp', > '*/.cache', > '*/temp', > '*/Cache', > '*/cache', > '/anonuser1/usenet-de/per-group', > '/anonuser2/sub-dir1/sub-dir2/models', > '/anonuser3/downloads', > '*/privat*', > '*/ImapMail', > '*.iso', > '*.ISO', > '*/.macromedia', > '*/.local/share/Trash', > '*.ogg', > '*.OGG', > '*.mp3', > '*.MP3', > '*.mp4', > '*.MP4' > ] > }; > > I've also tried putting the new paths to an explicitly defined share: > $Conf{BackupFilesExclude} = { > '*' => [ > '*/tmp', > '*/.cache', > '*/temp', > '*/Cache', > '*/cache' > ], > 'home' => [ > '/anonuser1/usenet-de/per-group', > '/anonuser2/sub-dir1/sub-dir2/models', > '/anonuser3/downloads', > '*/privat*', > '*/ImapMail', > '*.iso', > '*.ISO', > '*/.macromedia', > '*/.local/share/Trash', > '*.ogg', > '*.OGG', > '*.mp3', > '*.MP3', > '*.mp4', > '*.MP4' > ] > }; > > BackupPC 3.2.1-2ubuntu1.1 on Ubuntu 12.04 LTS, x86_64 > > What am I doing wrong? (see above) I assume the extension exclusions are more-or-less working as you expect them to. You may want to review the Xferlog. > Regards, > Benjamin -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd excludes problem (3.2.1)
Hello everybody, my exclude list seems to be defunct since adding a few absolute paths via the web interface. Recently(?) /tmp subdirectories and absolute paths (/anonuser... see below) are filling up the discs. XferMethod is rsyncd, shouldn't '*/tmp' avoid this? Did a restart of backuppc after every change. >From the config.pl: $Conf{BackupFilesExclude} = { '*' => [ '*/tmp', '*/.cache', '*/temp', '*/Cache', '*/cache', '/anonuser1/usenet-de/per-group', '/anonuser2/sub-dir1/sub-dir2/models', '/anonuser3/downloads', '*/privat*', '*/ImapMail', '*.iso', '*.ISO', '*/.macromedia', '*/.local/share/Trash', '*.ogg', '*.OGG', '*.mp3', '*.MP3', '*.mp4', '*.MP4' ] }; I've also tried putting the new paths to an explicitly defined share: $Conf{BackupFilesExclude} = { '*' => [ '*/tmp', '*/.cache', '*/temp', '*/Cache', '*/cache' ], 'home' => [ '/anonuser1/usenet-de/per-group', '/anonuser2/sub-dir1/sub-dir2/models', '/anonuser3/downloads', '*/privat*', '*/ImapMail', '*.iso', '*.ISO', '*/.macromedia', '*/.local/share/Trash', '*.ogg', '*.OGG', '*.mp3', '*.MP3', '*.mp4', '*.MP4' ] }; BackupPC 3.2.1-2ubuntu1.1 on Ubuntu 12.04 LTS, x86_64 What am I doing wrong? Regards, Benjamin -- FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html vox: +49 3641 9 44323 | fax: +49 3641 9 44321 -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/