Re: [BackupPC-users] rsyncd method does not work: (unexpected response: '')
On Sun, 10 Sep 2017 23:37:52 +0300 Anton Torkunovwrote: > Hi all! Hi you!! > I forgot to say that I have 3.3.0 version installed from Ubuntu 14.x > repositories. Hmm, memory lapses are precursors to the Alzheimer disease… > Thanks for suggestions: I asked Robert Duval tomb and his say that i > need to install last version of BackupPC from GitHub. I did it and now > everything is fine! Glad to read that! You should be careful about ubuntu because they package non-stable versions of many softwares, leading to "some (direct) problems" and also sometimes bad interactions. For servers stability sake, you'd prefer using the original: Debian. > Jean-Yves, just for clarify - orange.vpn - it just name inside my > private VPN ;) Who knows what' in orange people's heads… JY -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd method does not work: (unexpected response: '')
Hi all! I forgot to say that I have 3.3.0 version installed from Ubuntu 14.x repositories. Thanks for suggestions: I asked Robert Duval tomb and his say that i need to install last version of BackupPC from GitHub. I did it and now everything is fine! Jean-Yves, just for clarify - orange.vpn - it just name inside my private VPN ;) On Thu, Sep 7, 2017 at 11:24 PM, Bwrote: > On Wed, 6 Sep 2017 17:18:40 +0300 > Anton Torkunov wrote: > > > Hello everyone! > > Hi alone!! > > > I've tried to backup host via rsyncd, but got error: Backup aborted > > (unexpected response: '') > > > > rsyncd is well configured, because If I try to run just rsync, > > everything is fine: > > > > rsync rsync://orange.vpn/root/ > > I suspect some very bad black magic here. > > As you know, or should know, 'orange' is the name of a telecom > monopolistic company formerly called 'france telecom' in france, as such, > these people are very angry and resentful because they lost their > privileges when this company was privatized. > So, in order to get back their former position and revenge, they swear to > indefinitely devote themselves to the mighty god "unanswered > call" and goddess "twisted pair copper" (very filthy this one). > > So, as my BPC crystal balls say, there is a very high possibility they > took offense of your machine name, stole you the digital equivalent of a > beard hair or hair strand in the form of a byte from your browser and > stuffed it in a tux puppet representing your computer. > To achieve their miserable goal, they hired a very cruel and powerful > Russo-Chinese warlock, who's in fact half Béninois (from Bénin) by the > cousin of the half-sister's of his grand-aunt's cleaning lady. > As you know, or should know, Bénin was formerly called Dahomet and is > considered to be the mother country of voodoo. > So, each time you try to BPC you're machine, he plunges little darts in > his tux puppet and mutter a devilish incantation to make your live > miserable. > > So, your only solution is to jump in a plane going to Haïti and once > there, ask for Robert Duval tomb, but you can only ask a 34 years old > virgin ginger girl born on February 29th, and you must do this at > exactly midnight a night of full moon. > Once you'll know where it is, you'll have to wait for the next red moon > and be standing in front of the grave at 11:47:29PM precisely, then > you'll have to sing the salve regina three times in a row not missing a > music note, a word and sing them in the right tune - DO NOT accelerate > the tempo, it would amplify the problem, making it almost impossible to > solve. Then you'll kneel and wait for Robert Duval to raise from the dead > (NB: this might take some time, depending on his mood, YMMV.) > > When he'll be out, you will ask him how to get rid of this curse, but > the most important is to NOT forget to offer him a little goat (less > than 1 year old but more than 11 months and 25 days) named Patricia > that you brought with you, because not doing so would nullify your > quest. > > Once you'll get your answer, you'll only have 2 hours to go back home > and ward the curse off, otherwise you'll have to do it all over again > from the beginning. Your chances of success can be evaluated to ~8%; > there is another way to achieve that, but it is so terrible that nobody > wants to talk about it. > > > 64 bytes from orange (192.168.220.27): icmp_seq=1 ttl=64 time=8.25 ms > > --- orange.vpn ping statistics --- > > 1 packets transmitted, 1 received, 0% packet loss, time 0ms > > rtt min/avg/max/mdev = 8.259/8.259/8.259/0.000 ms > > I guess this terrible timing is due to the VPN liaison > > > At the client side (rsyncd): > > Hmm, did you try with the rsync method instead of the rsyncd one? > I remember, long time ago, I had some problems with rsyncd and BPC > in the same LAN - may be it was my fault, may be not, my notes juste say > not to use rsyncd. > > > Could you help me to fix the issue??? > > Nope, it is in Robert Duval's hands from now. > > > Anton > > Jean-Yves > > > -- > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -- ~~~ Anton Torkunov -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:
Re: [BackupPC-users] rsyncd method does not work: (unexpected response: '')
On Wed, 6 Sep 2017 17:18:40 +0300 Anton Torkunovwrote: > Hello everyone! Hi alone!! > I've tried to backup host via rsyncd, but got error: Backup aborted > (unexpected response: '') > > rsyncd is well configured, because If I try to run just rsync, > everything is fine: > > rsync rsync://orange.vpn/root/ I suspect some very bad black magic here. As you know, or should know, 'orange' is the name of a telecom monopolistic company formerly called 'france telecom' in france, as such, these people are very angry and resentful because they lost their privileges when this company was privatized. So, in order to get back their former position and revenge, they swear to indefinitely devote themselves to the mighty god "unanswered call" and goddess "twisted pair copper" (very filthy this one). So, as my BPC crystal balls say, there is a very high possibility they took offense of your machine name, stole you the digital equivalent of a beard hair or hair strand in the form of a byte from your browser and stuffed it in a tux puppet representing your computer. To achieve their miserable goal, they hired a very cruel and powerful Russo-Chinese warlock, who's in fact half Béninois (from Bénin) by the cousin of the half-sister's of his grand-aunt's cleaning lady. As you know, or should know, Bénin was formerly called Dahomet and is considered to be the mother country of voodoo. So, each time you try to BPC you're machine, he plunges little darts in his tux puppet and mutter a devilish incantation to make your live miserable. So, your only solution is to jump in a plane going to Haïti and once there, ask for Robert Duval tomb, but you can only ask a 34 years old virgin ginger girl born on February 29th, and you must do this at exactly midnight a night of full moon. Once you'll know where it is, you'll have to wait for the next red moon and be standing in front of the grave at 11:47:29PM precisely, then you'll have to sing the salve regina three times in a row not missing a music note, a word and sing them in the right tune - DO NOT accelerate the tempo, it would amplify the problem, making it almost impossible to solve. Then you'll kneel and wait for Robert Duval to raise from the dead (NB: this might take some time, depending on his mood, YMMV.) When he'll be out, you will ask him how to get rid of this curse, but the most important is to NOT forget to offer him a little goat (less than 1 year old but more than 11 months and 25 days) named Patricia that you brought with you, because not doing so would nullify your quest. Once you'll get your answer, you'll only have 2 hours to go back home and ward the curse off, otherwise you'll have to do it all over again from the beginning. Your chances of success can be evaluated to ~8%; there is another way to achieve that, but it is so terrible that nobody wants to talk about it. > 64 bytes from orange (192.168.220.27): icmp_seq=1 ttl=64 time=8.25 ms > --- orange.vpn ping statistics --- > 1 packets transmitted, 1 received, 0% packet loss, time 0ms > rtt min/avg/max/mdev = 8.259/8.259/8.259/0.000 ms I guess this terrible timing is due to the VPN liaison > At the client side (rsyncd): Hmm, did you try with the rsync method instead of the rsyncd one? I remember, long time ago, I had some problems with rsyncd and BPC in the same LAN - may be it was my fault, may be not, my notes juste say not to use rsyncd. > Could you help me to fix the issue??? Nope, it is in Robert Duval's hands from now. > Anton Jean-Yves -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd method does not work: (unexpected response: '')
On 2017-09-06 07:18, Anton Torkunov wrote: Hello everyone! I've tried to backup host via rsyncd, but got error: Backup aborted (unexpected response: '') rsyncd is well configured, because If I try to run just rsync, everything is fine: rsync rsync://orange.vpn/root/ ... the listing files is here ... It's a good troubleshooting step. Was this run from the same host? What does your rsyncd.conf look like? Next, I've tried to run BackupPC_dump: su backuppc -c "/usr/share/backuppc/bin/BackupPC_dump -v -f orange.vpn" cmdSystemOrEval: about to system /bin/ping -c 1 orange.vpn cmdSystemOrEval: finished: got output PING orange.vpn (192.168.220.27) 56(84) bytes of data. 64 bytes from orange (192.168.220.27): icmp_seq=1 ttl=64 time=8.25 ms --- orange.vpn ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 8.259/8.259/8.259/0.000 ms ... CheckHostAlive: returning 9.026 full backup started for directory root started full dump, share=root Connected to orange.vpn:873, remote version 31 Negotiated protocol version 28 Error connecting to module root at orange.vpn:873: unexpected response: '' Got fatal error during xfer (unexpected response: '') cmdSystemOrEval: about to system /bin/ping -c 1 orange.vpn cmdSystemOrEval: finished: got output PING orange.vpn (192.168.220.27) 56(84) bytes of data. 64 bytes from orange (192.168.220.27): icmp_seq=1 ttl=64 time=7.38 ms ... CheckHostAlive: returning 11.452 Backup aborted (unexpected response: '') Not saving this as a partial backup since it has fewer files than the prior one (got 0 and 0 files versus 0) dump failed: unexpected response: '' == At the client side (rsyncd): 2017/09/06 17:10:52 [4780] name lookup failed for 192.168.220.23 [1]: Name or service not known 2017/09/06 17:10:52 [4780] connect from UNKNOWN (192.168.220.23) 2017/09/06 17:10:52 [4780] rsync on root/ from UNKNOWN (192.168.220.23) 2017/09/06 17:10:52 [4780] building file list 2017/09/06 17:10:52 [4780] sent 459 bytes received 29 bytes total size 0 2017/09/06 17:12:59 [5305] name lookup failed for 192.168.220.23 [1]: Name or service not known 2017/09/06 17:12:59 [5305] connect from UNKNOWN (192.168.220.23) 2017/09/06 17:13:04 [5305] rsync: safe_read failed to read 1 bytes [Receiver]: Connection reset by peer (104) 2017/09/06 17:13:04 [5305] rsync error: error in rsync protocol data stream (code 12) at io.c(276) [Receiver=3.1.1] === Could you help me to fix the issue??? It may be instructive to examine the client side log from your successful session to see what's different. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd method does not work: (unexpected response: '')
Hello everyone! I've tried to backup host via rsyncd, but got error: Backup aborted (unexpected response: '') rsyncd is well configured, because If I try to run just rsync, everything is fine: rsync rsync://orange.vpn/root/ ... the listing files is here ... Next, I've tried to run BackupPC_dump: su backuppc -c "/usr/share/backuppc/bin/BackupPC_dump -v -f orange.vpn" cmdSystemOrEval: about to system /bin/ping -c 1 orange.vpn cmdSystemOrEval: finished: got output PING orange.vpn (192.168.220.27) 56(84) bytes of data. 64 bytes from orange (192.168.220.27): icmp_seq=1 ttl=64 time=8.25 ms --- orange.vpn ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 8.259/8.259/8.259/0.000 ms ... CheckHostAlive: returning 9.026 full backup started for directory root started full dump, share=root Connected to orange.vpn:873, remote version 31 Negotiated protocol version 28 Error connecting to module root at orange.vpn:873: unexpected response: '' Got fatal error during xfer (unexpected response: '') cmdSystemOrEval: about to system /bin/ping -c 1 orange.vpn cmdSystemOrEval: finished: got output PING orange.vpn (192.168.220.27) 56(84) bytes of data. 64 bytes from orange (192.168.220.27): icmp_seq=1 ttl=64 time=7.38 ms ... CheckHostAlive: returning 11.452 Backup aborted (unexpected response: '') Not saving this as a partial backup since it has fewer files than the prior one (got 0 and 0 files versus 0) dump failed: unexpected response: '' == At the client side (rsyncd): 2017/09/06 17:10:52 [4780] name lookup failed for 192.168.220.23: Name or service not known 2017/09/06 17:10:52 [4780] connect from UNKNOWN (192.168.220.23) 2017/09/06 17:10:52 [4780] rsync on root/ from UNKNOWN (192.168.220.23) 2017/09/06 17:10:52 [4780] building file list 2017/09/06 17:10:52 [4780] sent 459 bytes received 29 bytes total size 0 2017/09/06 17:12:59 [5305] name lookup failed for 192.168.220.23: Name or service not known 2017/09/06 17:12:59 [5305] connect from UNKNOWN (192.168.220.23) 2017/09/06 17:13:04 [5305] rsync: safe_read failed to read 1 bytes [Receiver]: Connection reset by peer (104) 2017/09/06 17:13:04 [5305] rsync error: error in rsync protocol data stream (code 12) at io.c(276) [Receiver=3.1.1] === Could you help me to fix the issue??? -- Anton -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd and selinux
I just fought through dealing with errors in my backup due to attempting to back up sockets and wanted to share my solution. Here's an example of the error message: rsync: readlink_stat("/var/spool/postfix/private/tlsmgr" (in root)) failed: Permission denied (13) (Postfix creates a directory full of sockets for all its processes, so I got quite a few errors in that directory.) On CentOS 7 I found I needed this: setsebool -P rsync_full_access 1 You may also need: setsebool -P rsync_export_all_ro 1 I'd prefer to just enable read-only access but that doesn't allow the readlink_stat needed to back up a socket. (I don't see a man page for that. Is that API part of BackupPC or rsync?) --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd excludes problem (3.2.1)
On 2016-04-13 03:29, Benjamin Redling wrote: > Sadly coming back for the same reason: > > On 03/29/2016 19:57, Michael Stowe wrote: >> On 2016-03-29 10:17, Benjamin Redling wrote: >>> my exclude list seems to be defunct [...] XferMethod is rsyncd, >>> shouldn't '*/tmp' avoid this? > >> No, > [...] >> If you want to exclude anything in a subdirectory named tmp, then >> 'tmp/' >> should do the trick. > > No variant works in my case -- tmp/, tmp/***, */tmp/*, home => > /tmp/ > > If anybody is using the same package successfully I would be happy to > not annoy the package maintainer and keep trying to understand what I > am > doing wrong. Start with the basics: xferlog. You'll want to review your excludes in two ways. First, you'll want to confirm that they show up here: Sent exclude: Users/*/AppData/Local/Temp/* If you don't see that, or it's munged, the problem isn't the syntax or format of your exclusions, so much as your config file isn't expressing exclusions to rsync. Once you do that, you should see (or perhaps fail to see) lower in the file, lines that correspond to the regular expression: create d 770544/18 0 Users/Administrator.Luffy/AppData/Local/Temp As you see from the above, this is NOT a match for the regex, but any files IN the directory would be. This happens to be what we want, since on a recovery of the user, we probably want to recover the directory but we don't care about temp files. We confirm below that no files within the directory are backed up. If we selected a more restrictive exclude, such as ending at "Temp", we wouldn't expect this line to appear at all. -- Find and fix application performance issues faster with Applications Manager Applications Manager provides deep performance insights into multiple tiers of your business applications. It resolves application problems quickly and reduces your MTTR. Get your free trial! https://ad.doubleclick.net/ddm/clk/302982198;130105516;z ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd excludes problem (3.2.1)
Sadly coming back for the same reason: On 03/29/2016 19:57, Michael Stowe wrote: > On 2016-03-29 10:17, Benjamin Redling wrote: >> my exclude list seems to be defunct [...] XferMethod is rsyncd, >> shouldn't '*/tmp' avoid this? > No, [...] > If you want to exclude anything in a subdirectory named tmp, then 'tmp/' > should do the trick. No variant works in my case -- tmp/, tmp/***, */tmp/*, home => /tmp/ If anybody is using the same package successfully I would be happy to not annoy the package maintainer and keep trying to understand what I am doing wrong. >> Did a restart of backuppc after every change. > > That's unnecessary. I avoided that at first. But when all variants (tmp/, */tmp/* tmp/***) failed I made sure no process was running an restarted backuppc. Benjamin -- FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html vox: +49 3641 9 44323 | fax: +49 3641 9 44321 -- Find and fix application performance issues faster with Applications Manager Applications Manager provides deep performance insights into multiple tiers of your business applications. It resolves application problems quickly and reduces your MTTR. Get your free trial! https://ad.doubleclick.net/ddm/clk/302982198;130105516;z ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd excludes problem (3.2.1)
On 2016-03-29 19:57, Michael Stowe wrote: > On 2016-03-29 10:17, Benjamin Redling wrote: >> [...] /tmp subdirectories and absolute >> paths (/anonuser... see below) are filling up the discs. >> XferMethod is rsyncd, shouldn't '*/tmp' avoid this? > No, '*/tmp' will avoid backing up any files named "tmp" or any empty > subdirectories named "tmp" as long as they are NOT in the root of the > share -- but it will not exclude any files IN directories named "tmp", > which, from your description, is probably what you want. Ok, I reread the section "INCLUDE/EXCLUDE PATTERN RULES" of the rsync man page in hope to grasp the patterns. There it says: " a trailing "dir_name/***" will match both the directory (as if "dir_name/" had been specified) and everything in the directory (as if "dir_name/**" had been specified). This behavior was added in version 2.6.7. " So, to my understanding tmp/*** (and all the other dirs accordingly) should be the correct pattern. [...] > Also note that exclude paths are relative, so if you want to match /tmp > in the root of the share, the proper exclude to use is simply 'tmp'. [...] > If you want to exclude anything in a subdirectory named tmp, then 'tmp/' > should do the trick. I need the later case, tmp in the home dirs. Thanks for pointing to the importance of the trailing slash! Maybe I changed more that I am willing to admit to myself and even worse: this wasn't part of config. management /version control -- really bad. Regards, Benjamin -- FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html vox: +49 3641 9 44323 | fax: +49 3641 9 44321 -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd excludes problem (3.2.1)
On 2016-03-29 10:17, Benjamin Redling wrote: > Hello everybody, > > my exclude list seems to be defunct since adding a few absolute paths > via the web interface. Recently(?) /tmp subdirectories and absolute > paths (/anonuser... see below) are filling up the discs. > XferMethod is rsyncd, shouldn't '*/tmp' avoid this? No, '*/tmp' will avoid backing up any files named "tmp" or any empty subdirectories named "tmp" as long as they are NOT in the root of the share -- but it will not exclude any files IN directories named "tmp", which, from your description, is probably what you want. It may help to imagine that rsync makes a list of files and directories relative to the share, and then applies your excludes to it to eliminate things from that list. As you might guess, */tmp doesn't match a lot of things on that list such as tmp/filename. Also note that exclude paths are relative, so if you want to match /tmp in the root of the share, the proper exclude to use is simply 'tmp'. If you want to exclude anything in a subdirectory named tmp, then 'tmp/' should do the trick. > Did a restart of backuppc after every change. That's unnecessary. >> From the config.pl: > > $Conf{BackupFilesExclude} = { > '*' => [ > '*/tmp', > '*/.cache', > '*/temp', > '*/Cache', > '*/cache', > '/anonuser1/usenet-de/per-group', > '/anonuser2/sub-dir1/sub-dir2/models', > '/anonuser3/downloads', > '*/privat*', > '*/ImapMail', > '*.iso', > '*.ISO', > '*/.macromedia', > '*/.local/share/Trash', > '*.ogg', > '*.OGG', > '*.mp3', > '*.MP3', > '*.mp4', > '*.MP4' > ] > }; > > I've also tried putting the new paths to an explicitly defined share: > $Conf{BackupFilesExclude} = { > '*' => [ > '*/tmp', > '*/.cache', > '*/temp', > '*/Cache', > '*/cache' > ], > 'home' => [ > '/anonuser1/usenet-de/per-group', > '/anonuser2/sub-dir1/sub-dir2/models', > '/anonuser3/downloads', > '*/privat*', > '*/ImapMail', > '*.iso', > '*.ISO', > '*/.macromedia', > '*/.local/share/Trash', > '*.ogg', > '*.OGG', > '*.mp3', > '*.MP3', > '*.mp4', > '*.MP4' > ] > }; > > BackupPC 3.2.1-2ubuntu1.1 on Ubuntu 12.04 LTS, x86_64 > > What am I doing wrong? (see above) I assume the extension exclusions are more-or-less working as you expect them to. You may want to review the Xferlog. > Regards, > Benjamin -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd excludes problem (3.2.1)
Hello everybody, my exclude list seems to be defunct since adding a few absolute paths via the web interface. Recently(?) /tmp subdirectories and absolute paths (/anonuser... see below) are filling up the discs. XferMethod is rsyncd, shouldn't '*/tmp' avoid this? Did a restart of backuppc after every change. >From the config.pl: $Conf{BackupFilesExclude} = { '*' => [ '*/tmp', '*/.cache', '*/temp', '*/Cache', '*/cache', '/anonuser1/usenet-de/per-group', '/anonuser2/sub-dir1/sub-dir2/models', '/anonuser3/downloads', '*/privat*', '*/ImapMail', '*.iso', '*.ISO', '*/.macromedia', '*/.local/share/Trash', '*.ogg', '*.OGG', '*.mp3', '*.MP3', '*.mp4', '*.MP4' ] }; I've also tried putting the new paths to an explicitly defined share: $Conf{BackupFilesExclude} = { '*' => [ '*/tmp', '*/.cache', '*/temp', '*/Cache', '*/cache' ], 'home' => [ '/anonuser1/usenet-de/per-group', '/anonuser2/sub-dir1/sub-dir2/models', '/anonuser3/downloads', '*/privat*', '*/ImapMail', '*.iso', '*.ISO', '*/.macromedia', '*/.local/share/Trash', '*.ogg', '*.OGG', '*.mp3', '*.MP3', '*.mp4', '*.MP4' ] }; BackupPC 3.2.1-2ubuntu1.1 on Ubuntu 12.04 LTS, x86_64 What am I doing wrong? Regards, Benjamin -- FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html vox: +49 3641 9 44323 | fax: +49 3641 9 44321 -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785471=/4140 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Rsyncd user and password field gets confused as a login form
When configuring an rsyncd host with the username being the same as the backuppc cgi user that is saved the browser autofills the password that is used for the cgi interface, you can delete it and write your own but pressing save saves the autofilled password. -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd user and password field gets confused as a login form
Actually the issue is that the browser saves from data from rsyncd user and pass fields as page login information. Is this a bug? On Tue, Mar 3, 2015 at 10:06 PM, Marko Doda ma...@lugola.net wrote: When configuring an rsyncd host with the username being the same as the backuppc cgi user that is saved the browser autofills the password that is used for the cgi interface, you can delete it and write your own but pressing save saves the autofilled password. -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd user and password field gets confused as a login form
On Tue, Mar 3, 2015 at 3:16 PM, Marko Doda ma...@lugola.net wrote: Actually the issue is that the browser saves from data from rsyncd user and pass fields as page login information. Is this a bug? Browsers will pre-populate credentials with what they have cached for the same authentication domain (Apache''s 'AuthName' setting), if you previously said to save it. I don't understand why you would have used those credentials in that context or saved them, though. -- Les Mikesell lesmikes...@gmail.com -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd user and password field gets confused as a login form
I accidentally saved the credentials for rsync, isn't it better to turn off the save password dialog for rsync credentials? On Tue, Mar 3, 2015 at 11:14 PM, Les Mikesell lesmikes...@gmail.com wrote: On Tue, Mar 3, 2015 at 3:16 PM, Marko Doda ma...@lugola.net wrote: Actually the issue is that the browser saves from data from rsyncd user and pass fields as page login information. Is this a bug? Browsers will pre-populate credentials with what they have cached for the same authentication domain (Apache''s 'AuthName' setting), if you previously said to save it. I don't understand why you would have used those credentials in that context or saved them, though. -- Les Mikesell lesmikes...@gmail.com -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd user and password field gets confused as a login form
On Tue, Mar 3, 2015 at 4:53 PM, Marko Doda ma...@lugola.net wrote: I accidentally saved the credentials for rsync, isn't it better to turn off the save password dialog for rsync credentials? That part is done by the client browser - which should also have a way to clear saved passwords. -- Les Mikesell lesmikes...@gmail.com -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
Hi, You could also go from raid1 to raid10. Met vriendelijke groet, Micha Kersloot Blijf op de hoogte en ontvang de laatste tips over Zimbra/KovoKs Contact: http://twitter.com/kovoks KovoKs B.V. is ingeschreven onder KvK nummer: 1104 - Oorspronkelijk bericht - Van: Adam Goryachev mailingli...@websitemanagers.com.au Aan: General list for user discussion, questions and support backuppc-users@lists.sourceforge.net Verzonden: Donderdag 31 oktober 2013 04:13:42 Onderwerp: Re: [BackupPC-users] rsyncd full backup On 31/10/13 13:56, Sharuzzaman Ahmat Raslan wrote: Hi Adam, The low I/O is when the machine is under load. Thank you for suggesting to use SSD. I have been thinking about that as well, but currently, the storage of BackupPC is using a 1TB disk, with about 80% utilization. Changing to 1TB SSD might be a little bit overkill on the customer's budget :) Sure, 2 x 480GB SSD in linear RAID is still relatively expensive :) though it certainly is a huge performance improvement. BTW, FYI, I get 2.5GB/s read and 1.5GB/s write performance from my RAID5... Maybe I should look at bcache for Linux :) https://lwn.net/Articles/497024/ http://bcache.evilpiepirate.org/ I've seen that also, but I'm not sure it is a good (stable) solution for real use (at least, I'm not prepared to use that for a server yet, your tolerance might be different). In addition, it probably won't help the backup work load, since you need to read the entire disk, and the entire disk won't fit into the cache Regards, Adam -- Adam Goryachev Website Managers P: +61 2 8304 a...@websitemanagers.com.au F: +61 2 8304 0001 www.websitemanagers.com.au -- Adam Goryachev Website Managers www.websitemanagers.com.au -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
Sharuzzaman Ahmat Raslan sharuzza...@gmail.com wrote on 10/30/2013 10:06:18 PM: Hi Holger, Based on short session of troubleshooting, I believe the machine actually suffer from low I/O speed to the disk. Average read is about 3 MB/s, which I considered slow for a SATA disk in IDE emulation. *REAL* slow: I consider anything under 20MB/s slow. But where did that number come from? The pattern of reads will make a *huge* difference... I'm planning to suggest to the customer to have a RAID 1 setup to increase the I/O speed. I'm looking at possibilities to speed things up by not having to change the overall setup. I think you might want to have a better idea of what is going on first before you just start throwing hardware at it. If your numbers were correct but still too slow I'd say sure. But your numbers are *broken* wrong. You *might* fix your problem (by accident!) by throwing away some pieces and adding others, but you might not, too. Then you've got a client that just spent a bunch of money for nothing... Tim Massey Out of the Box Solutions, Inc. Creative IT Solutions Made Simple! http://www.OutOfTheBoxSolutions.com tmas...@obscorp.com 22108 Harper Ave. St. Clair Shores, MI 48080 Office: (800)750-4OBS (4627) Cell: (586)945-8796 -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
Hi Timothy, I got the number by observing the output of iotop while file transfer is running. Also, on BackupPC host summary page, average transfer rate for full backup is also around 3MB/s It could be a network bottleneck also, as the customer is using 100Mbps switch with around 80 PC, not including network printer and servers. Inclusive should be around 100 network devices. Any idea how to properly troubleshoot network bottleneck? My skill is a little bit lacking on that area. Thanks. On Fri, Nov 1, 2013 at 2:12 AM, Timothy J Massey tmas...@obscorp.comwrote: Sharuzzaman Ahmat Raslan sharuzza...@gmail.com wrote on 10/30/2013 10:06:18 PM: Hi Holger, Based on short session of troubleshooting, I believe the machine actually suffer from low I/O speed to the disk. Average read is about 3 MB/s, which I considered slow for a SATA disk in IDE emulation. *REAL* slow: I consider anything under 20MB/s slow. But where did that number come from? The pattern of reads will make a *huge* difference... I'm planning to suggest to the customer to have a RAID 1 setup to increase the I/O speed. I'm looking at possibilities to speed things up by not having to change the overall setup. I think you might want to have a better idea of what is going on first before you just start throwing hardware at it. If your numbers were correct but still too slow I'd say sure. But your numbers are *broken* wrong. You *might* fix your problem (by accident!) by throwing away some pieces and adding others, but you might not, too. Then you've got a client that just spent a bunch of money for nothing... Tim Massey *Out of the Box Solutions, Inc.* * Creative IT Solutions Made Simple!** **http://www.OutOfTheBoxSolutions.com*http://www.outoftheboxsolutions.com/ * **tmas...@obscorp.com* tmas...@obscorp.com 22108 Harper Ave. St. Clair Shores, MI 48080 Office: (800)750-4OBS (4627) Cell: (586)945-8796 -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Sharuzzaman Ahmat Raslan -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
On Wed, Oct 30, 2013 at 9:06 PM, Sharuzzaman Ahmat Raslan sharuzza...@gmail.com wrote: Hi Holger, Based on short session of troubleshooting, I believe the machine actually suffer from low I/O speed to the disk. Average read is about 3 MB/s, which I considered slow for a SATA disk in IDE emulation. Where are you getting that number? hdparm -tT device_partition_name should show about 30MB/s for the lower number even for old IDEs and at least 2 or 3x that for SATA with a SATA controller - even old ones. I'm planning to suggest to the customer to have a RAID 1 setup to increase the I/O speed. I'm looking at possibilities to speed things up by not having to change the overall setup. RAID1 is a good idea to protect against a single drive failure, but it won't make a lot of difference in speed. Writes go to both, reads can overlap if the software is smart. But, if you are currently running RAID5, using bigger disks in RAID1 would help. -- Les Mikesell lesmikes...@gmail.com -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
Sharuzzaman Ahmat Raslan sharuzza...@gmail.com wrote on 10/31/2013 02:38:01 PM: Hi Timothy, I got the number by observing the output of iotop while file transfer is running. Also, on BackupPC host summary page, average transfer rate for full backup is also around 3MB/s It could be a network bottleneck also, as the customer is using 100Mbps switch with around 80 PC, not including network printer and servers. Inclusive should be around 100 network devices. For file transfers, 100Mb/s is good for 7MB/s transfer rate. Assuming a good quality switch (which is a *big* assumption), the number of computers shouldn't matter. But I would think strongly about buying a good quality Gigabit switch (I recommend the HP V1910-24G) as your backbone: Plug all of your servers (including the BackupPC server) into it, as well as each of your 100Mb/s switches (even better if they have Gb uplink ports!). That would eliminate the network as a bottleneck and only costs $300. And improve network performance across the board, though your users may not notice it if they only work with small files. Any idea how to properly troubleshoot network bottleneck? My skill is a little bit lacking on that area. Sure: Time the copying of files from one machine to another. Assuming the source and destination hard drives are faster than 7MB/s (and they very well *better* be!), then you'll saturate a 100Mb network no problem. For a more scientific approach, check out iperf. I'd be *much* more worried about checking out your *disk* performance. You can do tests in exactly the same way: copy files to and from the disk and see what happens. Here are some very simple examples: sync; time dd if=/dev/zero of=test.fil bs=1M count=1024; sync; sync; sync; sync; time dd if=test.fil of=/dev/null bs=1M The first line times the writing of a 1GB file named test.fil. The second one times the reading of the same 1GB file. Divide 1024 by the number of seconds it takes and that will give you the MB/s that you transferred. (The sync command is needed for accurate timing; the three sync commands is kind of an old UNIX graybeard joke: http://unix.stackexchange.com/questions/5260/is-there-truth-to-the-philosophy-that-you-should-sync-sync-sync-sync ) If you want more scientific disk performance information, check out iozone or iometer. Remember: always profile before you optimize. ( http://www.phatcode.net/res/224/files/html/ch37/37-02.html ) Tim Massey Out of the Box Solutions, Inc. Creative IT Solutions Made Simple! http://www.OutOfTheBoxSolutions.com tmas...@obscorp.com 22108 Harper Ave. St. Clair Shores, MI 48080 Office: (800)750-4OBS (4627) Cell: (586)945-8796 -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
Hi, Adam Goryachev wrote on 2013-10-29 15:29:42 +1100 [Re: [BackupPC-users] rsyncd full backup]: On 29/10/13 15:14, Sharuzzaman Ahmat Raslan wrote: [...] On Tue, Oct 29, 2013 at 11:33 AM, Les Mikesell lesmikes...@gmail.com mailto:lesmikes...@gmail.com wrote: On Mon, Oct 28, 2013 at 10:08 PM, Sharuzzaman Ahmat Raslan sharuzza...@gmail.com mailto:sharuzza...@gmail.com wrote: [...] Initially, the backup transport is SMB, but recently, I noticed a lot of machine backup (full and incremental) is not able to complete in 8 hours, due to large number of file, and big file size. Last week, I installed DeltaCopy (rsycnd server for Windows) on one machine, and change the backup transport to rysncd. The backup runs well. But today, I noticed, when BackupPC is running a full backup on the machine that have rsyncd, it still takes 8 hours to do full backup. [...] Rsync will only transfer the changed data, but in full runs the contents of the files are read at both ends and compared with block checksums, so it takes some time. [...] In essence, if I enable |--checksum-seed=32761 | then the rsync full backup will be faster? Yes, the third full backup after you enable that option will be faster *IF* the slow speed is due to the backup server needing to decompress the file and check the content. let me stress that again: don't expect a speedup on the *first* full backup after you enable that option. In my limited opinion (I haven't compared speeds because I don't have any issues with slow backups), the *second* full backup should be faster, as you have pre-existing full backups, i.e. the next full can add the checksums. In any case, the *third* full backup should hopefully be faster :-). In the case that your backup client has really slow disk, then there is nothing you can do, except maybe modify backuppc for full backups to not send the ignore-times option to rsync (ie, every backup is an incremental). Or, of course, upgrade the client to improve performance. Actually, it is worth noting that aside from a possible speed improvement the switch from smb to rsync(d) gives you far more precise *incremental* backups, so it might be an option to increase FullPeriod. This may transfer more data (because the delta is always relative to the reference backup - normally the previous full backup - and not to the previous incremental backup), but you can always explore the IncrLevels setting. So, while you might not speed up the full runs, you might get away with doing them less often. I would not recommend patching the ignore-times option away altogether. But Adams point is correct: you need to find out where the problem is, before you can fix it. While you might be able to find the problem by trying out fixes, that might not be the most efficient way :-). Regards, Holger -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
Hi Holger, Based on short session of troubleshooting, I believe the machine actually suffer from low I/O speed to the disk. Average read is about 3 MB/s, which I considered slow for a SATA disk in IDE emulation. I'm planning to suggest to the customer to have a RAID 1 setup to increase the I/O speed. I'm looking at possibilities to speed things up by not having to change the overall setup. Thank you for providing new insights to me regarding rsync. Glad to learn new things :) Thanks. On Thu, Oct 31, 2013 at 5:15 AM, Holger Parplies wb...@parplies.de wrote: Hi, Adam Goryachev wrote on 2013-10-29 15:29:42 +1100 [Re: [BackupPC-users] rsyncd full backup]: On 29/10/13 15:14, Sharuzzaman Ahmat Raslan wrote: [...] On Tue, Oct 29, 2013 at 11:33 AM, Les Mikesell lesmikes...@gmail.com mailto:lesmikes...@gmail.com wrote: On Mon, Oct 28, 2013 at 10:08 PM, Sharuzzaman Ahmat Raslan sharuzza...@gmail.com mailto:sharuzza...@gmail.com wrote: [...] Initially, the backup transport is SMB, but recently, I noticed a lot of machine backup (full and incremental) is not able to complete in 8 hours, due to large number of file, and big file size. Last week, I installed DeltaCopy (rsycnd server for Windows) on one machine, and change the backup transport to rysncd. The backup runs well. But today, I noticed, when BackupPC is running a full backup on the machine that have rsyncd, it still takes 8 hours to do full backup. [...] Rsync will only transfer the changed data, but in full runs the contents of the files are read at both ends and compared with block checksums, so it takes some time. [...] In essence, if I enable |--checksum-seed=32761 | then the rsync full backup will be faster? Yes, the third full backup after you enable that option will be faster *IF* the slow speed is due to the backup server needing to decompress the file and check the content. let me stress that again: don't expect a speedup on the *first* full backup after you enable that option. In my limited opinion (I haven't compared speeds because I don't have any issues with slow backups), the *second* full backup should be faster, as you have pre-existing full backups, i.e. the next full can add the checksums. In any case, the *third* full backup should hopefully be faster :-). In the case that your backup client has really slow disk, then there is nothing you can do, except maybe modify backuppc for full backups to not send the ignore-times option to rsync (ie, every backup is an incremental). Or, of course, upgrade the client to improve performance. Actually, it is worth noting that aside from a possible speed improvement the switch from smb to rsync(d) gives you far more precise *incremental* backups, so it might be an option to increase FullPeriod. This may transfer more data (because the delta is always relative to the reference backup - normally the previous full backup - and not to the previous incremental backup), but you can always explore the IncrLevels setting. So, while you might not speed up the full runs, you might get away with doing them less often. I would not recommend patching the ignore-times option away altogether. But Adams point is correct: you need to find out where the problem is, before you can fix it. While you might be able to find the problem by trying out fixes, that might not be the most efficient way :-). Regards, Holger -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Sharuzzaman Ahmat Raslan -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
On 31/10/13 13:06, Sharuzzaman Ahmat Raslan wrote: Hi Holger, Based on short session of troubleshooting, I believe the machine actually suffer from low I/O speed to the disk. Average read is about 3 MB/s, which I considered slow for a SATA disk in IDE emulation. Is that under load, or while idle? If it is under load, then it might be expected, remember throughput is very bad for HD when you have random load due to seek times. If it is idle and has that performance level, then there is something wrong. Even old IDE disks could do at least 30 to 50MB/s for large contiguous reads. I'm planning to suggest to the customer to have a RAID 1 setup to increase the I/O speed. I'm looking at possibilities to speed things up by not having to change the overall setup. While RAID1 will assist in reliability and is one strategy to reduce downtime/data loss (but it isn't a backup), it also is not going to improve performance. With RAID1 you still need to write to both disks, and while it is theoretically possible to balance reads across both disks, it likely won't do that well without a proper hardware raid controller. Personally, my suggestion would be to consider using a SSD, since you are using such an old drive, probably you don't need a lot of space, so a 120GB SSD might be suitable. An SSD will handle random IO significantly better than any one or two drive system, with much higher transfer rates as well (there is no penalty for seek times with SSD). Again, personally, I've used a couple of systems with 5 x 480GB Intel 520s SSD in RAID5, and they have been working really well (except they were difficult to actually get stock of them most of this year, and I hear they are now replaced by a new model). Regards, Adam -- Adam Goryachev Website Managers P: +61 2 8304 a...@websitemanagers.com.au F: +61 2 8304 0001 www.websitemanagers.com.au -- Adam Goryachev Website Managers www.websitemanagers.com.au -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
On 31/10/13 13:56, Sharuzzaman Ahmat Raslan wrote: Hi Adam, The low I/O is when the machine is under load. Thank you for suggesting to use SSD. I have been thinking about that as well, but currently, the storage of BackupPC is using a 1TB disk, with about 80% utilization. Changing to 1TB SSD might be a little bit overkill on the customer's budget :) Sure, 2 x 480GB SSD in linear RAID is still relatively expensive :) though it certainly is a huge performance improvement. BTW, FYI, I get 2.5GB/s read and 1.5GB/s write performance from my RAID5... Maybe I should look at bcache for Linux :) https://lwn.net/Articles/497024/ http://bcache.evilpiepirate.org/ I've seen that also, but I'm not sure it is a good (stable) solution for real use (at least, I'm not prepared to use that for a server yet, your tolerance might be different). In addition, it probably won't help the backup work load, since you need to read the entire disk, and the entire disk won't fit into the cache Regards, Adam -- Adam Goryachev Website Managers P: +61 2 8304 a...@websitemanagers.com.au F: +61 2 8304 0001 www.websitemanagers.com.au -- Adam Goryachev Website Managers www.websitemanagers.com.au -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd full backup
Hi, I have implemented BackupPC for my customer. Initially, the backup transport is SMB, but recently, I noticed a lot of machine backup (full and incremental) is not able to complete in 8 hours, due to large number of file, and big file size. Last week, I installed DeltaCopy (rsycnd server for Windows) on one machine, and change the backup transport to rysncd. The backup runs well. But today, I noticed, when BackupPC is running a full backup on the machine that have rsyncd, it still takes 8 hours to do full backup. Which is I considered weird, because rsync suppose to compare that full backup, with the previous full backup (or previous full + incremental), so that only modified file is transferred. That is my expectation when I plan to use rsyncd. Any explanation why BackupPC is not running in this way? Any configuration that I can changed to make it work like what I expect? Thanks. -- Sharuzzaman Ahmat Raslan -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
On Mon, Oct 28, 2013 at 10:08 PM, Sharuzzaman Ahmat Raslan sharuzza...@gmail.com wrote: Hi, I have implemented BackupPC for my customer. Initially, the backup transport is SMB, but recently, I noticed a lot of machine backup (full and incremental) is not able to complete in 8 hours, due to large number of file, and big file size. Last week, I installed DeltaCopy (rsycnd server for Windows) on one machine, and change the backup transport to rysncd. The backup runs well. But today, I noticed, when BackupPC is running a full backup on the machine that have rsyncd, it still takes 8 hours to do full backup. Which is I considered weird, because rsync suppose to compare that full backup, with the previous full backup (or previous full + incremental), so that only modified file is transferred. That is my expectation when I plan to use rsyncd. Any explanation why BackupPC is not running in this way? Any configuration that I can changed to make it work like what I expect? Rsync will only transfer the changed data, but in full runs the contents of the files are read at both ends and compared with block checksums, so it takes some time. Incrementals runs will quickly skip files where the file timestamps and lengths are identical. See the section on 'Rsync checksum caching' in http://backuppc.sourceforge.net/faq/BackupPC.html regarding a way to avoid having to read/uncompress on the server side after 2 fulls have completed, but the data is always read on the target side. -- Les Mikesell lesmikes...@gmail.com -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd full backup
On 29/10/13 15:14, Sharuzzaman Ahmat Raslan wrote: Hi Les, Thanks.| | On Tue, Oct 29, 2013 at 11:33 AM, Les Mikesell lesmikes...@gmail.com mailto:lesmikes...@gmail.com wrote: On Mon, Oct 28, 2013 at 10:08 PM, Sharuzzaman Ahmat Raslan sharuzza...@gmail.com mailto:sharuzza...@gmail.com wrote: Hi, I have implemented BackupPC for my customer. Initially, the backup transport is SMB, but recently, I noticed a lot of machine backup (full and incremental) is not able to complete in 8 hours, due to large number of file, and big file size. Last week, I installed DeltaCopy (rsycnd server for Windows) on one machine, and change the backup transport to rysncd. The backup runs well. But today, I noticed, when BackupPC is running a full backup on the machine that have rsyncd, it still takes 8 hours to do full backup. Which is I considered weird, because rsync suppose to compare that full backup, with the previous full backup (or previous full + incremental), so that only modified file is transferred. That is my expectation when I plan to use rsyncd. Any explanation why BackupPC is not running in this way? Any configuration that I can changed to make it work like what I expect? Rsync will only transfer the changed data, but in full runs the contents of the files are read at both ends and compared with block checksums, so it takes some time. Incrementals runs will quickly skip files where the file timestamps and lengths are identical. See the section on 'Rsync checksum caching' in http://backuppc.sourceforge.net/faq/BackupPC.html regarding a way to avoid having to read/uncompress on the server side after 2 fulls have completed, but the data is always read on the target side. In essence, if I enable |--checksum-seed=32761 | then the rsync full backup will be faster? Yes, the third full backup after you enable that option will be faster *IF* the slow speed is due to the backup server needing to decompress the file and check the content. In the case that your backup client has really slow disk, then there is nothing you can do, except maybe modify backuppc for full backups to not send the ignore-times option to rsync (ie, every backup is an incremental). Or, of course, upgrade the client to improve performance. Regards, Adam -- Adam Goryachev Website Managers www.websitemanagers.com.au -- Android is increasing in popularity, but the open development platform that developers love is also attractive to malware creators. Download this white paper to learn more about secure code signing practices that can help keep Android apps secure. http://pubads.g.doubleclick.net/gampad/clk?id=65839951iu=/4140/ostg.clktrk___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd cygwin Problem..
Well, I guess it is *SOLVED*... I didn't change how the service was running. Since I couldn't see any differences in the directories or privileges I decided to try something else. I went to the rsyncd.conf file on the client and setup three shares that match the directories I was trying to backup. I realize this could mean that (especially the user directory) might restore to the wrong place, that is ok, as long as I can get to the backup. It worked *PERFECT*. Ran right through the three shares and backed them up. Not exactly sure why it wasn't working the other way. For this one client, I don't mind having the extra step of creating the shares, it is not something that is going to change. Thanks! And thanks for the confirmation on the rsyncd user/pass meaning nothing, I figured it was a doesn't matter, but wasn't sure, that is why I matched it to my ID on the system just in case it was slipping through somehow. On Fri, Feb 1, 2013 at 10:08 AM, Michael Stowe mst...@chicago.us.mensa.orgwrote: So, it looks like rsyncd is running as: Local System account I guess I could switch that to run as my domain account on the machine. Just not sure if I should use all commands from cygwin shell to kill this one and start another or just change it from the windows gui (IF NEEDED).. You have a few alternatives, which involve matching up the user that rsync[d] is running as to the permissions on the directories you'd like to synchronize. The Local System account usually doesn't have access to domain directories, but they can be granted; alternatively, you can run rsyncd as a domain user. I compared the directories and the properties and they all look the same (well, my user directory was slightly different, but expected). It ran an incremental last night and I changed what user I was passing over in the rsyncd setup (and changed the conf to reflect that user) and it looks like it did the exact same thing, as in only looked at the one directory. To clarify: the rsyncd user -- the one in rsyncd.conf -- does not actually relate to anything in any way except allowing connections to rsync. It's not a cygwin, Windows, or domain user. Although it can be named the same, you can easily just use hoobydooby and everything will work the same. Being my work machine, my ID is from the domain and while I they give us admin privileges, there are still some things we can't do, like add a local user. The ID I used this time was my domain ID in the rsyncd setup to try to see if it was an issue with that. As above, you need to run rsyncd as the domain user; the user in rsyncd.conf is inherently meaningless. Also, changed the log level on the client and the log looks exactly the same. Actually the log files look pretty clean. It is really like it is almost not even trying to do the other two directories. From the description, it's likely that this is the case, as the local system user wouldn't even be able to traverse the directories without permission. Thanks Travis Schwenke Once again confused.. but learning... :) -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd cygwin Problem..
So, it looks like rsyncd is running as: Local System account I guess I could switch that to run as my domain account on the machine. Just not sure if I should use all commands from cygwin shell to kill this one and start another or just change it from the windows gui (IF NEEDED).. I compared the directories and the properties and they all look the same (well, my user directory was slightly different, but expected). It ran an incremental last night and I changed what user I was passing over in the rsyncd setup (and changed the conf to reflect that user) and it looks like it did the exact same thing, as in only looked at the one directory. Being my work machine, my ID is from the domain and while I they give us admin privileges, there are still some things we can't do, like add a local user. The ID I used this time was my domain ID in the rsyncd setup to try to see if it was an issue with that. Also, changed the log level on the client and the log looks exactly the same. Actually the log files look pretty clean. It is really like it is almost not even trying to do the other two directories. Thanks Travis Schwenke Once again confused.. but learning... :) On Thu, Jan 31, 2013 at 6:45 AM, Michael Stowe mst...@chicago.us.mensa.orgwrote: So, my goal was going to be rsync on all machines, I seem to have that working fine now on my windows machines, but my work laptop is part of a domain so I figured I would try rsyncd and learn how it worked in the process. It is trying to backup, but it is not following my rules correctly. It is only grabbing one of my directories and I am not sure why! It is only getting the /eng_apps area and not the other two, this was working fine with smb. Start of the LOG file full backup started for directory root (baseline backup #12) Connected to machine:873, remote version 30 Negotiated protocol version 28 Connected to module root Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . . Sent include: /users Sent include: /users/wzpcnt Sent include: /data Sent include: /eng_apps Sent exclude: /* Sent exclude: /users/* Rsyncd.conf on machine in c:\cygwin\etc gid = users read only = true use chroot = false transfer logging = false log file = /var/log/rsyncd.log log format = %h %o %f %l %b hosts allow = x.x.x.x hosts deny = 0.0.0.0/0 strict modes = false [root] path = /cygdrive/c/ auth users = backuppc secrets file = /etc/rsyncd.secret machine.pl (I did everything via the CGI I see some smb settings are still in the file, I omitted them this paste, I hope they are not causing the issue) $Conf{BackupFilesOnly} = { '*' = [ '/users/me', '/data', '/eng_apps' ] }; $Conf{ClientCharset} = 'cp1252'; $Conf{RsyncShareName} = [ 'root' ]; $Conf{RsyncdPasswd} = 'xxx'; $Conf{RsyncdUserName} = 'backuppc'; $Conf{XferMethod} = 'rsyncd'; So why is it only getting ONE of the directories I specified? Under which user account is rsyncd running? My first guess would be that it is a permission problem. It may be enlightening to turn transfer logging on. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd cygwin Problem..
So, it looks like rsyncd is running as: Local System account I guess I could switch that to run as my domain account on the machine. Just not sure if I should use all commands from cygwin shell to kill this one and start another or just change it from the windows gui (IF NEEDED).. You have a few alternatives, which involve matching up the user that rsync[d] is running as to the permissions on the directories you'd like to synchronize. The Local System account usually doesn't have access to domain directories, but they can be granted; alternatively, you can run rsyncd as a domain user. I compared the directories and the properties and they all look the same (well, my user directory was slightly different, but expected). It ran an incremental last night and I changed what user I was passing over in the rsyncd setup (and changed the conf to reflect that user) and it looks like it did the exact same thing, as in only looked at the one directory. To clarify: the rsyncd user -- the one in rsyncd.conf -- does not actually relate to anything in any way except allowing connections to rsync. It's not a cygwin, Windows, or domain user. Although it can be named the same, you can easily just use hoobydooby and everything will work the same. Being my work machine, my ID is from the domain and while I they give us admin privileges, there are still some things we can't do, like add a local user. The ID I used this time was my domain ID in the rsyncd setup to try to see if it was an issue with that. As above, you need to run rsyncd as the domain user; the user in rsyncd.conf is inherently meaningless. Also, changed the log level on the client and the log looks exactly the same. Actually the log files look pretty clean. It is really like it is almost not even trying to do the other two directories. From the description, it's likely that this is the case, as the local system user wouldn't even be able to traverse the directories without permission. Thanks Travis Schwenke Once again confused.. but learning... :) -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd cygwin Problem..
So, my goal was going to be rsync on all machines, I seem to have that working fine now on my windows machines, but my work laptop is part of a domain so I figured I would try rsyncd and learn how it worked in the process. It is trying to backup, but it is not following my rules correctly. It is only grabbing one of my directories and I am not sure why! It is only getting the /eng_apps area and not the other two, this was working fine with smb. Start of the LOG file full backup started for directory root (baseline backup #12) Connected to machine:873, remote version 30 Negotiated protocol version 28 Connected to module root Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . . Sent include: /users Sent include: /users/wzpcnt Sent include: /data Sent include: /eng_apps Sent exclude: /* Sent exclude: /users/* Rsyncd.conf on machine in c:\cygwin\etc gid = users read only = true use chroot = false transfer logging = false log file = /var/log/rsyncd.log log format = %h %o %f %l %b hosts allow = x.x.x.x hosts deny = 0.0.0.0/0 strict modes = false [root] path = /cygdrive/c/ auth users = backuppc secrets file = /etc/rsyncd.secret machine.pl (I did everything via the CGI I see some smb settings are still in the file, I omitted them this paste, I hope they are not causing the issue) $Conf{BackupFilesOnly} = { '*' = [ '/users/me', '/data', '/eng_apps' ] }; $Conf{ClientCharset} = 'cp1252'; $Conf{RsyncShareName} = [ 'root' ]; $Conf{RsyncdPasswd} = 'xxx'; $Conf{RsyncdUserName} = 'backuppc'; $Conf{XferMethod} = 'rsyncd'; So why is it only getting ONE of the directories I specified? Under which user account is rsyncd running? My first guess would be that it is a permission problem. It may be enlightening to turn transfer logging on. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Rsyncd cygwin Problem..
So, my goal was going to be rsync on all machines, I seem to have that working fine now on my windows machines, but my work laptop is part of a domain so I figured I would try rsyncd and learn how it worked in the process. It is trying to backup, but it is not following my rules correctly. It is only grabbing one of my directories and I am not sure why! It is only getting the /eng_apps area and not the other two, this was working fine with smb. Start of the LOG file full backup started for directory root (baseline backup #12) Connected to machine:873, remote version 30 Negotiated protocol version 28 Connected to module root Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . . Sent include: /users Sent include: /users/wzpcnt Sent include: /data Sent include: /eng_apps Sent exclude: /* Sent exclude: /users/* Rsyncd.conf on machine in c:\cygwin\etc gid = users read only = true use chroot = false transfer logging = false log file = /var/log/rsyncd.log log format = %h %o %f %l %b hosts allow = x.x.x.x hosts deny = 0.0.0.0/0 strict modes = false [root] path = /cygdrive/c/ auth users = backuppc secrets file = /etc/rsyncd.secret machine.pl (I did everything via the CGI I see some smb settings are still in the file, I omitted them this paste, I hope they are not causing the issue) $Conf{BackupFilesOnly} = { '*' = [ '/users/me', '/data', '/eng_apps' ] }; $Conf{ClientCharset} = 'cp1252'; $Conf{RsyncShareName} = [ 'root' ]; $Conf{RsyncdPasswd} = 'xxx'; $Conf{RsyncdUserName} = 'backuppc'; $Conf{XferMethod} = 'rsyncd'; So why is it only getting ONE of the directories I specified? -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd backup fails with Can't write to socket
From the XferLog file: Can't write 13944 bytes to socket Read EOF: Operation timed out Tried again: got 0 bytes finish: removing in-process file filename removed Child is aborting Done: 502 files, 43008274 bytes Got fatal error during xfer (aborted by signal=PIPE) The server is a freeBSD 9.1 system, and the client is a windows 7 machine running the DeltaCopy rsync service. The file in question *may* have been an open file, since the owner was logged in at the time. Anyone know how to get one of these backups to actually complete? Thanks RP -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122412 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd backup fails with Can't write to socket
From the XferLog file: Can't write 13944 bytes to socket Read EOF: Operation timed out Tried again: got 0 bytes finish: removing in-process file filename removed Child is aborting Done: 502 files, 43008274 bytes Got fatal error during xfer (aborted by signal=PIPE) The server is a freeBSD 9.1 system, and the client is a windows 7 machine running the DeltaCopy rsync service. The file in question *may* have been an open file, since the owner was logged in at the time. Anyone know how to get one of these backups to actually complete? Thanks RP I'd normally expect rsync to skip over open files with a warning; you may be running into a DeltaCopy bug, or it may react badly to certain semantics for open files. The proper way to copy open files is using Shadow Copies, but rsync presents an interesting conundrum, because the shadow copy has to be available before rsync is started, so running an rsync service probably won't work (unless you go to the trouble or writing your own rsync-compatible, non-Cygwin, VSS-capable service, I guess. DeltaCopy is not such a thing.) At any rate, there are at least two VSS/rsync based solutions, but I'm not aware of an rsync service working with open files at all. -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122412 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd on mac
Negotiated protocol version 28 Hi I see that the File-RsyncP-0.70 only runs to Protocol version 28. but I see interesting facts for backup MAC systems. the default mac version 2.6.8 is very slow in my test. I put the last version of rsync 3.0.7 and see a speed improbe. My questions are two. 1, What is the best and the faster option for backup remote files?? (rsync or rsyncd) for me is rsyncd. for example. two full rsync 2.6.8(mac version) 541593.5 (files in MB) TIME: 448.1 rsync 3.0.7(https://github.com/MacLemon/mlbackup/) 543157.5 (files in MB) TIME: 276.1. use the last version becasue is more faster... 2, There is any chances that the File-RsyncP perl module future support protocol 30 in a future? Regards! P.D. anybody make test? Is interesting put this in wiki? I have the complete manual for make rsyncd running in MAC OS. ;-) -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd, Parent read EOF from child
SOLVED 17.06.2010 12:05, Alexander Moisseev пишет: I had resolve the problem by adding extra 512 MB of RAM. But problem back again after a few days. Solution: The default hard datasize limit on FreeBSD is 512MB. To raise it, put this in /boot/loader.conf and reboot: kern.maxdsiz=1G -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd, Parent read EOF from child
Alexander Moisseev wrote: I have BackupPC configured to backup several directories on the same server as different BackupPC hosts. It works without a problem more than 2 years. But now backup of one directory interrupts during transfer when it still works normally for other ones. There are a lot of problems with rsyncd in windows. At least with cygwin prior V1.7. I found a lot of information (but no solution) about this in different mailing lists within the last two years :-( So it is very interesting that it does work with cygwin-rsyncd-2.6.8_0, Windows Server 2003 Std R2. I use rsync instead rsyncd and happy with that. Got fatal error during xfer (Child exited prematurely) means that your cygwin-rsyncd die. You should increase log verbosity on cygwin-rsyncd and check against this log. br Matthias -- Don't Panic -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd, Parent read EOF from child
Matthias Meyer wrote: So it is very interesting that it does work with cygwin-rsyncd-2.6.8_0, Windows Server 2003 Std R2. I have no problem with one at all. Got fatal error during xfer (Child exited prematurely) means that your cygwin-rsyncd die. You should increase log verbosity on cygwin-rsyncd and check against this log. I had overlook this lines in BackupPC log: 2010-06-11 04:04:13 1s_trade_at_phoenix: Out of memory during large request for 16781312 bytes, total sbrk() is 529952768 bytes at /usr/local/BackupPC/lib/BackupPC/FileZIO.pm line 203. 2010-06-11 04:04:19 Backup failed on 1s_trade_at_phoenix (Child exited prematurely) It seems that when BackupPC tries to _decompress_ 342 MB file from pool it consumes all available RAM and swap. (I had 1G RAM + 1G swap). I had resolve the problem by adding extra 512 MB of RAM. But the directory that I am backing up is only about 1000 Files and 2.5 GB and the biggest file is 342 MB. Is BackupPC really needs so much memory? Or it is memory leaks? -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd, Parent read EOF from child
Alexander Moisseev wrote: Matthias Meyer wrote: So it is very interesting that it does work with cygwin-rsyncd-2.6.8_0, Windows Server 2003 Std R2. I have no problem with one at all. Got fatal error during xfer (Child exited prematurely) means that your cygwin-rsyncd die. You should increase log verbosity on cygwin-rsyncd and check against this log. I had overlook this lines in BackupPC log: 2010-06-11 04:04:13 1s_trade_at_phoenix: Out of memory during large request for 16781312 bytes, total sbrk() is 529952768 bytes at /usr/local/BackupPC/lib/BackupPC/FileZIO.pm line 203. 2010-06-11 04:04:19 Backup failed on 1s_trade_at_phoenix (Child exited prematurely) It seems that when BackupPC tries to _decompress_ 342 MB file from pool it consumes all available RAM and swap. (I had 1G RAM + 1G swap). I had resolve the problem by adding extra 512 MB of RAM. But the directory that I am backing up is only about 1000 Files and 2.5 GB and the biggest file is 342 MB. Is BackupPC really needs so much memory? Or it is memory leaks? Are you running a 64-bit perl on the server? I think it consumes much more memory than a 32 bit instance would. -- Les Mikesell lesmikes...@gmail.com -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd, Parent read EOF from child
Les Mikesell wrote: Are you running a 64-bit perl on the server? I think it consumes much more memory than a 32 bit instance would. No, my hardware have no support 64-bit at all. -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd, Parent read EOF from child
I have BackupPC configured to backup several directories on the same server as different BackupPC hosts. It works without a problem more than 2 years. But now backup of one directory interrupts during transfer when it still works normally for other ones. Xfer Settings for all hosts (directories) is the same. XferMethod is rcyncd. BackupPC 3.1.0, FreeBSD 6.2 Client: cygwin-rsyncd-2.6.8_0, Windows Server 2003 Std R2 Transfer log: Contents of file /data/BackupPC/pc/1s_trade_at_phoenix/XferLOG.bad.z, modified 2010-06-11 10:19:09 full backup started for directory dDrive (baseline backup #987) Connected to phoenix:873, remote version 29 Negotiated protocol version 28 Connected to module dDrive Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . . SKIPPED same 644 400/401 627185 1s_db/db/trade/t_mezon/db/RG351.DBF create 644 400/401 118901106 1s_db/db/trade/t_mezon/db/RG3549.DBF create 644 400/40159228634 1s_db/db/trade/t_mezon/db/RG405.DBF create 644 400/401 130588998 1s_db/db/trade/t_mezon/db/RG4314.DBF Parent read EOF from child: fatal error! Done: 0 files, 0 bytes Got fatal error during xfer (Child exited prematurely) Backup aborted (Child exited prematurely) Saving this as a partial backup, replacing the prior one (got 161 and 0 files versus 0) full backup started for directory dDrive; updating partial #988 Connected to phoenix:873, remote version 29 Negotiated protocol version 28 Connected to module dDrive Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . . SKIPPED same 644 400/401 627185 1s_db/db/trade/t_mezon/db/RG351.DBF create 644 400/401 118922578 1s_db/db/trade/t_mezon/db/RG3549.DBF create 644 400/40159228634 1s_db/db/trade/t_mezon/db/RG405.DBF create 644 400/401 130588998 1s_db/db/trade/t_mezon/db/RG4314.DBF Parent read EOF from child: fatal error! Done: 0 files, 0 bytes Got fatal error during xfer (Child exited prematurely) Backup aborted (Child exited prematurely) Saving this as a partial backup full backup started for directory dDrive; updating partial #988 Connected to phoenix:873, remote version 29 Negotiated protocol version 28 Got response: 92ee79e1345b080d93ceaa6b12a71b9a in mime: ku554TRbCA2TzqprEqcbmg Auth: got challenge: [removed], reply: backuppc [removed] Connected to module dDrive Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . . Checksum seed is 1276236933 Got checksumSeed 0x4c11d485 SKIPPED Starting file 648 (1s_db/db/trade/t_mezon/db/RG4335.DBF), blkCnt=14989, blkSize=16384, remainder=13126 /data/BackupPC/pc/1s_trade_at_phoenix/987/fdDrive/f1s_db/fdb/ftrade/ft_mezon/fdb/fRG438.DBF cache = , invalid = , phase = 0 Sending csums for 1s_db/db/trade/t_mezon/db/RG438.DBF (size=157430) /data/BackupPC/pc/1s_trade_at_phoenix/987/fdDrive/f1s_db/fdb/ftrade/ft_mezon/fdb/fRG4480.DBF cache = , invalid = , phase = 0 Sending csums for 1s_db/db/trade/t_mezon/db/RG4480.DBF (size=74355938) /data/BackupPC/pc/1s_trade_at_phoenix/987/fdDrive/f1s_db/fdb/ftrade/ft_mezon/fdb/fRG464.DBF cache = , invalid = , phase = 0 Sending csums for 1s_db/db/trade/t_mezon/db/RG464.DBF (size=51968559) Parent read EOF from child: fatal error! Sending csums, cnt = 149, phase = 1 /data/BackupPC/pc/1s_trade_at_phoenix/987/fdDrive/f1s_db/fdb/ftrade/ft_mezon/fdb/fRG4667.DBF cache = , invalid = , phase = 1 Sending csums for 1s_db/db/trade/t_mezon/db/RG4667.DBF (size=23992630) Done: 0 files, 0 bytes Got fatal error during xfer (Child exited prematurely) Backup aborted (Child exited prematurely) Not saving this as a partial backup since it has fewer files than the prior one (got 162 and 0 files versus 162) -- Alexander Moisseev -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd restore issue
Hello, I have two files (both Access DB). One with 2MB and the other with 200MB. Both are backed up with BackupPC 3.1.0 using rsyncd from my Windows-PC. If I delete the 200MB file on my Windows-PC the restore need only some minutes. If I restore both, only the first one (2MB) will be restored. After hours of duration I abort the restore process. I've also tried to chmod ugo=rwx the files in front of a restore. But alos without success. I've tried loglevel=9 and checked the RestoreLOG.1.z (208MB). Unfortunately I didn't found a error messages. Any hint how to find the reason? Thanks in advance Matthias -- Don't Panic -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Les Mikesell schrieb: Guido Schmidt wrote: So, what could cause BackupPC not to connect to the tunnel? I may have missed something in the thread, but did you change the ping command to something that would succeed? Yes. The host is publicly available, I just put it's real name into $Conf{PingCmd} = '$pingPath -c 1 -w 3 host.example.com'; (Have a look at my first posting.) Guido -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Chris Robertson schrieb: Guido Schmidt wrote: Matthias Meyer schrieb: Guido Schmidt wrote: Matthias Meyer wrote: Guido Schmidt wrote: What works? The opening and closing of the tunnel. What does not? The connection to it. Nothing in the rsyncd-logs on host.example.com. If I leave DumpPostUserCmd empty the tunnel stays open and I can use it with rsync as user backuppc on a shell providing the password by hand: rsync -av --list-only --port=32323 backu...@localhost::Alles /home/backuppc/test/ Do you provide the password during your script? The ssh-connection works (authenticated via public key). The password I refered to is for connecting to rsyncd and that is stored in $Conf{RsyncdPasswd}. It seems that backuppc does not reach the point where it actually tries to connect to rsync daemon. There are no entries in the rsyncd-log (there are when I use the rsync-command above). How can I find out more what happens and what not? I don't really know what the problem :-( You can increase the loglevel with $Conf{XferLogLevel}. I already increased it to 6, but that didn't give any more details. What happens if you start your tunnel interactive and leave DumpPreUser as well as CmdDumpPostUserCmd empty. Okay, we're getting closer. That way the backup worked. So I either get BackupPC to open the tunnel or to do the backup. That's odd. I'd try giving an explicit exit value upon successful tunnel creation. ... --- /usr/local/bin/sshtunnelcontrol.orig2009-12-22 03:16:34.0 -0900 +++ /usr/local/bin/sshtunnelcontrol 2009-12-22 03:17:09.0 -0900 @@ -27,6 +27,9 @@ if ! ps -ef|grep -E ^backuppc $PID ; then echo $PRG_NAME: Error: Tunnel does not exist exit 1 + else +echo $PRG_NAME: Info: Tunnel exists +exit 0 fi else echo $PRG_NAME: Error: ${PIDFILE} already exists. Although the script should already return 0 upon successfull completion (and it does, I tried with echo ?) I'm so desperate I gave it a try, but no, that didn't help. So, what could cause BackupPC not to connect to the tunnel? -- Schalloch Musikhandel GmbH Percussionsabteilung Firmensitz: Karolinenstraße 4-5, 20357 Hamburg Registergericht: Amtsgericht Hamburg, HRB 22770 Geschäftsführer: Christoph Scheffler Tel 040-43 84 94 Fax 040-430 29 47 Öffnungszeiten: Mo-Mi 10-19 Uhr Do+Fr 10-20 Uhr Sa10-16 Uhr Sie erreichen mich: Mo 13-19 Uhr Di 10-19 Uhr Do 11-20 Uhr Jeden 2. Sa 10-16 Uhr -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Guido Schmidt wrote: I'd try giving an explicit exit value upon successful tunnel creation. ... --- /usr/local/bin/sshtunnelcontrol.orig2009-12-22 03:16:34.0 -0900 +++ /usr/local/bin/sshtunnelcontrol 2009-12-22 03:17:09.0 -0900 @@ -27,6 +27,9 @@ if ! ps -ef|grep -E ^backuppc $PID ; then echo $PRG_NAME: Error: Tunnel does not exist exit 1 + else +echo $PRG_NAME: Info: Tunnel exists +exit 0 fi else echo $PRG_NAME: Error: ${PIDFILE} already exists. Although the script should already return 0 upon successfull completion (and it does, I tried with echo ?) I'm so desperate I gave it a try, but no, that didn't help. So, what could cause BackupPC not to connect to the tunnel? I may have missed something in the thread, but did you change the ping command to something that would succeed? -- Les Mikesell lesmikes...@gmail.com -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Matthias Meyer schrieb: Guido Schmidt wrote: Matthias Meyer wrote: Guido Schmidt wrote: What works? The opening and closing of the tunnel. What does not? The connection to it. Nothing in the rsyncd-logs on host.example.com. If I leave DumpPostUserCmd empty the tunnel stays open and I can use it with rsync as user backuppc on a shell providing the password by hand: rsync -av --list-only --port=32323 backu...@localhost::Alles /home/backuppc/test/ Do you provide the password during your script? The ssh-connection works (authenticated via public key). The password I refered to is for connecting to rsyncd and that is stored in $Conf{RsyncdPasswd}. It seems that backuppc does not reach the point where it actually tries to connect to rsync daemon. There are no entries in the rsyncd-log (there are when I use the rsync-command above). How can I find out more what happens and what not? I don't really know what the problem :-( You can increase the loglevel with $Conf{XferLogLevel}. I already increased it to 6, but that didn't give any more details. What happens if you start your tunnel interactive and leave DumpPreUser as well as CmdDumpPostUserCmd empty. Okay, we're getting closer. That way the backup worked. So I either get BackupPC to open the tunnel or to do the backup. That's odd. Why do you need the identification by rsync? I would believe you can trust your ssh-tunnel and dont't need an additional authentication. There a users with shell-access to that host. Not protecting the port would give them read-access to the whole file-system. Guido -- Schalloch Musikhandel GmbH Percussionsabteilung Firmensitz: Karolinenstraße 4-5, 20357 Hamburg Registergericht: Amtsgericht Hamburg, HRB 22770 Geschäftsführer: Christoph Scheffler Tel 040-43 84 94 Fax 040-430 29 47 Öffnungszeiten: Mo-Mi 10-19 Uhr Do+Fr 10-20 Uhr Sa10-16 Uhr Sie erreichen mich: Mo 13-19 Uhr Di 10-19 Uhr Do 11-20 Uhr Jeden 2. Sa 10-16 Uhr -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Guido Schmidt wrote: Matthias Meyer schrieb: Guido Schmidt wrote: Matthias Meyer wrote: Guido Schmidt wrote: What works? The opening and closing of the tunnel. What does not? The connection to it. Nothing in the rsyncd-logs on host.example.com. If I leave DumpPostUserCmd empty the tunnel stays open and I can use it with rsync as user backuppc on a shell providing the password by hand: rsync -av --list-only --port=32323 backu...@localhost::Alles /home/backuppc/test/ Do you provide the password during your script? The ssh-connection works (authenticated via public key). The password I refered to is for connecting to rsyncd and that is stored in $Conf{RsyncdPasswd}. It seems that backuppc does not reach the point where it actually tries to connect to rsync daemon. There are no entries in the rsyncd-log (there are when I use the rsync-command above). How can I find out more what happens and what not? I don't really know what the problem :-( You can increase the loglevel with $Conf{XferLogLevel}. I already increased it to 6, but that didn't give any more details. What happens if you start your tunnel interactive and leave DumpPreUser as well as CmdDumpPostUserCmd empty. Okay, we're getting closer. That way the backup worked. So I either get BackupPC to open the tunnel or to do the backup. That's odd. I'd try giving an explicit exit value upon successful tunnel creation. ... --- /usr/local/bin/sshtunnelcontrol.orig2009-12-22 03:16:34.0 -0900 +++ /usr/local/bin/sshtunnelcontrol 2009-12-22 03:17:09.0 -0900 @@ -27,6 +27,9 @@ if ! ps -ef|grep -E ^backuppc $PID ; then echo $PRG_NAME: Error: Tunnel does not exist exit 1 + else +echo $PRG_NAME: Info: Tunnel exists +exit 0 fi else echo $PRG_NAME: Error: ${PIDFILE} already exists. ... Why do you need the identification by rsync? I would believe you can trust your ssh-tunnel and dont't need an additional authentication. There a users with shell-access to that host. Not protecting the port would give them read-access to the whole file-system. Guido Chris -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Matthias Meyer wrote: Guido Schmidt wrote: What works? The opening and closing of the tunnel. What does not? The connection to it. Nothing in the rsyncd-logs on host.example.com. If I leave DumpPostUserCmd empty the tunnel stays open and I can use it with rsync as user backuppc on a shell providing the password by hand: rsync -av --list-only --port=32323 backu...@localhost::Alles /home/backuppc/test/ Do you provide the password during your script? The ssh-connection works (authenticated via public key). The password I refered to is for connecting to rsyncd and that is stored in $Conf{RsyncdPasswd}. It seems that backuppc does not reach the point where it actually tries to connect to rsync daemon. There are no entries in the rsyncd-log (there are when I use the rsync-command above). How can I find out more what happens and what not? -- Schalloch Musikhandel GmbH Percussionsabteilung Firmensitz: Karolinenstraße 4-5, 20357 Hamburg Registergericht: Amtsgericht Hamburg, HRB 22770 Geschäftsführer: Christoph Scheffler Tel 040-43 84 94 Fax 040-430 29 47 Öffnungszeiten: Mo-Mi 10-19 Uhr Do+Fr 10-20 Uhr Sa10-16 Uhr Sie erreichen mich: Mo 13-19 Uhr Di 10-19 Uhr Do 11-20 Uhr Jeden 2. Sa 10-16 Uhr -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd via ssh-redirected port
Guido Schmidt wrote: Matthias Meyer wrote: Guido Schmidt wrote: What works? The opening and closing of the tunnel. What does not? The connection to it. Nothing in the rsyncd-logs on host.example.com. If I leave DumpPostUserCmd empty the tunnel stays open and I can use it with rsync as user backuppc on a shell providing the password by hand: rsync -av --list-only --port=32323 backu...@localhost::Alles /home/backuppc/test/ Do you provide the password during your script? The ssh-connection works (authenticated via public key). The password I refered to is for connecting to rsyncd and that is stored in $Conf{RsyncdPasswd}. It seems that backuppc does not reach the point where it actually tries to connect to rsync daemon. There are no entries in the rsyncd-log (there are when I use the rsync-command above). How can I find out more what happens and what not? I don't really know what the problem :-( You can increase the loglevel with $Conf{XferLogLevel}. What happens if you start your tunnel interactive and leave DumpPreUser as well as CmdDumpPostUserCmd empty. Try your interactive: rsync -av --list-only --port=32323 backu...@localhost::Alles /home/backuppc/test/ If it work, start a backup via BackupPC. Why do you need the identification by rsync? I would believe you can trust your ssh-tunnel and dont't need an additional authentication. br Matthias -- Don't Panic -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd via ssh-redirected port
Dear backuppc-users, I'm happily using BackupPC 3.1.0 for quite a while. I'm now trying to backup a public host (host.example.com) via an ssh-redirected port. I don't allow any command execution on that host (and therefore cannot use the wait command), so I wrote a script (sshtunnelcontrol, see below) to open and close the tunnel when needed. It is called as DumpPreUserCmd and DumpPostUserCmd. What works? The opening and closing of the tunnel. What does not? The connection to it. Nothing in the rsyncd-logs on host.example.com. If I leave DumpPostUserCmd empty the tunnel stays open and I can use it with rsync as user backuppc on a shell providing the password by hand: rsync -av --list-only --port=32323 backu...@localhost::Alles /home/backuppc/test/ XferMethod is rsyncd. RsyncdClientPort is set to 873. I double-checked the password in /etc/BackupPC/pc/host.example.com.pl. Running /usr/local/BackupPC/bin/BackupPC_dump -v -f host.example.com didn't give more information. Thank you for any hint. Guido --- Begin of file /local/backup/pc/host.example.com/XferLOG.bad.z, modified 2009-12-17 19:50:13 --- Executing DumpPreUserCmd: /usr/local/bin/sshtunnelcontrol start host.example.com /usr/bin/ssh -CN 32323 localhost 873 backuppc 43868 SSH Tunnel Control: Opening tunnel SSH Tunnel Control: /usr/bin/ssh -CN -L 32323:localhost:873 -l backuppc -p 43868 host.example.com SSH Tunnel Control: Process ID is 24538 SSH Tunnel Control: Created /home/backuppc/sshtunnel-host.example.com.pid SSH Tunnel Control: Checking for tunnel: backuppc 24538 24537 0 19:50 ?00:00:00 /usr/bin/ssh -CN -L 32323:localhost:873 -l backuppc -p 43868 host.example.com incr backup started back to 2009-11-24 15:50:34 (backup #0) for directory Alles Error connecting to rsync daemon at localhost:32323: inet connect: Verbindungsaufbau abgelehnt Executing DumpPostUserCmd: /usr/local/bin/sshtunnelcontrol stop host.example.com SSH Tunnel Control: Killing Process 24538 SSH Tunnel Control: Done SSH Tunnel Control: Deleting /home/backuppc/sshtunnel-host.example.com.pid SSH Tunnel Control: Done Got fatal error during xfer (inet connect: Verbindungsaufbau abgelehnt) Backup aborted (inet connect: Verbindungsaufbau abgelehnt) --- End of file /local/backup/pc/host.example.com/XferLOG.bad.z, modified 2009-12-17 19:50:13 --- Begin /etc/BackupPC/pc/host.example.com.pl -- $Conf{PingMaxMsec} = 400; $Conf{RsyncArgs} = [ '--numeric-ids', '--perms', '--owner', '--group', '-D', '--links', '--hard-links', '--times', '--block-size=2048', '--recursive', '--checksum-seed=32761' ]; $Conf{RsyncShareName} = [ 'Alles' ]; $Conf{XferLogLevel} = 3; $Conf{XferMethod} = 'rsyncd'; $Conf{RsyncdUserName} = 'backuppc'; $Conf{DumpPreUserCmd} = '/usr/local/bin/sshtunnelcontrol start $client $sshPath -CN 32323 $host 873 backuppc 12345'; $Conf{DumpPostUserCmd} = '/usr/local/bin/sshtunnelcontrol stop $client'; $Conf{RsyncdClientPort} = 32323; $Conf{ClientNameAlias} = 'localhost'; $Conf{RsyncdPasswd} = ''; $Conf{UserCmdCheckStatus} = '1'; $Conf{PingCmd} = '$pingPath -c 1 -w 3 host.example.com'; End /etc/BackupPC/pc/host.example.com.pl -- Begin /usr/local/bin/sshtunnelcontrol -- #!/bin/sh TODO=$1 CLIENT=$2 SSH_PATH=$3 SSH_OPTS=$4 SSH_TUNNEL_PORT=$5 SSH_HOST=$6 RSYNC_PORT=$7 SSH_USER=$8 SSH_PORT=$9 PRG_NAME=SSH Tunnel Control BASEDIR=/home/backuppc PIDFILE=${BASEDIR}/sshtunnel-${CLIENT}.pid case $TODO in start) if [ ! -e ${PIDFILE} ]; then echo $PRG_NAME: Opening tunnel echo $PRG_NAME: $SSH_PATH $SSH_OPTS -L $SSH_TUNNEL_PORT:$SSH_HOST:$RSYNC_PORT -l $SSH_USER -p $SSH_PORT $CLIENT $SSH_PATH $SSH_OPTS -L $SSH_TUNNEL_PORT:$SSH_HOST:$RSYNC_PORT -l $SSH_USER -p $SSH_PORT $CLIENT 1/dev/null 2/dev/null #$SSH_PATH $SSH_OPTS -L $SSH_TUNNEL_PORT:$SSH_HOST:$RSYNC_PORT -l $SSH_USER -p $SSH_PORT $CLIENT PID=$! echo $PRG_NAME: Process ID is $PID echo $PID ${PIDFILE} echo $PRG_NAME: Created ${PIDFILE} echo $PRG_NAME: Checking for tunnel: if ! ps -ef|grep -E ^backuppc $PID ; then echo $PRG_NAME: Error: Tunnel does not exist exit 1 fi else echo $PRG_NAME: Error: ${PIDFILE} already exists. exit 2 fi ;; stop) if [ ! -e ${PIDFILE} ]; then echo $PRG_NAME: Error: Can not find process. $PIDFILE is missing. exit 3 else PID2KILL=`cat ${PIDFILE}` echo $PRG_NAME: Killing Process $PID2KILL kill -15 $PID2KILL echo $PRG_NAME: Done echo $PRG_NAME: Deleting $PIDFILE rm $PIDFILE echo $PRG_NAME: Done fi ;; *) echo $PRG_NAME: Parameter-error exit 4 ;; esac End /usr/local/bin/sshtunnelcontrol -- -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's
Re: [BackupPC-users] rsyncd via ssh-redirected port
Guido Schmidt wrote: Dear backuppc-users, I'm happily using BackupPC 3.1.0 for quite a while. I'm now trying to backup a public host (host.example.com) via an ssh-redirected port. I don't allow any command execution on that host (and therefore cannot use the wait command), so I wrote a script (sshtunnelcontrol, see below) to open and close the tunnel when needed. It is called as DumpPreUserCmd and DumpPostUserCmd. What works? The opening and closing of the tunnel. What does not? The connection to it. Nothing in the rsyncd-logs on host.example.com. If I leave DumpPostUserCmd empty the tunnel stays open and I can use it with rsync as user backuppc on a shell providing the password by hand: rsync -av --list-only --port=32323 backu...@localhost::Alles /home/backuppc/test/ Do you provide the password during your script? I don't know how BackupPC can know the password for the ssh connection. I believe $Conf{RsyncdUserName} and $Conf{RsyncdPasswd} refers to the rsync secrets and not to the ssh connection. I would suggest to use public/private key for ssh. br Matthias -- Don't Panic -- This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on vista 64 bit
Just for future reference: I was just now able to get this working. I simply renamed the original cygrunsrv.exe and cygwin1.dll with a -org in the name to differentiate with the new version. I then downloaded the cygrunsrv stuff out of the cygwin package and replaced those two files in the c:\rsyncd folder. Started the service and WHAM!!! It works. thanks to all who assisted me with this issue. While not a backuppc issue directly, it is helpful to those of us that wanted to use the rsyncd setup on windows. I have the 2 files I replaced if anyone else runs into this issue. On Wed, Dec 9, 2009 at 2:02 AM, Erik Hjertén erik.hjer...@companion.sewrote: Kameleon skrev: I am trying to setup the standalone rsyncd from the backuppc downloads page on a 64 bit vista machine. I have done it already on about 5 32 bit machines. Only this one fails to start the service. I see no error other than it trys to run and then nothing. Has anyone else ran into this issue and found a workaround? I don't want to use smb if I can help it. Thanks in advance. I'm running cygwin bundled in Deltacopy on Vista 64. I'm not sure if the Deltacopy team altered the cygwin-dlls in some way, but it works very well. I'm doing daily backups to a Linux based server running Backuppc via rsyncd. Deltacopy can be found here: http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp Kind regards /Erik -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on vista 64 bit
Kameleon skrev: I am trying to setup the standalone rsyncd from the backuppc downloads page on a 64 bit vista machine. I have done it already on about 5 32 bit machines. Only this one fails to start the service. I see no error other than it trys to run and then nothing. Has anyone else ran into this issue and found a workaround? I don't want to use smb if I can help it. Thanks in advance. I'm running cygwin bundled in Deltacopy on Vista 64. I'm not sure if the Deltacopy team altered the cygwin-dlls in some way, but it works very well. I'm doing daily backups to a Linux based server running Backuppc via rsyncd. Deltacopy can be found here: http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp Kind regards /Erik -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd on vista 64 bit
I am trying to setup the standalone rsyncd from the backuppc downloads page on a 64 bit vista machine. I have done it already on about 5 32 bit machines. Only this one fails to start the service. I see no error other than it trys to run and then nothing. Has anyone else ran into this issue and found a workaround? I don't want to use smb if I can help it. Thanks in advance. -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on vista 64 bit
I definitely have had this issue on my machine at home and never did resolve it. Fortunately I have Ubuntu Linux running on it now though, and no more problems :) But I am likely to hit this before too long here at work so will watch this thread eagerly -- “Don't eat anything you've ever seen advertised on TV” - Michael Pollan, author of In Defense of Food -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on vista 64 bit
Also, I may not, I did the trick to run as administrator and no go. I get the error: cygrunsrv: Error starting a service: QueryServiceStatus: Win32 error 1053: The service did not respond to the start or control request in a timely fashion. If that helps any. I am making sure it is not a gremlin by deleting the service and rebooting. Any other ideas? This works perfectly on 32-bit. On Tue, Dec 8, 2009 at 2:50 PM, Alan McKay alan.mc...@gmail.com wrote: I definitely have had this issue on my machine at home and never did resolve it. Fortunately I have Ubuntu Linux running on it now though, and no more problems :) But I am likely to hit this before too long here at work so will watch this thread eagerly -- “Don't eat anything you've ever seen advertised on TV” - Michael Pollan, author of In Defense of Food -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on vista 64 bit
Kameleon wrote at about 15:19:03 -0600 on Tuesday, December 8, 2009: Also, I may not, I did the trick to run as administrator and no go. I get the error: cygrunsrv: Error starting a service: QueryServiceStatus: Win32 error 1053: The service did not respond to the start or control request in a timely fashion. If that helps any. I am making sure it is not a gremlin by deleting the service and rebooting. Any other ideas? This works perfectly on 32-bit. If cygrunsrv is not working, I would ask on the cygwin mailing list because then we are really talking about a cygwin issue and not a BackupPC issue - the cygwin developers are really very helpful and prompt. Also, before asking or trying anything else, if you haven't already, I would try installing cygwin 1.7 (which is late beta now, about to go public, and quite stable) since that is likely to be more up-to-date and thus more Vista friendly. -- Return on Information: Google Enterprise Search pays you back Get the facts. http://p.sf.net/sfu/google-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd resume of partial backup retransmits many files
debian linux running BackupPC 3.1.0, client is Windows XP SP2 with rsync 3.0.4 (for more details see below). When I retrigger the full backup, a lot of large files are retransmitted Update: All files are retransmitted: This is a log excerpt of the pc being backuped: 2009/10/22 02:16:00 [2244] send [192.168.5.9] .musikproject/musik_u.db 28868608 f? From rsyncs doc this means: item transmitted to remote host f item is a file ? property unknown ... To cite from the rsync doc: and (3) an unknown attribute replaces each letter with a ? (this can happen when talking to an older rsync) So I think because of this rsync is retransmitting instead of finding that the files didn't change. It doesn't even try to checksum altough the logs on the other side indicate that checksums are sent (see previous mail). Please help! What is wrong here? Harald -- Jetzt kostenlos herunterladen: Internet Explorer 8 und Mozilla Firefox 3.5 - sicherer, schneller und einfacher! http://portal.gmx.net/de/go/atbrowser -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd resume of partial backup retransmits many files
I am trying to backup a machine over a low bandwidth connection. Server is debian linux running BackupPC 3.1.0, client is Windows XP SP2 with rsync 3.0.4 (for more details see below). I am currently trying to run the initial full backup but it got interrupted twice already due to various reasons. When I retrigger the full backup, a lot of large files are retransmitted even though they have already been uploaded to the server and weren't even touched in the meantime. To clarify: It seems rsync is uploading some of the previously uploaded files to the server again (see the log for one such a file in my previous mail). After the upload finished, backuppc determines that the hash is the same, detects the file to be in the pool already and goes to the next file. It does this for a whole lot of files. The first backup run was interrupted after about 9 hours. When I restarted it, after about 5 hours it was still reuploading/rechecking files which have been uploaded in the first run. Can anyone tell me what _should_ happen in this case? Maybe I didn't understand the workings of backuppc right and what I see is totally normal. Thanks -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01 -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd resume of partial backup retransmits many files
Hello, I am trying to backup a machine over a low bandwidth connection. Server is debian linux running BackupPC 3.1.0, client is Windows XP SP2 with rsync 3.0.4 (for more details see below). I am currently trying to run the initial full backup but it got interrupted twice already due to various reasons. When I retrigger the full backup, a lot of large files are retransmitted even though they have already been uploaded to the server and weren't even touched in the meantime. In the log excerpt below you can see the processing of a file that definitely has been uploaded already. I am not sure if rsync transmits the file completely again or if the blocksize is so very small that the blockhashes are almost as much data as the original file. Whatever it is, resuming takes wy too long. Is it a problem to use rsyncd and pool compression in this scenario? Please help. Regards, Harald Windows XP Client - rsync version 3.0.4 protocol version 30 Copyright (C) 1996-2008 by Andrew Tridgell, Wayne Davison, and others. Web site: http://rsync.samba.org/ Capabilities: 64-bit files, 64-bit inums, 32-bit timestamps, 64-bit long ints, socketpairs, hardlinks, symlinks, no IPv6, batchfiles, inplace, append, ACLs, no xattrs, iconv, symtimes rsyncd.conf --- [d] path = /cygdrive/d comment = Documents and Settings strict modes = false auth users = baggub secrets file = D:/Programme/develop/cygwin/etc/rsyncd.secrets hosts allow = 192.168.5.9 read only = true list = false Debian Linux Server Log --- full backup started for directory docsnsettings Connected to therapy:873, remote version 30 Negotiated protocol version 28 Got response: 96c536dccfe269b730e0053c0bfd0561 in mime: lsU23M/iabcw4AU8C/0FYQ Auth: got challenge: lcPTIMTn7tfds46eQF+PFw, reply: baggub lsU23M/iabcw4AU8C/0FYQ Connected to module docsnsettings Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . . Checksum seed is 1255314593 Got checksumSeed 0x4ad294a1 [..] Got file (244 of 387): .kde/share/apps/amarok/collection.db [..] /var/lib/backuppc/pc/therapy/0/fdocsnsettings/f.kde/fshare/fapps/famarok/fcollection.db cache = , invalid = , phase = 0 Sending csums for .kde/share/apps/amarok/collection.db (size=6002688) [..] Starting file 191 (.kde/share/apps/amarok/collection.db), blkCnt=2931, blkSize=2048, remainder=2048 .kde/share/apps/amarok/collection.db: blk=, newData=4096, rxMatchBlk=0, rxMatchNext=0 .kde/share/apps/amarok/collection.db: blk=2099, newData=0, rxMatchBlk=0, rxMatchNext=0 .kde/share/apps/amarok/collection.db: blk=3, newData=0, rxMatchBlk=2099, rxMatchNext=2100 .kde/share/apps/amarok/collection.db: blk=, newData=7168, rxMatchBlk=3, rxMatchNext=4 .kde/share/apps/amarok/collection.db: blk=2097, newData=0, rxMatchBlk=, rxMatchNext=4 .kde/share/apps/amarok/collection.db: blk=2099, newData=0, rxMatchBlk=2097, rxMatchNext=2098 .kde/share/apps/amarok/collection.db: blk=, newData=23552, rxMatchBlk=2099, rxMatchNext=2100 [...] rxMatchNext=2100 .kde/share/apps/amarok/collection.db: blk=, newData=30720, rxMatchBlk=, rxMatchNext=2100 .kde/share/apps/amarok/collection.db: blk=, newData=0, rxMatchBlk=, rxMatchNext=2100 .kde/share/apps/amarok/collection.db got digests 79fcd46f9cecf0e252718c1c0959dd2c vs 79fcd46f9cecf0e252718c1c0959dd2c pool 700 4294967295/4294967295 6002688 .kde/share/apps/amarok/collection.db attribSet(dir=fdocsnsettings/.kde/share/apps/amarok, file=collection.db, size=6002688, placeholder=) -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01 -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Rsyncd --sparse flag
Hi, Does backuppc support the --sparse flag for rsyncd remote backups - searching for answers led me to 'probably not' in an old post. If it is supported, any benefit of using it with my famous database backup dumps? Thanks Nigel -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd --sparse flag
On Fri, Aug 28, 2009 at 11:55:35AM +0100, Nigel Kendrick wrote: Does backuppc support the --sparse flag for rsyncd remote backups - searching for answers led me to 'probably not' in an old post. I don't know for sure, but I doubt it since BackupPC_dump will probably just produce zeroes and compress them. If it is supported, any benefit of using it with my famous database backup dumps? No, you wouldn't benefit since your database dumps will probably not contain long chains of zero bytes. Tino. -- What we nourish flourishes. - Was wir nähren erblüht. www.lichtkreis-chemnitz.de www.craniosacralzentrum.de -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on Vista 64-bit cygwin vs SUA
Koen Linders skrev: I don't know what you mean with SUA environment, but I use Deltacopy in Vista 64 bit via rsyncd. http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp Works without a problem atm. Easy to use and you can copy the files to other computers and easily register the service. I second that. Works like a charm. Cheers /Erik -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on Vista 64-bit cygwin vs SUA
Koen Linders wrote: I don't know what you mean with SUA environment, but I use Deltacopy in ^^ It's Microsoft Subsystem for UNIX-based Applications: http://technet.microsoft.com/en-us/library/cc779522(WS.10).aspx Regards, Bernhard -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on Vista 64-bit cygwin vs SUA
Koen Linders wrote: I don't know what you mean with SUA environment, but I use Deltacopy in Vista 64 bit via rsyncd. http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp Works without a problem atm. Easy to use and you can copy the files to other computers and easily register the service. Greetings, Koen Linders So I will have to play around with DeltaCopy (yet another win-client-solution ;-))! Thanks, Bernhard -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd on Vista 64-bit cygwin vs SUA
Hi, anyone successfully using the SUA environment for backing up a windows vista 64bit client via ssh-rsync or rsyncd? I failed running cygwin on Vista Business 6.0 64-bit and considered giving MS a chance ... Any comments very much appreciated, thanks in advance, Bernhard -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd on Vista 64-bit cygwin vs SUA
I don't know what you mean with SUA environment, but I use Deltacopy in Vista 64 bit via rsyncd. http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp Works without a problem atm. Easy to use and you can copy the files to other computers and easily register the service. Greetings, Koen Linders -Oorspronkelijk bericht- Van: Bernhard Ott [mailto:bernhard@gmx.net] Verzonden: dinsdag 18 augustus 2009 0:21 Aan: backuppc-users@lists.sourceforge.net Onderwerp: [BackupPC-users] rsyncd on Vista 64-bit cygwin vs SUA Hi, anyone successfully using the SUA environment for backing up a windows vista 64bit client via ssh-rsync or rsyncd? I failed running cygwin on Vista Business 6.0 64-bit and considered giving MS a chance ... Any comments very much appreciated, thanks in advance, Bernhard -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd over ssh
daniel wrote at about 10:53:23 -0400 on Thursday, May 21, 2009: Hi Joe, This is exactly what I am looking for at the moment. Can you please post you changes? Am I the only one who has NO CLUE what he is talking about? - What exactly is the 'this' that you are looking for? - Who is the 'you' that you want to post something? (Joe???) - What 'changes' need to be posted? And if you wanted something from a particular 'Joe' that only you two know about, why spam the entire list? I am beginning to sympathize with Holger's frustrations with Backup Central and people who think this is a topic-based forum rather than a mailing list. Cheers, Daniel. +-- |This was sent by dan...@amristar.com.au via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd over ssh
Hi Jeffrey, At the risk of spamming the list again, I apologise. I only joined the list and the forum immediately before the post. And, I agree that I *thought* this is a topic-based forum rather than a mailing list - I went to www.backupcentral.com, selected the menu Forums and them Open Source BackupPC - it looked like a forum to me. Now I know :-) Anyway, the (mailing list) post I was referring to was http://www.backupcentral.com/phpBB2/two-way-mirrors-of-external-mailing-lists-3/backuppc-21/rsyncd-over-ssh-79117/ which relates to running BackupPC using rsync's daemon mode tunnelled over SSH. I've since got Joe's modifications which enable this and I'll let you know how I get on. FYI, the key issue for me is that I want to tunnel over SSH, but am not happy to allow un-checked root access to the target machine(s) - rsync's daemon mode tunnelled over SSH is a good balance. Cheers, Daniel. On Thu, 2009-05-21 at 15:35 -0400, Jeffrey J. Kosowsky wrote: daniel wrote at about 10:53:23 -0400 on Thursday, May 21, 2009: Hi Joe, This is exactly what I am looking for at the moment. Can you please post you changes? Am I the only one who has NO CLUE what he is talking about? - What exactly is the 'this' that you are looking for? - Who is the 'you' that you want to post something? (Joe???) - What 'changes' need to be posted? And if you wanted something from a particular 'Joe' that only you two know about, why spam the entire list? I am beginning to sympathize with Holger's frustrations with Backup Central and people who think this is a topic-based forum rather than a mailing list. Cheers, Daniel. +-- |This was sent by dan...@amristar.com.au via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Rsyncd and WinXP
Dear All, I apologise for re-visiting this, but I am having difficulty backing up a WinXP machine over rync. I am using Backuppc version 3.1.0, and cygwin's rsync on the WinXP box. When I issue a fuill backup, I get the following message in backuppc Executing DumpPostUserCmd: /home/backuppc/Bin/NotifyUsers -h -u *...@ -m ** -c 0 -t full -s hr_info Got fatal error during xfer (chdir failed) Backup aborted (chdir failed) I have blanked out the email address, host and user for this email. I then went and looked on the WinXP in the rsync.log file and I get the following message, 2009/05/01 16:39:23 [4024] rsync: chdir /cygdrive/c/WINDOWS/system32/f:/Alvina_PET/HR_Info failed Has anyone else seen this, or can someone point me in the direction of a solution, thanks Peter -- Register Now Save for Velocity, the Web Performance Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd and WinXP
Hi, Peter Bloomfield wrote on 2009-05-01 16:56:45 -0400 [[BackupPC-users] Rsyncd and WinXP]: [...] backing up a WinXP machine over rync. I take it that is actually missing a d as well as the s? ;-) [...] Got fatal error during xfer (chdir failed) Backup aborted (chdir failed) [...] I then went and looked on the WinXP in the rsync.log file and I get the following message, 2009/05/01 16:39:23 [4024] rsync: chdir /cygdrive/c/WINDOWS/system32/f:/Alvina_PET/HR_Info failed Has anyone else seen this, or can someone point me in the direction of a solution, thanks I take it your rsyncd.conf contains a path specification f:/Alvina_PET/HR_Info. Apparently, rsyncd is interpreting this as a relative path. You probably need to use something like /cygdrive/f/Alvina_PET/HR_Info instead. Hope that helps. Regards, Holger -- Register Now Save for Velocity, the Web Performance Operations Conference from O'Reilly Media. Velocity features a full day of expert-led, hands-on workshops and two days of sessions from industry leaders in dedicated Performance Operations tracks. Use code vel09scf and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd to import off site backup
Hi all, I'm using the import data for a backup on the wiki to import 20 GB of files (I don't want to transfer that over xDSL). I just follow the tips and tricks entry in the wiki. It did work before, but now I'm having an rsyncd issue (I think). It might be possible that rsync has been updated, at the moment it's 3.0.4. As soon as I use the [/srv/] path, it doesn't work. Rsync logs this as soon as I connect: rsyncd[23507]: Warning: invalid section name in configuration file: /srv/ But when I use the [srv] path, it doesn't do that and just allows connections. The problem is that when I switch over to real backup, it won't be correct since (in backuppc) we're using rsync and we need the '/srv' sharename. Does anyone have any idea on how we can workaround this? regards, Kristof -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd to import off site backup
On 03/05 11:22 , stoffell wrote: rsyncd[23507]: Warning: invalid section name in configuration file: /srv/ Sure you're not missing a semicolon somewhere, or some other typo in the config files? -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd to import off site backup
On Thu, Mar 5, 2009 at 3:18 PM, Carl Wilhelm Soderstrom chr...@real-time.com wrote: On 03/05 11:22 , stoffell wrote: rsyncd[23507]: Warning: invalid section name in configuration file: /srv/ Sure you're not missing a semicolon somewhere, or some other typo in the config files? that's not the problem. we managed to figure out why it doesn't work. As of rsync v3.0.? the [/srv/] is not allowed anymore. You can only use [srv], /'s are not allowed. When using rsync v2.6.9 (on debian etch) it works without any problem. So it's related to the version of rsync. :-( Regards, Kristof. -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd info
Hi I was just wondering what rsync does when running rsyncd on the client if a full backup fails. Does it try and continue from where it left off on the next run ? Also for the next full backup I assume it does a complete copy ? Thanks Terry -- Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Rsyncd - probability that it trashed my drive?
I just installed Rsyncd on my XP Pro machine and performed a full backup. Fourty-eight hours later my drive seems hosed. I have run a drive check and it won't complete, it sticks at 82%. The drive check as finding a nunmber of bad clusters and repairing files. To be fair I also allowed the Windows SP3 install in the same 48 hour window between no problems and problems. I also allowed a Java upgrade. I know, I know, what was I thinking! Anyway...what are the chances that rsyncd was responsible for the drive going down by somehow scrambling the data or some other unintended problem? Has anybody running rsyncd on XP Pro machines had any other problems to report? Thanks, Eric - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd - probability that it trashed my drive?
[EMAIL PROTECTED] wrote: nunmber of bad clusters and repairing files. Bad clusters usually indicate a failing drive. Doug -- Ben Franklin quote: Those who would give up Essential Liberty to purchase a little Temporary Safety, deserve neither Liberty nor Safety. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd - probability that it trashed my drive?
[EMAIL PROTECTED] wrote: I just installed Rsyncd on my XP Pro machine and performed a full backup. Fourty-eight hours later my drive seems hosed. I have run a drive check and it won't complete, it sticks at 82%. The drive check as finding a nunmber of bad clusters and repairing files. To be fair I also allowed the Windows SP3 install in the same 48 hour window between no problems and problems. I also allowed a Java upgrade. I know, I know, what was I thinking! Anyway...what are the chances that rsyncd was responsible for the drive going down by somehow scrambling the data or some other unintended problem? Has anybody running rsyncd on XP Pro machines had any other problems to report? I think the issue is that you had bad clusters, and one of the things you installed happened to land on some of those bad clusters. The bad clusters probably went unnoticed until you tried to actually use them. I've used rsyncd on a couple XP Pro machines with no problems. -Rob The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you are not the addressee, any disclosure, reproduction, copying, distribution, or other dissemination or use of this transmission in error please notify the sender immediately and then delete this e-mail. E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. If verification is required please request a hard copy version. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd - probability that it trashed my drive?
On 11/20 05:18 , [EMAIL PROTECTED] wrote: Anyway...what are the chances that rsyncd was responsible for the drive going down by somehow scrambling the data or some other unintended problem? Has anybody running rsyncd on XP Pro machines had any other problems to report? BackupPC puts substantial additional load on disks, because it forces them to seek every file, and on a heavily fragmented filesystem this can add up to a lot of head movement which would normally not take place. So a drive which might have been marginal before, might fail when you do the backup of it. I've had this happen to me once or twice (once with disastrous consequences when I found that the new external drive enclosure I was using for the backuppc data pool was no good, so I lost the backup that caused the client disk to fail, and then discovered that the LVM RAID I had been using to give me a redundant client disk had stopped replicating a year before and not given me any signs I recognized... fortunately it was only my own data, and not someone else's that I lost). So be aware that this can happen. -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd - probability that it trashed my drive?
disk failure brought on by stress. thats my diagnostic. On Thu, Nov 20, 2008 at 8:14 AM, Carl Wilhelm Soderstrom [EMAIL PROTECTED] wrote: On 11/20 05:18 , [EMAIL PROTECTED] wrote: Anyway...what are the chances that rsyncd was responsible for the drive going down by somehow scrambling the data or some other unintended problem? Has anybody running rsyncd on XP Pro machines had any other problems to report? BackupPC puts substantial additional load on disks, because it forces them to seek every file, and on a heavily fragmented filesystem this can add up to a lot of head movement which would normally not take place. So a drive which might have been marginal before, might fail when you do the backup of it. I've had this happen to me once or twice (once with disastrous consequences when I found that the new external drive enclosure I was using for the backuppc data pool was no good, so I lost the backup that caused the client disk to fail, and then discovered that the LVM RAID I had been using to give me a redundant client disk had stopped replicating a year before and not given me any signs I recognized... fortunately it was only my own data, and not someone else's that I lost). So be aware that this can happen. -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd - probability that it trashed my drive?
Makes sense. New drive is in now getting formatted. I will of course, see what I can salvage off the old drive. This computer was a used computer off ebay and shipped about 6 months ago, it may have had some head slap in shipping. That is why I think lots of drive activity causing the existing problem to show up makes sense. One more thing...THANK GOD for BackupPC! Awesome software! I appreciate deeply that I have a set of critical files ready to be restored on the new drive. Thanks Craig (and whoever else) for doing this project. Thanks, Eric Carl Wilhelm Soderstrom wrote: On 11/20 05:18 , [EMAIL PROTECTED] wrote: Anyway...what are the chances that rsyncd was responsible for the drive going down by somehow scrambling the data or some other unintended problem? Has anybody running rsyncd on XP Pro machines had any other problems to report? BackupPC puts substantial additional load on disks, because it forces them to seek every file, and on a heavily fragmented filesystem this can add up to a lot of head movement which would normally not take place. So a drive which might have been marginal before, might fail when you do the backup of it. I've had this happen to me once or twice (once with disastrous consequences when I found that the new external drive enclosure I was using for the backuppc data pool was no good, so I lost the backup that caused the client disk to fail, and then discovered that the LVM RAID I had been using to give me a redundant client disk had stopped replicating a year before and not given me any signs I recognized... fortunately it was only my own data, and not someone else's that I lost). So be aware that this can happen. No virus found in this incoming message. Checked by AVG - http://www.avg.com Version: 8.0.175 / Virus Database: 270.9.8/1801 - Release Date: 11/20/2008 9:11 AM - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd - probability that it trashed my drive?
On Thu, Nov 20, 2008 at 12:06 PM, Eric Snyder [EMAIL PROTECTED] wrote: Makes sense. New drive is in now getting formatted. I will of course, see what I can salvage off the old drive. This computer was a used computer off ebay and shipped about 6 months ago, it may have had some head slap in shipping. That is why I think lots of drive activity causing the existing problem to show up makes sense. One more thing...THANK GOD for BackupPC! Awesome software! I appreciate deeply that I have a set of critical files ready to be restored on the new drive. Thanks Craig (and whoever else) for doing this project. Thanks, Eric just to play devil's advocate here, you could also be looking at a bad chipset. I cant recall if you said it was SATA or IDE but heat buildup in the case or a dislodged heatsink on some chipsets can lead to disk corruption. Consider looking in the case after the system has been running for a while, is the chipset hot? Is it too cool? If it is too hot you may just need to add a fan. If it is too cool your heatsink may not be attatched properly. Also, power fluctuations in the power supply can lead to disk corruption. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd on XP
Eric Snyder wrote: I was having problems with SMB on XP pro so have shifted gears and am trying Rsyncd. I ran a full backup of the cDrive setup. The problem is that I am using a backup user I created that is part of the user group Backup Operators. I do get files backed up but... The only files I get in the Documents and Settings folder is the backup user's files (basically empty). There are other users there and I need to get those files backed up as well. There seems to be a permission problem and I can't get the other users files backed up I have a domain user as part of the backup group, called ... what else? Wait for it! backup Here is my config. [cDrive] path = c: comment = Entire Drive auth users = backup secrets file = c:/rsyncd/rsyncd.secrets # hosts allow = 172.16.0.17 strict modes = false read only = false list = false - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Rsyncd on XP
I was having problems with SMB on XP pro so have shifted gears and am trying Rsyncd. I ran a full backup of the cDrive setup. The problem is that I am using a backup user I created that is part of the user group Backup Operators. I do get files backed up but... The only files I get in the Documents and Settings folder is the backup user's files (basically empty). There are other users there and I need to get those files backed up as well. There seems to be a permission problem and I can't get the other users files backed up. How do I get all the users files backed up using Rsynced? Config file: [cDrive] path = c: comment = Entire Drive auth users = removed,removed secrets file = c:/rsyncd/rsyncd.secrets # hosts allow = 172.16.0.17 strict modes = false read only = true list = false - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd on XP
Eric Snyder wrote: I was having problems with SMB on XP pro so have shifted gears and am trying Rsyncd. I ran a full backup of the cDrive setup. The problem is that I am using a backup user I created that is part of the user group Backup Operators. I do get files backed up but... The only files I get in the Documents and Settings folder is the backup user's files (basically empty). There are other users there and I need to get those files backed up as well. There seems to be a permission problem and I can't get the other users files backed up. How do I get all the users files backed up using Rsynced? Config file: [cDrive] path = c: comment = Entire Drive auth users = removed,removed secrets file = c:/rsyncd/rsyncd.secrets # hosts allow = 172.16.0.17 strict modes = false read only = true list = false Does your rsyncd.conf file have a line like: uid = someuser This is the user that that the rsync daemon runs as. Mine is set to be my backup user. I'm not sure what the default is, but if it's uid = administrator, that might not give you enough rights to see everything. I'm pretty sure it needs to be run as someone who is in the Backup Operators group. Additionally, on my systems I found that some files were not readable by the Backup Operators group. That made it impossible for me to backup those files until I fixed the problem. -Rob The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you are not the addressee, any disclosure, reproduction, copying, distribution, or other dissemination or use of this transmission in error please notify the sender immediately and then delete this e-mail. E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. If verification is required please request a hard copy version. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd connection stalled
I started a backup from a new workstation and I can see the rsyncd connection with lsof -i but tcpdump shows no traffic passing over it. What would cause BackupPC_dump to stall? I also have another backup in progress from another system and I see lots of traffic from its rsyncd port. Is this situation normal? - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd connection stalled
I notice on the general status page that both clients have PIDs but that the client with network activity has a transfer PID. Does only one client at a time transfer? - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd in linux
when i use this command rsync [EMAIL PROTECTED]:: i got this : rsync : failed to connect to servername : connection refused(111) rsync error : error in socket IO (code 10) at /home/lapo/packaging/tmp/rsync-2.6.9/clientserver.c (104) [receiver=2.6.9] thanks 2008/7/31 fatima ech-charif [EMAIL PROTECTED] hi this my file of configuration rsyncd.conf: i open directory /etc in linux and i edit this file rsyncd.conf #gid =user max connections = 0 # transfer logging = true log format = %h %o %f %l %b log file = /var/log/rsyncd.log [docs] path = /home read only = no uid = root gid = nogroup list = yes auth users = backuppc secrets file = /etc/rsyncd.secrets thanks 2008/7/29 Jean-Michel Beuken [EMAIL PROTECTED] Hello, If rsyncd is configured properly and running, you should be able to issue this command to get a list of modules offered by the rsyncd server: rsync [EMAIL PROTECTED]:: (yes, 2 colons) This assumes that you have set list = true for each of the modules in the rsyncd.conf on the source server. I think it is the default (see man page) because without the line list = true in the rsyncd.conf, I can list the modules... jmb - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd in linux
Hi Am Donnerstag, den 31.07.2008, 09:53 + schrieb fatima ech-charif: rsync : failed to connect to servername : connection refused(111) did you configure the rsyncd on the client side? the error looks like that you have no running server. Renke -- rbrausse ferdinand-kopf-str 7 79117 freiburg germany, old europe +497613845491 http://gss-konstanz.de/8-kerne-und-nen-typ/ signature.asc Description: Dies ist ein digital signierter Nachrichtenteil - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd in linux
On Thu, Jul 31, 2008 at 4:53 PM, fatima ech-charif [EMAIL PROTECTED] wrote: when i use this command rsync [EMAIL PROTECTED]:: i got this : rsync : failed to connect to servername : connection refused(111) rsync error : error in socket IO (code 10) at /home/lapo/packaging/tmp/rsync-2.6.9/clientserver.c (104) [receiver=2.6.9] thanks Are you backing up linux client? If yes, please use rsync: http://taksuyama.com/?page_id=7 If the client is windows xp, please use rsyncd http://taksuyama.com/?page_id=8 David - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd in linux
Hi, fatima ech-charif wrote on 2008-07-29 10:11:34 + [[BackupPC-users] rsyncd in linux]: hi how to configure rsyncd in linux ubuntu same as always ... read the docs and relevant man pages. because i have this problem full backup started for directory docs (baseline backup #18) Got fatal error during xfer (inet connect: Connection refused) Backup aborted (inet connect: Connection refused) That's not a BackupPC issue. Your rsyncd is not running or there's a firewall in between or the IP address is wrong or ... Narrowing down a problem has to be done where the problem is, not where people have to guess about just about everything. Regards, Holger - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsyncd in linux
On Tue, Jul 29, 2008 at 10:50 AM, Rob Owens [EMAIL PROTECTED] wrote: fatima ech-charif wrote: hi how to configure rsyncd in linux ubuntu because i have this problem full backup started for directory docs (baseline backup #18) Got fatal error during xfer (inet connect: Connection refused) Backup aborted (inet connect: Connection refused) thanks I recommend that you test rsyncd from a terminal on another machine, instead of with BackupPC (to minimize the potential spots for error). If rsyncd is configured properly and running, you should be able to issue this command to get a list of modules offered by the rsyncd server: rsync [EMAIL PROTECTED]:: (yes, 2 colons) This assumes that you have set list = true for each of the modules in the rsyncd.conf on the source server. -Rob The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you are not the addressee, any disclosure, reproduction, copying, distribution, or other dissemination or use of this transmission in error please notify the sender immediately and then delete this e-mail. E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. If verification is required please request a hard copy version. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Jonathan Craig - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd on Win XP and stalled backups
Dear list, For a while now I've been testing out backuppc pc, and running it for real at home with SMB shares. But now I'm implementing it for work I need to test, test, test, test, etc. So I've set it up using the rsyncd package from Backuppc.sourceforge. And accessing it through a openvpn. Which incidentally does compression and encryption on it's own, so no need for ssh ;-) All is working quite wonderfully with 3.1.0. Backups are being made, full and incremental's. When a client shutsdown via the Startmenu (windows still), the backup gets canceled and a partial is saved. /But/ when the client simply dissapears from radar (cable is janked out, or laptop is placed in suspend mode) the rsync transfer stalls in lack of a better word for it. The backuppc's webpage for the client simply states Backup in progress forever and never time's out. Even with the --timeout=120 option added to RsyncArgs. Plus, when the client reappears, the backup does not continue... :-( It has to get cancelled by me, before the next backup can be initiated. Has anyone had the same things happening? Thanks, -- Mark Maas Unix Beheerder T +31 (0)20 522 0707 F +31 (0)20 320 4176 I www.binck.nl BinckBank N.V. Vijzelstraat 20 1017 HK Amsterdam Deze e-mail en zijn bijlagen zijn uitsluitend bestemd voor de geadresseerde(n) als op dit e-mailblad vermeld. Het is mogelijk dat deze e-mail persoonlijke en/of vertrouwelijke informatie bevat. Wanneer u niet de geadresseerde bent, verzoeken wij u dringend ons daarvan te berichten. Elke verspreiding, vermenigvuldiging, gebruik of openbaarmaking aan derden van de inhoud van deze e-mail en zijn bijlagen, is verboden. Hoewel deze informatie met de meeste zorg is samengesteld is BinckBank N.V. op geen enkele wijze aansprakelijk voor eventuele fouten, omissies of andere onjuistheden in deze informatie of de gevolgen daarvan noch op enigerlei wijze gebonden aan de inhoud van de e-mail of zijn bijlagen. Gelieve, in geval van onjuiste of onvolledige ontvangst, deze e-mail terug te sturen naar de afzender. This e-mail and its attachments are only intended for the individual(s) or entity(entities) named above to whom they are addressed and may contain personal and/or confidential information. Please notify us immediately if you are not the intended recipient. Any dissemination, duplication, publication to third parties or other use of the contents of this e-mail or its attachments is forbidden. BinckBank N.V. shall not accept any responsibility for any errors, omissions or other inaccuracies in this information or for the consequences thereof, nor shall it be bound in any way by the contents of this e-mail or its attachments. In the event of incomplete or incorrect transmission please return the e-mail to the sender. - Check out the new SourceForge.net Marketplace. It's the best place to buy or sell services for just about anything Open Source. http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Rsyncd transfer speed
Hello, is there a way to speed up transfer via rsyncd, the last backup was at 0,9 MB/s. The network is 100Mb, the backup was made on local disk (no USB involved), except the include list was involved and there is a lot of empty directories. Bye, Alan - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd transfer speed
Alan Orlic( Belšak wrote: Hello, is there a way to speed up transfer via rsyncd, the last backup was at 0,9 MB/s. The network is 100Mb, the backup was made on local disk (no USB involved), except the include list was involved and there is a lot of empty directories. Bye, Alan It's almost certainly not rsyncd that is the hold up - next time it runs take a look a cpu load, disk activity and network activity - I'd be willing to bet that you're disk bound. Do you have rsync checksum caching enabled? It normally makes a big difference. John - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd transfer speed
iftop, iostat, top. your best friends :) On Mon, Feb 25, 2008 at 9:16 AM, John Pettitt [EMAIL PROTECTED] wrote: Alan Orlic( Belšak wrote: Hello, is there a way to speed up transfer via rsyncd, the last backup was at 0,9 MB/s. The network is 100Mb, the backup was made on local disk (no USB involved), except the include list was involved and there is a lot of empty directories. Bye, Alan It's almost certainly not rsyncd that is the hold up - next time it runs take a look a cpu load, disk activity and network activity - I'd be willing to bet that you're disk bound. Do you have rsync checksum caching enabled? It normally makes a big difference. John - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Rsyncd/Samba include/exclude
Hello, probably this has been answered several times, but here I go again - as I found out, there is no way to backup Windows machines via Samba for some files only (like DOC, XLS, etc), but I was unable to find the solution how to do that via rsyncd. I don't like to backup the whole PC, only documents. If somebody has a solution, I'll be more than happy. Bye, Alan - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Rsyncd/Samba include/exclude
Alan Orlic( Belšak wrote: Hello, probably this has been answered several times, but here I go again - as I found out, there is no way to backup Windows machines via Samba for some files only (like DOC, XLS, etc), but I was unable to find the solution how to do that via rsyncd. I don't like to backup the whole PC, only documents. If somebody has a solution, I'll be more than happy. I think the only common problem is with files that some other program has open and locked. Is this a character set issue in the filenames? -- Les Mikesell [EMAIL PROTECTED] - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] rsyncd over ssh
I decided that the best way to handle rsync security is with rsync in daemon mode, over ssh, with sudo. The advantages are that rsync daemon mode allows for chroot and a lot of access controls, but running a normal rsync daemon could leave some local access security holes, and id very restricted by many SELinux security configurations. I now have set up an ssh authorized_key to an unprivileged account, which runs sudo to start rsync in daemon mode, with a specific rsyncd.conf. (Earlier, I didn't realize that sudo can limit command arguments as well as executables.) The rsyncd.conf enforce restrictions better than my previous attempt at an rsync proxy command. I have this working for BackupPC. It required a bit of hacking to merge rsync and rsyncd connections in File::RsyncP.pm, which is implemented outside of the RsyncP.pm module. I hacked the option to use it into BackupPC/Xfer/Rsync.pm by using this method when rsyncd is selected with a port value of zero. Joe Krahn - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/