Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Robin Lee Powell
On Tue, Dec 15, 2009 at 05:42:55PM -0800, Robin Lee Powell wrote: > Just to give a sense of scale here: > > # date ; find /pictures -xdev -type f -printf "%h\n" >/tmp/dirs ; date > Tue Dec 15 12:50:57 PST 2009 > Tue Dec 15 17:26:44 PST 2009 > > (something I ran to try to figure out how to partiti

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Carl Wilhelm Soderstrom
On 12/15 05:42 , Robin Lee Powell wrote: > The other one isn't even close to finishing, as far as I can tell. > In the face of it taking nigh-on 5 hours just to *walk the tree*, > from the local host, I haven't been focusing on little things like > ssh encryption choices too much. :) So you're co

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Carl Wilhelm Soderstrom
On 12/16 06:38 , Carl Wilhelm Soderstrom wrote: > On 12/15 05:42 , Robin Lee Powell wrote: > > The other one isn't even close to finishing, as far as I can tell. > > In the face of it taking nigh-on 5 hours just to *walk the tree*, > > from the local host, I haven't been focusing on little things l

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Les Mikesell
Robin Lee Powell wrote: > On Tue, Dec 15, 2009 at 05:42:55PM -0800, Robin Lee Powell wrote: >> Just to give a sense of scale here: >> >> # date ; find /pictures -xdev -type f -printf "%h\n" >/tmp/dirs ; date >> Tue Dec 15 12:50:57 PST 2009 >> Tue Dec 15 17:26:44 PST 2009 >> >> (something I ran to t

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Ralf Gross
Robin Lee Powell schrieb: > RedHat GFS *really* doesn't like directories with large numbers of > files. It's not a big fan of stat() calls, either. Well, a network Cluster Filesystem is no fun to backup and might very well be the bottleneck. Ralf ---

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Robin Lee Powell
I want to start by saying that I appreciate all the help and suggestions y'all have given on something that's obviously not your problem. :) Unfortunately, it looks like this problem is (1) far more interesting than I thought and (2) might be in BackupPC itself. On Tue, Dec 15, 2009 at 11:29:46A

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Robin Lee Powell
Sorry, a couple of things I forgot. On Wed, Dec 16, 2009 at 11:15:37AM -0800, Robin Lee Powell wrote: > Anyways, the one that has the problem consistently *also* always has > it in exactly the same place; I was watching it in basically every > way possible, so here comes the debugging stuff. As w

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Robin Lee Powell
On last thing: Stop/Dequeue Backup did the right thing: all parts of the backup, on both server and client, were torn down correctly. So, clearly, there was nothing wrong with the communication between parts as such. -Robin -- They say: "The first AIs will be built by the military as weapons.

Re: [BackupPC-users] pools are showing data but clients have no backups

2009-12-16 Thread Sabuj Pattanayek
Hi, Added some debugging code to Storage/Text.pm sub TextFileWrite, it used to look like this : rename("$file.new", "$file") if ( -f "$file.new" ); I changed it to : if ( -f "$file.new" ) { my $renRet = rename("$file.new", "$file"); if ($renRet) {

Re: [BackupPC-users] Backuppc only works from the command line

2009-12-16 Thread Chris Robertson
M. Sabath wrote: > Hello all, > > I use backuppc on Debian 5. > Since I upgraded from Debian 4 to Debian 5 backuppc doesn't run > automatically. > > Our server runs only during daytime between 7am and 19 pm > Let me see if I have this right... Your server is only powered on from 7 am to 7 pm.

[BackupPC-users] Slow link options

2009-12-16 Thread Kameleon
I have a few remote sites I am wanting to backup using backuppc. However, two are on slow DSL connections and the other 2 are on T1's. I did some math and roughly figured that the DSL connections, having a 256k upload, could do approximately 108MB/hour of transfer. With these clients having around

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Les Mikesell
Robin Lee Powell wrote: > > They're just not *doing* anything. Nothing has errored out; BackupPC > thinks everything is fine. > > Some of the places this is happening are very small backups that > usually take a matter of minutes. > > Suddenly this isn't looking like a networking problem anymor

Re: [BackupPC-users] Slow link options

2009-12-16 Thread Chris Robertson
Kameleon wrote: > I have a few remote sites I am wanting to backup using backuppc. > However, two are on slow DSL connections and the other 2 are on T1's. > I did some math and roughly figured that the DSL connections, having a > 256k upload, could do approximately 108MB/hour of transfer. With t

Re: [BackupPC-users] An idea to fix both SIGPIPE and memory issues with rsync

2009-12-16 Thread Robin Lee Powell
On Wed, Dec 16, 2009 at 03:13:23PM -0600, Les Mikesell wrote: > Robin Lee Powell wrote: > > > > They're just not *doing* anything. Nothing has errored out; BackupPC > > thinks everything is fine. > > > > Some of the places this is happening are very small backups that > > usually take a matter o

[BackupPC-users] problem with smb transfers

2009-12-16 Thread Omid
so i've set up my backuppc server again (we got a bunch of new drives and new server) and rather than upgrade, i just did a fresh installation. so i've migrated my settings from v2.1 to v3.2.0beta0, and i'm having a problem with smb transfers. they seem to fail. here's a sample xfer error log fi

[BackupPC-users] problem with smb transfers (solved)

2009-12-16 Thread Omid
(unfortunately i don't receive copies of my own emails, but...) i figured out what was going on. (or google did... of course...) from the page: https://bugs.launchpad.net/ubuntu/+source/backuppc/+bug/283652 "I believe that the fix you need is to edit /etc/backuppc/config.pl. There are three st

Re: [BackupPC-users] Backuppc only works from the command line

2009-12-16 Thread M. Sabath
Am Mittwoch, den 16.12.2009, 11:27 -0900 schrieb Chris Robertson: > M. Sabath wrote: > > Hello all, > > > > I use backuppc on Debian 5. > > Since I upgraded from Debian 4 to Debian 5 backuppc doesn't run > > automatically. > > > > Our server runs only during daytime between 7am and 19 pm > > >