Re: [Eug-lug] rsync problems

2008-03-04 Thread Bob Miller
Rob Hudson wrote: > I'm helping a friend set up a sort of backup solution. He's got a > co-located Linux web server, and a Linux file server in his office > behind a firewall. I set up an rsync script to synchronize (pull) all > the web files down at night. The problem is that it's dying about

Re: [Eug-lug] rsync problems

2008-03-03 Thread Alan
On Mon, March 3, 2008 9:29 am, Rob Hudson wrote: > Hi LUG, I set up an rsync script to synchronize (pull) all > the web files down at night. The problem is that it's dying about 25% > of the way through. From the log error output it appears that since > rsync can sometimes take a bit of time, so

Re: [Eug-lug] rsync problems

2008-03-03 Thread Hal Pomeranz
> > Are you using the "--partial" option for rsync? > > No, but I just read the man page on it. You should also check out the "--link-dest" option, which is a nice way of doing "incremental" style backups where you only backup the files that have been modified since the last backup. -- Hal Pome

Re: [Eug-lug] rsync problems

2008-03-03 Thread Garl Grigsby
Rob Hudson wrote: Hi LUG, I'm helping a friend set up a sort of backup solution. He's got a co-located Linux web server, and a Linux file server in his office behind a firewall. I set up an rsync script to synchronize (pull) all the web files down at night. The problem is that it's dying abou

Re: [Eug-lug] rsync problems

2008-03-03 Thread Ben Barrett
Rsync --partial still needs to iterate all the files/paths you specify, of course, so it will still use some system resources... I'd suggest doing some system load-testing (for rsync differences), and also gaining a sense of how much file change happens ("ls -lt"?) as well as how much actually matt

Re: [Eug-lug] rsync problems

2008-03-03 Thread Rob Hudson
On 3/3/08, Ben Barrett <[EMAIL PROTECTED]> wrote: > Are you using the "--partial" option for rsync? No, but I just read the man page on it. > Sticking with rsync for now... do you have any reasons other that > network timeouts to desire a different solution? No... if it would work, this would

Re: [Eug-lug] rsync problems

2008-03-03 Thread Ben Barrett
Are you using the "--partial" option for rsync? The best approach I've seen using rsync for backups uses a wrapper to setup a lock-file of sorts, kicked off [repeatedly] by a cron job... the wrapper script will not try to do 2 rsyncs at once, in short. Sticking with rsync for now... do you have any

[Eug-lug] rsync problems

2008-03-03 Thread Rob Hudson
Hi LUG, I'm helping a friend set up a sort of backup solution. He's got a co-located Linux web server, and a Linux file server in his office behind a firewall. I set up an rsync script to synchronize (pull) all the web files down at night. The problem is that it's dying about 25% of the way thr