Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread Matt
Les Mikesell wrote: >Are you comparing uncompressed native rsync runs to the perl version >that handles backuppc's compressed files? > More or less yes. Dirvish boils down to a perl wrapper around "rsync --link-dest=DIR ..." I haven't tested backuppc without compression -- after all this was one

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread Les Mikesell
On Fri, 2006-03-10 at 14:41, Matt wrote: > I'm not convinced that there > >is much you can do to maintain any kind of structured order > >over a long term when you are adding files from multiple > >sources simultaneously and expiring them more or less randomly. > > > It's not really random! Th

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread Les Mikesell
On Fri, 2006-03-10 at 15:37, David Brown wrote: > describes the state of my > understanding of incremental backup (as of about 5 years ago) when I wrote > Adump. Adump grew out of my frustration of no existing solutions being > able to correctly rest

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread David Brown
On Fri, Mar 10, 2006 at 02:21:41PM -0600, Les Mikesell wrote: > Sort-of... Consider what happens if you rename a directory > containing old files. An incremental based on timestamps won't > take the files in their new locations. Dump can deal with the > renamed directory but you have to back up

Re: [BackupPC-users] CPU usage and low network usage

2006-03-10 Thread jmyers
Currently I am using 2 x 160GB, 2 x 200GB, 2 x 300GB, all 7200rpm all in a LVM, using ext3 filesystem. I can't put them in a stripe set because they are different sizes... so that causes a pain "David Rees" <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 11/03/2006 06:05 AM To

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread Matt
Les Mikesell wrote: >Of course there are other ways to do things, but they aren't >necessarily going to be better. I'm not convinced that there >is much you can do to maintain any kind of structured order >over a long term when you are adding files from multiple >sources simultaneously and expiri

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread Les Mikesell
On Fri, 2006-03-10 at 13:55, David Brown wrote: > Also, as far as I know, every backup program that does incrementals looks > at just the timestamp field. On unix, the ctime and mtime field together > will always tell you of a file change, as long as the system clock is > monotonically increasing

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread David Brown
On Fri, Mar 10, 2006 at 01:39:24PM -0600, Les Mikesell wrote: > Rsync incrementals turn on the option to skip files where the length > and timestamp match, making them considerably faster but more likely > to accidentally miss a changed file. However, since they always work > against the last full

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread Les Mikesell
On Fri, 2006-03-10 at 12:57, Matt wrote: > >I'm not going to discuss this proposal any further. The way that backuppc > >(and other programs) work is too ingrained in people's thinking to realize > >that there are other ways to do things. > > > > > I generally dislike such statements. They sto

Re: [BackupPC-users] CPU usage and low network usage

2006-03-10 Thread David Rees
On 3/10/06, Guus Houtzager <[EMAIL PROTECTED]> wrote: > On Friday 10 March 2006 11:27, [EMAIL PROTECTED] wrote: > > Here tis.. > > > > top - 21:57:44 up 11:45, 2 users, load average: 5.70, 5.50, 4.29 > > Tasks: 106 total, 5 running, 99 sleeping, 0 stopped, 2 zombie > > Cpu(s): 37.7% us

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread Matt
David Brown wrote: >When files are no longer used, they are simply deleted, and those numbered >slots are never used. > >There is _NO_ linking in my proposal, that is it's point. Also, if you >hash the entire file, instead of just the beginning, and you use a strong >enough hash function, there

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread David Brown
On Fri, Mar 10, 2006 at 07:53:20AM -0600, Les Mikesell wrote: > On Fri, 2006-03-10 at 01:29, David Brown wrote: > > > By storing the files in the same order as the traversal, they will likely > > stay near files that will be retrieved at a similar time. > > How would you maintain any kind of orde

Re: [BackupPC-users] CPU usage and low network usage

2006-03-10 Thread Carl W. Soderstrom
Lachlan Simpson wrote: Sorry, obviously that was for my IT team here at work. You are a backuppc developer aren't you Carl? You certainly know a lot.. no, I'm not a backuppc developer. I just use it, and have a few years of experience with backups of various sorts. :) I've learned enough to

Re: [BackupPC-users] filesystem benchmark results

2006-03-10 Thread Les Mikesell
On Fri, 2006-03-10 at 01:29, David Brown wrote: > By storing the files in the same order as the traversal, they will likely > stay near files that will be retrieved at a similar time. How would you maintain any kind of order as backups are expired and replaced? You also need to check new files f

Re: [BackupPC-users] CPU usage and low network usage

2006-03-10 Thread Guus Houtzager
On Friday 10 March 2006 11:27, [EMAIL PROTECTED] wrote: > Here tis.. > > > top - 21:57:44 up 11:45, 2 users, load average: 5.70, 5.50, 4.29 > Tasks: 106 total, 5 running, 99 sleeping, 0 stopped, 2 zombie > Cpu(s): 37.7% us, 25.4% sy, 0.0% ni, 0.4% id, 30.8% wa, 3.3% hi, 2.5% > si

Re: [BackupPC-users] CPU usage and low network usage

2006-03-10 Thread jmyers
Here tis.. top - 21:57:44 up 11:45,  2 users,  load average: 5.70, 5.50, 4.29 Tasks: 106 total,   5 running,  99 sleeping,   0 stopped,   2 zombie Cpu(s): 37.7% us, 25.4% sy,  0.0% ni,  0.4% id, 30.8% wa,  3.3% hi,  2.5% si Mem:   2023220k total,  2009352k used,    13868k free,     2652k buf

Re: [BackupPC-users] Segmentation fault error in gentoo linux

2006-03-10 Thread abhilash s
The problem was I didn't copied the gentoo-backuppc.conf file to /etc/conf.d/backuppc . In gentoo we have to copy two files :gentoo-backuppc  --> /etc/init.d/backuppc  and  gentoo-backuppc.conf --> /etc/conf.d/backuppc . After this change the permission of the script you copied and restart the serv

Re: [BackupPC-users] CPU usage and low network usage

2006-03-10 Thread Guus Houtzager
On Thursday 09 March 2006 21:36, [EMAIL PROTECTED] wrote: > When I say 100%, I mean lookin at top or system Monitor in Gnome, both > show the processors running at 100% usage, not the number of tasks running > on the processor. Ok. Could you show us the upper 5 lines from the output of the 'top' c

Re: [BackupPC-users] Backup aborted (Child exited prematurely)

2006-03-10 Thread Marcos Lorenzo de Santiago
El Viernes, 10 de Marzo de 2006 03:58, Stephen Vaughan escribió: SV > I am having nothing but trouble with doing backups.. I have a backup SV > i'm trying to, its at least 1,000,000 files.. it takes over an hour to SV > build the list... SV > and it seems to start coping files but then just