Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-31 Thread Jeffrey J. Kosowsky
John Rouillard wrote at about 20:13:15 + on Thursday, October 30, 2008: On Thu, Oct 30, 2008 at 10:04:26AM -0400, Jeffrey J. Kosowsky wrote: Holger Parplies wrote at about 11:29:49 +0100 on Thursday, October 30, 2008: Hi, Jeffrey J. Kosowsky wrote on 2008-10-30

[BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Jeffrey J. Kosowsky
I have found a number of files in my pool that have the same checksum (other than a trailing _0 or _1) and also the SAME CONTENT. Each copy has a few links to it by the way. Why is this happening? Isn't this against the whole theory of pooling. It also doesn't seem to get cleaned up by

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Tino Schwarze
Hi Jeffrey, On Thu, Oct 30, 2008 at 03:55:16AM -0400, Jeffrey J. Kosowsky wrote: I have found a number of files in my pool that have the same checksum (other than a trailing _0 or _1) and also the SAME CONTENT. Each copy has a few links to it by the way. That's intentional - what are the

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Holger Parplies
Hi, Jeffrey J. Kosowsky wrote on 2008-10-30 03:55:16 -0400 [[BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS]: I have found a number of files in my pool that have the same checksum (other than a trailing _0 or _1) and also the SAME CONTENT. Each copy has a few

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Holger Parplies
Hi, Tino Schwarze wrote on 2008-10-30 11:13:27 +0100 [Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS]: [...] Hm. I just took a look in my cpool and found some files which didn't hit the hardlink count yet, but have a _0 and _1: .../cpool/0/0 # ls -l

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Tino Schwarze
Hi Holger, On Thu, Oct 30, 2008 at 12:11:43PM +0100, Holger Parplies wrote: I'm not sure though, how the file name is derived, It's in the docs. Up to 256 KB of file contents (from the first 1 MB) and the file length are taken into account, so it's quite easy to produce hash clashes if

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Tino Schwarze
Apropos link count, I just did a quick check of my pool. Here are the top linked files: -rw-r- 987537 backuppc users 359 2007-05-19 23:43 ./0/d/1/0d16a8f0ce1b516044a3f015b7d5ee06 -rw-r- 437446 backuppc users 98 2007-02-07 03:21 ./b/c/8/bc891581e99fb3729ea3d239a52d2b9a -rw-r- 340062

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Jeffrey J. Kosowsky
Tino Schwarze wrote at about 11:13:27 +0100 on Thursday, October 30, 2008: Hi Jeffrey, On Thu, Oct 30, 2008 at 03:55:16AM -0400, Jeffrey J. Kosowsky wrote: I have found a number of files in my pool that have the same checksum (other than a trailing _0 or _1) and also the SAME

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Jeffrey J. Kosowsky
Holger Parplies wrote at about 11:29:49 +0100 on Thursday, October 30, 2008: Hi, Jeffrey J. Kosowsky wrote on 2008-10-30 03:55:16 -0400 [[BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS]: I have found a number of files in my pool that have the same

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Tino Schwarze
On Thu, Oct 30, 2008 at 09:56:15AM -0400, Jeffrey J. Kosowsky wrote: I'm not sure though, how the file name is derived, I found another file with same name but different MD5 sum: .../cpool/0/0 # md5sum 8/0084734e7242df0fbc186ba6741d1bab* db224998946bac7859f2448f41c58f88

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Jeffrey J. Kosowsky
Tino Schwarze wrote at about 15:08:29 +0100 on Thursday, October 30, 2008: On Thu, Oct 30, 2008 at 09:56:15AM -0400, Jeffrey J. Kosowsky wrote: I'm not sure though, how the file name is derived, I found another file with same name but different MD5 sum: .../cpool/0/0 # md5sum

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Adam Goryachev
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Jeffrey J. Kosowsky wrote: Holger Parplies wrote at about 11:29:49 +0100 on Thursday, October 30, 2008: Hi, Jeffrey J. Kosowsky wrote on 2008-10-30 03:55:16 -0400 [[BackupPC-users] Duplicate files in pool with same CHECKSUM and same

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Jeffrey J. Kosowsky
Jeffrey J. Kosowsky wrote at about 10:04:26 -0400 on Thursday, October 30, 2008: Holger Parplies wrote at about 11:29:49 +0100 on Thursday, October 30, 2008: Hi, Jeffrey J. Kosowsky wrote on 2008-10-30 03:55:16 -0400 [[BackupPC-users] Duplicate files in pool with same CHECKSUM

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Craig Barratt
Jeffrey writes: Except that it my case some of the duplicated checksums truly are the same file (probably due to the link issue I am having)... Yes. Just as Holger mentions, if the hardlink attempt fails, a new file is created in the pool. You appear to have some unreliability in your NFS or

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Jeffrey J. Kosowsky
Craig Barratt wrote at about 11:27:41 -0700 on Thursday, October 30, 2008: Jeffrey writes: Except that it my case some of the duplicated checksums truly are the same file (probably due to the link issue I am having)... Yes. Just as Holger mentions, if the hardlink attempt fails,

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Jeffrey J. Kosowsky
John Rouillard wrote at about 20:13:15 + on Thursday, October 30, 2008: On Thu, Oct 30, 2008 at 10:04:26AM -0400, Jeffrey J. Kosowsky wrote: Holger Parplies wrote at about 11:29:49 +0100 on Thursday, October 30, 2008: Hi, Jeffrey J. Kosowsky wrote on 2008-10-30

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Jeffrey J. Kosowsky
Jeffrey J. Kosowsky wrote at about 20:26:35 -0400 on Thursday, October 30, 2008: John Rouillard wrote at about 20:13:15 + on Thursday, October 30, 2008: On Thu, Oct 30, 2008 at 10:04:26AM -0400, Jeffrey J. Kosowsky wrote: Holger Parplies wrote at about 11:29:49 +0100 on Thursday,

Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS

2008-10-30 Thread Holger Parplies
Hi, [could we agree on a subject line without tabs? ;-] Jeffrey J. Kosowsky wrote on 2008-10-30 20:31:15 -0400 [Re: [BackupPC-users] Duplicate files in pool with same CHECKSUM and same CONTENTS]: Jeffrey J. Kosowsky wrote at about 20:26:35 -0400 on Thursday, October 30, 2008: It's really