Re: Content based storage

2010-03-17 Thread Heinz-Josef Claes
sed database), but I think there is enough need. my 2 cents, Heinz-Josef Claes On Wednesday 17 March 2010 09:27:15 you wrote: > On 17/03/2010 01:45, Hubert Kario wrote: > > On Tuesday 16 March 2010 10:21:43 David Brown wrote: > >> Hi, > >> > >> I was wondering i

Re: Data Deduplication with the help of an online filesystem check

2009-05-05 Thread Heinz-Josef Claes
On Tue, 5 May 2009 07:29:45 +1000 Dmitri Nikulin wrote: > On Tue, May 5, 2009 at 5:11 AM, Heinz-Josef Claes wrote: > > Hi, during the last half year I thought a little bit about doing dedup for > > my backup program: not only with fixed blocks (which is implemented), but > &g

Re: Data Deduplication with the help of an online filesystem check

2009-05-04 Thread Heinz-Josef Claes
Thomas Glanzmann schrieb: Ric, I would not categorize it as offline, but just not as inband (i.e., you can run a low priority background process to handle dedup). Offline windows are extremely rare in production sites these days and it could take a very long time to do dedup at th

Re: Data Deduplication with the help of an online filesystem check

2009-04-28 Thread Heinz-Josef Claes
Am Dienstag, 28. April 2009 22:16:19 schrieb Thomas Glanzmann: > Hello Heinz, > > > It's not only cpu time, it's also memory. You need 32 byte for each 4k > > block. It needs to be in RAM for performance reason. > > exactly and that is not going to scale. > > Thomas Hi Thomas, I wrote a

Re: Data Deduplication with the help of an online filesystem check

2009-04-28 Thread Heinz-Josef Claes
Am Dienstag, 28. April 2009 19:38:24 schrieb Chris Mason: > On Tue, 2009-04-28 at 19:34 +0200, Thomas Glanzmann wrote: > > Hello, > > > > > I wouldn't rely on crc32: it is not a strong hash, > > > Such deduplication can lead to various problems, > > > including security ones. > > > > sure thing, di