Re: [tahoe-dev] small file

2011-01-17 Thread Brian Warner
On 1/17/11 11:37 AM, medhioub wrote:
> Hello,
> 
> Any news about the management of small files with Tahoe.
> I give it a try few months ago (and i like it so much) but unfortunately
> with bad performance and few problems using small files.

We replaced the immutable-file downloader in version 1.8.0 (released at
the end of September, last fall), which should let you download small
files a lot faster than in 1.7.0 or earlier. The new downloader should
fetch small files in two roundtrips, while the old downloader could
require 5 or 6. This might be noticeable if you download a lot of them
in a row.

Storage overhead is still the same: small files (larger than 70 bytes,
smaller than maybe 20kB) are not stored very efficiently.

But as Zooko says, specific measurements will help us give you a better
answer.

hope that helps,
 -Brian

___
tahoe-dev mailing list
tahoe-dev@tahoe-lafs.org
http://tahoe-lafs.org/cgi-bin/mailman/listinfo/tahoe-dev


Re: [tahoe-dev] small file

2011-01-17 Thread Zooko O'Whielacronx
On Mon, Jan 17, 2011 at 12:37 PM, medhioub
 wrote:
> Any news about the management of small files with Tahoe.
> I give it a try few months ago (and i like it so much) but unfortunately with 
> bad performance and few problems using small files.

Hello medhioub:

I'm sorry but I don't have enough information to answer your question.
It would depend on what the problems were that you had using small
files, and what sort of operations you were doing that had performance
problems, and what sort of performance problems you had at that time,
and what sort of performance you require.

Probably the best way to answer your question is for you to try it
yourself. If you do that, I would be happy to learn from you how it
worked.

Regards,

Zooko
___
tahoe-dev mailing list
tahoe-dev@tahoe-lafs.org
http://tahoe-lafs.org/cgi-bin/mailman/listinfo/tahoe-dev