> Does anyone know if 64-bit Fedora or OpenSolaris or any other 64-bit OS
> allows more than 32,000 entries in a directory?  I am running a shared
> polipo cache on 32-bit Red Hat Enterprise Linux that keeps filling up around
> 32,000 entries which is quite annoying ...

This depends on the filesystem, not on the architecture.

However, if you've got that many entries, it would be better to
implement a different scheme for storing files in the disk cache.
Right now, an entry in the disk cache is in the file

  <domain name>/<sha1 hash of the URL>

The advantage is that it is easy to remove all files for a given site
(rm -r), and that you've got good locality (all files for a single
cache are kept together, so the directory will be in cache most of the
time).  However, as you noticed, it doesn't scale well.

It would be a good idea, for very large proxies, to use something like

  <domain name>/<first digit of sha1>/<sha1>

which will obviously be suboptimal for small proxies.  I guess I'll
implement it and make it optional.

                                        Juliusz

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Polipo-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/polipo-users

Reply via email to