At 9:29 PM -0500 2003/10/31, Scott Lambert wrote:

 If we were talking about more than 10,000 files, I might buy it.  But we
 are talking about 1300 files.

Many filesystems start significantly slowing down around 1,000 files, not 10,000. Moreover, are you sure that this is the largest number of files you've ever had in that directory?


                                Also the processing goes something like
 O(n), in reverse, slower as it processes the files in the directory.

That is a bit strange, but might be explained by holes in the directory structure that need to be skipped.


                                                                       I
 might buy it staying slow if it started slow but it doesn't.

I've seen mail servers at large freemail providers that had previously grown to very large sizes, and worked reasonably well for numbers of files in the low thousands, but seriously flaked out when pushed much beyond that.


Move the directory aside, move the files to a new directory, and restart -- suddenly everything works like magic again.


Unless you know the filesystem code intimately, as well as the code that is using the filesystem, it can be difficult to predict how or when things will break or how badly they will break.


--
Brad Knowles, <[EMAIL PROTECTED]>

"They that can give up essential liberty to obtain a little temporary
safety deserve neither liberty nor safety."
    -Benjamin Franklin, Historical Review of Pennsylvania.

GCS/IT d+(-) s:+(++)>: a C++(+++)$ UMBSHI++++$ P+>++ L+ !E-(---) W+++(--) N+
!w--- O- M++ V PS++(+++) PE- Y+(++) PGP>+++ t+(+++) 5++(+++) X++(+++) R+(+++)
tv+(+++) b+(++++) DI+(++++) D+(++) G+(++++) e++>++++ h--- r---(+++)* z(+++)

------------------------------------------------------
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

This message was sent to: [EMAIL PROTECTED]
Unsubscribe or change your options at
http://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Reply via email to