Hmmmm,
Bartosz Oudekerk wrote:
[EMAIL PROTECTED] wrote:
Hi everyone,
I found this article by Jasha about importing large number of files to
hippo cms.
http://blogs.hippo.nl/jasha/2008/07/importing_lots_of_data_into_hi.html
In the last paragraph, Jasha mentioned that Slide doesn't like too many
files in one directory.
Does anyone know what this threshold is? What's your experience with
large amount of files in one directory with hippo?
I don't think there's a fixed threshold, it's simply a question of the
more you put in, the slower it will get.
We tried around 10000 files in one dir, which took Hippo Repository
almost 5 mins for a complete file listing (with default flatfile
backend). So here is the second question: what can we do to tune the
performance? I am going to try it with db backend, as well as increasing
the memory. What are the other things that I can try?
First of all, a 1000 files in one directory, will be unmanageable for
your editors, try finding one specific file in such a listing. And even
if you could tune it to be faster, what would be acceptable? twice as
fast? You'll get much more performance gain, by simply putting less
files in a folder.
Who sais editors need to manage those files?
In one of my Hippo installations files are put in the repository by an external
application.
Nobody but the frontend looks at them.
It would be very inconvenient to have to spread them over subdirectories, to
say the least.
Luckily for now the number of files is in the hundreds, so I need not worry.
Yet.
Question is, of course, what is slides problem?
Getting a folder listing should in principal be linear in the number of entries.
If it sorts the entries this would get worse, but sorting of 10000 entries
should not be a real problem nowadays.
Is this an intrinsic problem of WebDav, or is it the implementation in slide?
Would a workaround using a DASL help? That gets entries from an index, which, I
assume, is much faster.
For a frontend that could easily be implemented.
I think it would be wise to put them in subdirectories/subtrees like by
year/month/day for example, or if no such distinction can be made, by
first few letters like f/i/l/e.
Regards,
Bartosz
********************************************
Hippocms-dev: Hippo CMS development public mailinglist
Searchable archives can be found at:
MarkMail: http://hippocms-dev.markmail.org
Nabble: http://www.nabble.com/Hippo-CMS-f26633.html
Regards,
Reinier
--
Reinier van den Born
HintTech B.V.
Rotterdamseweg 183c, 2629 HD Delft
T: +31(0)15 268 2573
F: +31(0)15 268 2567
M: +31(0)6 494 171 36
--
HintTech levert specialisten op het gebied van softwareontwikkeling (.NET en
Java),
projectmanagement, informatiebeveiliging en business consulting.
KvK Den Haag nr. 27242282 | BTW nr. NL8062.16.396.B01
begin:vcard
fn:Reinier van den Born
n:van den Born;Reinier
org:HintTech B.V.
adr:;;Rotterdamseweg 183c;Delft;;2629HD;Netherlands
email;internet:[EMAIL PROTECTED]
tel;work:+31-15-268 2573
tel;fax:+31-15-268 2567
tel;cell:+31-6 494 171 36
note;quoted-printable:KvK Den Haag nr. 27242282 | BTW nr. NL8062.16.396.B01=0D=0A=
=0D=0A=
HintTech levert specialisten op het gebied van softwareontwikkeling (.NET=
en Java), projectmanagement, informatiebeveiliging en business consulting=
.=0D=0A=
=0D=0A=
url:www.hinttech.com
version:2.1
end:vcard
********************************************
Hippocms-dev: Hippo CMS development public mailinglist
Searchable archives can be found at:
MarkMail: http://hippocms-dev.markmail.org
Nabble: http://www.nabble.com/Hippo-CMS-f26633.html
