On Tue, 27 Jan 2009, Stuart Lewis wrote: > The following paper talks about this, and how DSpace performs when ingesting > 1 million items: > > Testing the Scalability of a DSpace-based Archive, Dharitri Misra, James > Seamans, George R. Thoma, National Library of Medicine, Bethesda, Maryland, > USA > > http://www.dspace.org/images/stories/ist2008_paper_submitted1.pdf > > Is this one big import of 30,000 items, or do you break them up into smaller > chunks?
That paper doesn't use the DSpace importer, so I fail to see how it can claim the importer scales well. I can tell from a lot of first-hand experience that the DSpace importer doesn't scale, and that it gets slower as you have more items in your DSpace instance, as well as slowing down for each item in the batch. In addition, if you have a busy DSpace instance, there may be issues with file locking where deleted filehandles don't get recovered properly. best, -- Tom De Mulder <[email protected]> - Cambridge University Computing Service +44 1223 3 31843 - New Museums Site, Pembroke Street, Cambridge CB2 3QH -> 27/01/2009 : The Moon is Waning Crescent (3% of Full) ------------------------------------------------------------------------------ This SF.net email is sponsored by: SourcForge Community SourceForge wants to tell your story. http://p.sf.net/sfu/sf-spreadtheword _______________________________________________ DSpace-tech mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dspace-tech
