Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time? AND: question about regular recompiling

2011-07-29 Thread Berry, Irene (CIV)
Thank you, Peter, Stuart, Andrea, Alex - So it sounds like it comes down to how much RAM is available on our server. We're going to try 1000, and see how it goes, as we are still on a development server for just this kind of reason. We are looking at correcting a very large batch of records

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-28 Thread Lemann, Alexander Bernard
-Original Message- From: Andrea Schweer [mailto:schw...@waikato.ac.nz] Sent: Wednesday, July 27, 2011 6:38 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time? Hi,

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-28 Thread helix84
On Thu, Jul 28, 2011 at 14:00, Lemann, Alexander Bernard ablem...@bsu.edu wrote: Relatedly, does anyone know how safe it is to test higher limit values?  I looked at the code to determine whether these batch edits occur within a single database transaction, but I didn't see any evidence

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-28 Thread Heitor Barbieri
helix84 Usually, how much time do you wait to import 2000 items via the command line interface? Regards Heitor De: helix84 heli...@centrum.sk Para: Alexander Bernard Lemann ablem...@bsu.edu Cc: dspace-tech@lists.sourceforge.net Enviadas: Quinta-feira, 28 de Julho de 2011 9:17:16

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-28 Thread helix84
On Thu, Jul 28, 2011 at 15:37, Heitor Barbieri heitor.barbi...@bireme.org wrote: Usually, how much time do you wait to import 2000 items via the command line interface? Not more than a minute. Regards, ~~helix84 --

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-28 Thread helix84
I think the most error-prone part will be displaying the diff (the list of all changes) via HTTP. This is what is most likely to cause long waiting times and timeouts, because a lot of HTML will be generated. I had no problem with command line imports - you can even halve the time it takes if you

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-28 Thread helix84
On Thu, Jul 28, 2011 at 15:50, helix84 heli...@centrum.sk wrote: I think the most error-prone part will be displaying the diff (the list of all changes) via HTTP. This is what is most likely to cause long waiting times and timeouts, because a lot of HTML will be generated. I would suggest the

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-27 Thread Stuart Lewis
Hi Irene, We're experimenting with making batch corrections to metadata using the Import Metadata feature in the jsp. We'd like to raise the limit on the number of items that may be changed at a time. I can see the file:

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-27 Thread Peter Dietz
Hi Irene, We've wondered that too at my university, Ohio State University, so we've upped our setting to 600 which we feel is safe, but users typically do smaller batches. I'm guessing the too-low-for-practical-use limit of 20 is to be overly conservative by default, so that there is no risk of

Re: [Dspace-tech] Batch metadata corrections question: does anyone know why the limit is set to just 20 items at a time?

2011-07-27 Thread Andrea Schweer
Hi, On 28/07/11 10:19, Peter Dietz wrote: Doing batch changes with a large number of changes will keep your system busy, and the reindexing can take a while. I've noticed that when we set the limit to be really high, it appears that nothing will happen from the user's browser for 20+ minutes,