Re: [Dspace-tech] Questions on upgrading from 1.5 to 3.1 and maintaining a live and test instance
Thanks everyone! Helix84, we'll give your plan a try next week. I'll let you know about anything we learn that would be good for your potential wiki entry. On Tue, Jun 18, 2013 at 4:39 AM, helix84 heli...@centrum.sk wrote: On Mon, Jun 17, 2013 at 6:52 PM, Spencer Lamm sla...@swarthmore.edu wrote: 1) This wiki post by Mark Diggory details how to upgrade on the same box without overwriting - essentially install the new code, diff the config file differences, copy the db files to the new instance, and run the db upgrades. We need to upgrade on a new server due to OS issues. Are there any additional considerations replicating Mark's process on a new server? https://wiki.duraspace.org/display/DSPACE/To+upgrade+without+overwriting Hi Spencer, using a new server when upgrading is actually a procedure I would recommend over in-place upgrade, especially in case of a large version jump. I outlined the procedure here (I really need to make a wiki page for it): http://dspace.2283337.n4.nabble.com/Migrate-1-8-to-3-0-database-td4661490.html http://dspace.2283337.n4.nabble.com/migrate-repository-into-a-new-instances-machine-td4660930.html Basically, make sure you read through each of the upgrading instructions (1.5-1.6, 1.6-1.7, ...). You don't need to do all the steps, but at the very least you have to run the database migration scripts in the correct order. Then, in the last one (1.8-3.1) follow the repeated steps you previously skipped. 2) Our assetstore is on a Compellent SAN accessible via a server mount. What I would love to do is use this upgrade as an opportunity to set up live and development DSpace servers that are as close as possible to being exact replicas. Is it possible to have two DSpace instances pointing to the same assetstore? Do database changes in DSpace upgrades affect the assetstore ? Yes, it's possible, but I strongly recommend against it! If you did, you could delete a file in the staging instance and it would be also missing in the production instance assetstore, but the production instance wouldn't know about it, because it would still have a record that it exists in its database. What you can do is make separate assetstores and use some deduplication method (because most of the files will be the same) - from primitive ones like hardlinks to advanced ones like deduplication on ZFS - check with your SAN admin. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Spencer Lamm Digital Initiatives Librarian Swarthmore College Library sla...@swarthmore.edu 610-328-8541 -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Questions on upgrading from 1.5 to 3.1 and maintaining a live and test instance
Hello Everyone, We are getting ready to do a long overdue upgrade from 1.5.2 to 3.1. In light of that, I have two questions... 1) This wiki post by Mark Diggory details how to upgrade on the same box without overwriting - essentially install the new code, diff the config file differences, copy the db files to the new instance, and run the db upgrades. We need to upgrade on a new server due to OS issues. Are there any additional considerations replicating Mark's process on a new server? https://wiki.duraspace.org/display/DSPACE/To+upgrade+without+overwriting 2) Our assetstore is on a Compellent SAN accessible via a server mount. What I would love to do is use this upgrade as an opportunity to set up live and development DSpace servers that are as close as possible to being exact replicas. Is it possible to have two DSpace instances pointing to the same assetstore? Do database changes in DSpace upgrades affect the assetstore ? Thanks! Spencer -- Spencer Lamm Digital Initiatives Librarian Swarthmore College Library sla...@swarthmore.edu 610-328-8541 -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Slow response to submitting/deleting items and editing metadata
Hi Andrea, Thanks for the information! That worked perfectly. For documentation's sake I want to clear up one thing, namely that the write.lock file is not one of the files in /var/dspace/search that gets updated when items are added/edited/deleted. It is created when there is an interruption of some kind. (You may have meant this, Andrea, but I wanted to make sure it was stated explicitly.) This thread talks about that in more detail: http://www.mail-archive.com/dspace-tech@lists.sourceforge.net/msg10873.html Spencer Re: [Dspace-tech] Slow response to submitting/deleting items and editing metadata Andrea Schweer Tue, 07 Dec 2010 12:15:49 -0800 Hi Spencer, On 08/12/10 09:00, Spencer Lamm wrote: We're running DSpace 1.5.1 and Postgres 8.1.11 on a Linux machine. In the last week we've been experiencing significant slowdowns; it now takes about 30 seconds to add or delete items or metadata. If anybody has suggestions for how to start tackling this, they would be greatly appreciated. To date, we have done the following: I was having similar issues with one of my DSpace instances the other day. In my case it turned out that there was a stale lock file in the index directory, which led to delays when DSpace tried (and failed) to update the search/browse indexes. Have a look in your [dspace]/search directory (or wherever else your search.dir parameter in dspace.cfg points to). In particular, check - when the files in the directory were last modified (as far as I know, these files should be updated basically whenever you add/delete an item or change an item's metadata) - whether there is a file in that directory with the extension .lock or .lck (sorry I can't remember which one it was) I could solve this by manually deleting the lock file and then manually updating the indexes once ([dspace]/bin/index-update). Also, make sure you always update the indexes as the standard dspace user (in our case tomcat, but I think it'd be dspace if you followed the standard installation instructions) so that the file permissions in [dspace]/search are correct. Incorrect permissions for this directory and its files may be another reason for the delays you're seeing, if indeed they are linked to index updates. Hope this helps. cheers, Andrea -- Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- What happens now with your Lotus Notes apps - do you make another costly upgrade, or settle for being marooned without product support? Time to move off Lotus Notes and onto the cloud with Force.com, apps are easier to build, use, and manage than apps on traditional platforms. Sign up for the Lotus Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Spencer Lamm Digital Initiatives Librarian Swarthmore College Library sla...@swarthmore.edu 610-328-8541 -- This SF Dev2Dev email is sponsored by: WikiLeaks The End of the Free Internet http://p.sf.net/sfu/therealnews-com ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Slow response to submitting/deleting items and editing metadata
Hi- We're running DSpace 1.5.1 and Postgres 8.1.11 on a Linux machine. In the last week we've been experiencing significant slowdowns; it now takes about 30 seconds to add or delete items or metadata. If anybody has suggestions for how to start tackling this, they would be greatly appreciated. To date, we have done the following: - ensured that extraneous/idle postgres processes are not slowing things down. We do see what looks to be a high number of idle processes but killing them and restarting tomcat does not address the speed issue. - ensured that vacuumdb is running on the dspace database - from the command line verified that simple adds/deletes to the item and metadata tables in the database are working fine. - turned on DEBUG for log4j.properties and saw a number of select statements We have about 4,200 items in our repository. Thanks! Spencer -- Spencer Lamm Digital Initiatives Librarian Swarthmore College Library sla...@swarthmore.edu 610-328-8541 -- What happens now with your Lotus Notes apps - do you make another costly upgrade, or settle for being marooned without product support? Time to move off Lotus Notes and onto the cloud with Force.com, apps are easier to build, use, and manage than apps on traditional platforms. Sign up for the Lotus Notes Migration Kit to learn more. http://p.sf.net/sfu/salesforce-d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Browsing by Author in Kubrick - alpha links don't work on author page
Hi Claudia, Thanks for the response. I see now how that fits within the DSpace structure. I guess the confusion for our design group, why they saw this as a flaw, is that once you're at the page for a single author there isn't much use to the alpha navigation except to start a new browse list based on a different letter. If the list of items associated with a single author is large, 'previous page'/'next page' links would serve well for browsing. I think we felt it would be more useful to use the alpha list as a way to help users browse the author names more broadly, rather than refining the browse list for a single author. We may decide to explore a change to this on our own. If we do, I will pass along whatever we come up with. Best, Spencer 2010/1/21 Claudia Jürgen claudia.juer...@ub.tu-dortmund.de: Hello Spencer, this seems ok in the example you gave. Using the navigation in the browse by a single author will navigate within the list. If the list got only one page, using the navigation will not cause any change in the display. Have you actually produced the error with a list where the navigation should lead to another page? Hope that helps Claudia Jürgen Spencer Lamm schrieb: Hi- We're on 1.5.2 and currently revamping the Kubrick theme. When browsing by author the alpha links don't work on the page for a single author, like 'Browsing by Author Chao, Corey'. Checked other DSpace instances and see the same problem at MIT - http://dspace.mit.edu/browse?rpp=20value=Aalberts%2C+Daniel+Paul%2C+1966-etal=-1type=authorstarts_with=Morder=ASCsort_by=-1. Thanks, Spencer -- Spencer Lamm Digital Initiatives Librarian Swarthmore College Library sla...@swarthmore.edu 610-328-8541 -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Spencer Lamm Digital Initiatives Librarian Swarthmore College Library sla...@swarthmore.edu 610-328-8541 -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Browsing by Author in Kubrick - alpha links don't work on author page
Hi- We're on 1.5.2 and currently revamping the Kubrick theme. When browsing by author the alpha links don't work on the page for a single author, like 'Browsing by Author Chao, Corey'. Checked other DSpace instances and see the same problem at MIT - http://dspace.mit.edu/browse?rpp=20value=Aalberts%2C+Daniel+Paul%2C+1966-etal=-1type=authorstarts_with=Morder=ASCsort_by=-1. Thanks, Spencer -- Spencer Lamm Digital Initiatives Librarian Swarthmore College Library sla...@swarthmore.edu 610-328-8541 -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
