Re: [Dspace-tech] assetstore across multiple partitions
Hi Mark, John F wrote to you on the partitioning question, but I'm the one who posed the question. We are building a dspace installation to upgrade the current which is running on an old box. It is new hardware. The assetstore(s) will me on a Dell MD1000 array. I want to partition the array into 2T partitions with XFS file system to aid in recovery in the event recovery is forced. I don't have a lot experience with recovery times on large partitions, but smaller partitions will recover faster. It sounds like to me you can manually balance data stored on each partition. How can you configure this through dspace.cfg? Any suggestions would be appreciated.Thanks. Kent On Tue, 2008-09-16 at 14:19 -0400, John Furfey wrote: Begin forwarded message: From: Mark H. Wood [EMAIL PROTECTED] Date: September 10, 2008 4:11:05 PM EDT To: dspace-tech@lists.sourceforge.net Subject: [Junk released by Allow List] Re: [Dspace-tech] assetstore across multiple partitions On Wed, Sep 10, 2008 at 03:35:26PM -0400, John Furfey wrote: Is it possible to split up the assetstore directory across multiple partitions? You can configure multiple assetstore directories, and they can be on different partitions. Only one is designated to be the place that new submissions go at any particular time. What do you want to accomplish by doing this? -- Mark H. Wood, Lead System Programmer [EMAIL PROTECTED] Typically when a software vendor says that a product is intuitive he means the exact opposite. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech John Furfey Digital Systems and Services Coordinator MBLWHOI Library Woods Hole MA 02543 USA PHONE: 508-289-7435 EMAIL: [EMAIL PROTECTED] http://www.mblwhoilibrary.org -- Kent L. Nasveschuk Systems Administrator Marine Biological Laboratory 7 MBL Street Woods Hole, MA 02543 Tel. (508) 289-7263 - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] assetstore across multiple partitions
On Tue, Sep 16, 2008 at 03:09:38PM -0400, Kent Nasveschuk wrote: Hi Mark, John F wrote to you on the partitioning question, but I'm the one who posed the question. We are building a dspace installation to upgrade the current which is running on an old box. It is new hardware. The assetstore(s) will me on a Dell MD1000 array. I want to partition the array into 2T partitions with XFS file system to aid in recovery in the event recovery is forced. I don't have a lot experience with recovery times on large partitions, but smaller partitions will recover faster. On the other hand, you'll have more partitions to recover. fsck will try to do them all in parallel, if they all have the same fs_passno in /etc/fstab, but there are limits all along the data path which may constrain the saving you can achieve. I'm not really into high-performance storage so I can't offer specific advice about the potential bottlenecks. It sounds like to me you can manually balance data stored on each partition. How can you configure this through dspace.cfg? This is the section you need to look at: # File Storage ## # Asset (bitstream) store number 0 (zero) assetstore.dir = /first/assetstore # Specify extra asset stores like this, counting from 1 upwards: # assetstore.dir.1 = /second/assetstore # assetstore.dir.2 = /third/assetstore # Specify the number of the store to use for new bitstreams with this property # The default is 0 (zero) which corresponds to the 'assetstore.dir' above # assetstore.incoming = 1 You would mount a bunch of partitions somewhere, configure [assetstore.dir, assetstore.dir.1 ... assetstore.dir.99 or whatever] to point to those mount points, and then from time to time change assetstore.incoming to the number of the assetstore you want new submissions to go into. Each change to assetstore.incoming will require restarting DSpace. DSpace will only fill one assetstore at a time. -- Mark H. Wood, Lead System Programmer [EMAIL PROTECTED] Typically when a software vendor says that a product is intuitive he means the exact opposite. pgpRlsYT91NCm.pgp Description: PGP signature - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] assetstore across multiple partitions
Is it possible to split up the assetstore directory across multiple partitions? John Furfey Digital Systems and Services Coordinator MBLWHOI Library Woods Hole MA 02543 USA PHONE: 508-289-7435 EMAIL: [EMAIL PROTECTED] http://www.mblwhoilibrary.org - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
