Hi

We had done some preliminary testing using registration of large files > 2GB into DSpace and it worked.

Our approach was to utilize multiple asset stores within DSpace, and large files were handled by SRB asset store.

The ingest was done through SRB and registration was done into DSpace. We basically worked off David Little's DSpace SRB integration patch, additionally my colleague Kate Pechekhonova did some re-factoring to make it work alongside non-SRB managed asset store.

In our PR (preservation repository) which is managed by DSpace, we don't plan on allowing direct downloads of large files, since the same I/O bandwidth issues that prevent DSpace from directly ingesting large files, are also true for exporting of large files.

Currently we plan on streaming proxies of the corresponding lower res AV files, through appropriate streaming server, and for qualified users the large files would be made available for download through some appropriate client application outside DSpace.

Summary: Instead of ingesting individual large files, think of ingesting the large file with associated smaller proxy file into your collection which can be downloadable or stream-able depending upon your collection policy.



Unni Pillai
Programmer/Analyst
Tel: (212)-992-9741
[EMAIL PROTECTED]
AIM: [EMAIL PROTECTED]
Jabber:[EMAIL PROTECTED]
Digital Library Program
NDIIPP-Preserving Digital Public Television




On Apr 17, 2007, at 8:55 AM, Mark H. Wood wrote:

My position on huge AV files has been that they are too large for the
average user to fiddle with if he has to download the whole thing
before seeing/hearing anything.  We ought to have the bitstreams in
DSpace for archival purposes, but we also ought to mount them on a
streaming service and point to them, so that casual users can just
open them with a streaming client.  It's fairly easy to build a
trivial SMIL document pointing to a stream and tuck that into an item.

This doesn't address the ingestion performance issue, of course.
Does the "registration" mechanism not suffice for this?

--
Mark H. Wood, Lead System Programmer   [EMAIL PROTECTED]
Typically when a software vendor says that a product is "intuitive" he
means the exact opposite.

---------------------------------------------------------------------- ---
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/ _______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Reply via email to