Hi, a little nervous about it, but I'm game to try a swing at this, and would appreciate any pointers, jeers, or tomatoes (or, heck, SWORDBagitIngesters, if you have one handy) thrown this way. :-) -- HARDY POTTINGER <pottinge...@umsystem.edu> University of Missouri Library Systems http://lso.umsystem.edu/~pottingerhj/ "No matter how far down the wrong road you've gone, turn back." --Turkish proverb
On 7/28/11 11:21 AM, "Tim Donohue" <tdono...@duraspace.org> wrote: >Though, to be clear -- the replicate code is *not* hooked up to DSpace's >SWORD ingestion process yet. > >So, if we wanted to ingest bags via SWORD (which sounds like a good idea >to me), I believe there's still one piece missing: > >* a SWORDIngester class which calls the replicate code to ingest a bag >received via SWORD into DSpace. (This would be similar to how there's a >SWORDMETSIngester which forwards METS packages on to the DSpace METS >PackageIngester) > >- Tim > >On 7/27/2011 5:05 PM, Richard Rodgers wrote: >> BTW, the replicate code does all this - serializes and deserializes >>bags to DSpace objects >> >> Richard >> On Jul 27, 2011, at 5:56 PM, Stuart Lewis wrote: >> >>> Hi Hardy, >>> >>> SWORD is completely agnostic about what packages it transports, >>>however out the box, DSpace does not know how to ingest bags via SWORD. >>> You might therefore need to write a bag ingester than knows how to >>>unpack and ingest the contents of the bag. This would make an >>>excellent addition to DSpace :) >>> >>> Thanks, >>> >>> >>> Stuart Lewis >>> Digital Development Manager >>> Te Tumu Herenga The University of Auckland Library >>> Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand >>> Ph: +64 (0)9 373 7599 x81928 >>> >>> >>> >>> On 28/07/2011, at 9:29 AM, Pottinger, Hardy J. wrote: >>> >>>> Thanks, Mark, that code from MIT looks interesting, I will look into >>>>it >>>> more. I did notice that the Bagit spec is supported by the SWORD >>>>protocol, >>>> and when I mentioned this to our archivist, he went and looked and it >>>>does >>>> appear that the BIL 3.9 can send a "bag" using SWORD (see output of >>>>the >>>> BIL -h command, pasted below). So, it looks like Bagger and/or BIL + >>>> turning on SWORD for our repository will get us what we want. Huzzah! >>>> >>>> ***** >>>> BagIt Library (BIL) Version 3.9 >>>> Usage: bag<operation> [operation arguments] [--help] >>>> Parameters: >>>> <operation> >>>> Valid operations are: baginplace, bob, >>>>checkpayloadoxum, create, >>>> fillholey, generatepayloadoxum, makecomplete, makeholey, retrieve, >>>> splitbagbyfiletype, splitbagbysize, splitbagbysizeandfiletype, sword, >>>> update, updatetagmanifests, verifycomplete, verifypayloadmanifests, >>>> verifytagmanifests and verifyvalid. >>>> Operation explanations: >>>> baginplace: Creates a bag-in-place. The source >>>>must be a directory on >>>> a filesystem and may already have a data directory. >>>> bob: Sends a bag using BOB. >>>> checkpayloadoxum: Generates Payload-Oxum and >>>>checks against >>>> Payload-Oxum in bag-info.txt. >>>> create: Creates a bag from supplied >>>>files/directories, completes the >>>> bag, and then writes in a specified format. >>>> fillholey: Retrieves any missing pieces of a >>>>local bag. >>>> generatepayloadoxum: Generates and returns the >>>>Payload-Oxum for the bag. >>>> makecomplete: Completes a bag and then writes >>>>in a specified format. >>>> Completing a bag fills in any missing parts. >>>> makeholey: Generates a fetch.txt and then >>>>writes bag in a specified >>>> format. >>>> retrieve: Retrieves a bag exposed by a web >>>>server. A local holey bag is >>>> not required. >>>> splitbagbyfiletype: Splits a bag by file types. >>>> splitbagbysize: Splits a bag by size. >>>> splitbagbysizeandfiletype: Splits a bag by size >>>>and file types. >>>> sword: Sends a bag using SWORD. >>>> update: Updates the manifests and (if it >>>>exists) the bag-info.txt for a >>>> bag. >>>> updatetagmanifests: Updates the tag manifests >>>>for a bag. The bag must >>>> be unserialized. >>>> verifycomplete: Verifies the completeness of a >>>>bag. >>>> verifypayloadmanifests: Verifies the checksums >>>>in all payload manifests. >>>> verifytagmanifests: Verifies the checksums in >>>>all tag manifests. >>>> verifyvalid: Verifies the validity of a bag. >>>> [--version] >>>> Prints version of BIL and exits. >>>> [--help] >>>> Prints usage message for the operation. >>>> Examples: >>>> bag verifyvalid --help >>>> Prints help for the verifyvalid operation. >>>> >>>> >>>> >>>> -- >>>> HARDY POTTINGER<pottinge...@umsystem.edu> >>>> University of Missouri Library Systems >>>> http://lso.umsystem.edu/~pottingerhj/ >>>> "No matter how far down the wrong road you've gone, >>>> turn back." --Turkish proverb >>>> >>>> >>>> >>>> >>>> >>>> >>>> On 7/26/11 5:31 PM, "Mark Diggory"<mdigg...@atmire.com> wrote: >>>> >>>>> Hardy, >>>>> Be aware that MIT / Richard Rodgers also has some Bagit work >>>>>available, >>>>> currently nested within the modules directory here: >>>>> >>>>> >>>>>http://scm.dspace.org/svn/repo/modules/dspace-replicate/trunk/src/main >>>>>/jav >>>>> a/org/dspace/pack/ >>>>> >>>>> >>>>> >>>>><http://scm.dspace.org/svn/repo/modules/dspace-replicate/trunk/src/mai >>>>>n/ja >>>>> va/org/dspace/pack/>Mark >>>>> >>>>> On Tue, Jul 26, 2011 at 2:33 PM, Pottinger, Hardy J. >>>>> <pottinge...@umsystem.edu> wrote: >>>>> >>>>> Hi, I've done a bit of googling on Bagit, and I see that Dryad (and >>>>>@mire) >>>>> have done some work with Bagit as a repository interchange >>>>>mechanism. I am >>>>> interested in something a bit more mundane. There exists a very nice >>>>>tool >>>>> for constructing a "bag", called Bagger: >>>>> >>>>> http://sourceforge.net/projects/loc-xferutils/files/loc-bagger/ >>>>> >>>>> >>>>> Which would be ideal for adapting for our needs--we need a tool that >>>>>a >>>>> scanner technician can use to feed scanned images into our >>>>>repository. >>>>> >>>>> Bags, in my mind, are not much different than SAF packages. It would >>>>>be >>>>> trivial to script a converter between the two formats, though I'm >>>>>thinking >>>>> someone is likely to have walked this path already. If so, and if >>>>>you can >>>>> share any code, or just talk about your approach, I'd love to hear >>>>>from >>>>> you. Thanks! >>>>> >>>>> >>>>> -- >>>>> HARDY POTTINGER<pottinge...@umsystem.edu> >>>>> University of Missouri Library Systems >>>>> http://lso.umsystem.edu/~pottingerhj/ >>>>> "No matter how far down the wrong road you've gone, >>>>> turn back." --Turkish proverb >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>>---------------------------------------------------------------------- >>>>>---- >>>>> ---- >>>>> Got Input? Slashdot Needs You. >>>>> Take our quick survey online. Come on, we don't ask for help often. >>>>> Plus, you'll get a chance to win $100 to spend on ThinkGeek. >>>>> http://p.sf.net/sfu/slashdot-survey >>>>> _______________________________________________ >>>>> DSpace-tech mailing list >>>>> DSpace-tech@lists.sourceforge.net >>>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Mark R. Diggory >>>>> @mire - www.atmire.com<http://www.atmire.com/> >>>>> 2888 Loker Avenue East - Suite 305 - Carlsbad - CA - 92010 >>>>> Esperantolaan 4 - Heverlee 3001 - Belgium >>>>> >>>> >>>> >>>> >>>>----------------------------------------------------------------------- >>>>------- >>>> Got Input? Slashdot Needs You. >>>> Take our quick survey online. Come on, we don't ask for help often. >>>> Plus, you'll get a chance to win $100 to spend on ThinkGeek. >>>> http://p.sf.net/sfu/slashdot-survey >>>> _______________________________________________ >>>> DSpace-tech mailing list >>>> DSpace-tech@lists.sourceforge.net >>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech >>> >>> >>> >>> >>>------------------------------------------------------------------------ >>>------ >>> Got Input? Slashdot Needs You. >>> Take our quick survey online. Come on, we don't ask for help often. >>> Plus, you'll get a chance to win $100 to spend on ThinkGeek. >>> http://p.sf.net/sfu/slashdot-survey >>> _______________________________________________ >>> DSpace-tech mailing list >>> DSpace-tech@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/dspace-tech >> >> >> >>------------------------------------------------------------------------- >>----- >> Got Input? Slashdot Needs You. >> Take our quick survey online. Come on, we don't ask for help often. >> Plus, you'll get a chance to win $100 to spend on ThinkGeek. >> http://p.sf.net/sfu/slashdot-survey >> _______________________________________________ >> DSpace-tech mailing list >> DSpace-tech@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/dspace-tech ------------------------------------------------------------------------------ Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey _______________________________________________ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
