Re: [CODE4LIB] Net::OAI::Harvester

2011-08-11 Thread Westman, Stephen
AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Net::OAI::Harvester -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Stephen, > Does anyone know a way in which Net::OAI::Harvester can be used with oai_dc > records in a way where multiple instances of a tag can be captur

Re: [CODE4LIB] Net::OAI::Harvester

2011-08-11 Thread Thomas Berger
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Stephen, > Does anyone know a way in which Net::OAI::Harvester can be used with oai_dc > records in a way where multiple instances of a tag can be captured and then > concatenated with the first one. It should work to extract the tag in array con

Re: [CODE4LIB] Net::OAI::Harvester

2011-08-10 Thread Thomas Krichel
Westman, Stephen writes > Thanks! I'll look into it. I've put out a sample script using it at http://wotan.liu.edu/home/mamf/tmp/westman In this work I used OpenDOAR to get repository sources. I am not maintaining this any more becaues I now use a source from BASE for feeding repos

Re: [CODE4LIB] Net::OAI::Harvester

2011-08-10 Thread Westman, Stephen
Thanks! I'll look into it. Take care, Stephen From: Code for Libraries [CODE4LIB@LISTSERV.ND.EDU] on behalf of Thomas Krichel [kric...@openlib.org] Sent: Thursday, August 11, 2011 1:07 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Net

Re: [CODE4LIB] Net::OAI::Harvester

2011-08-10 Thread Thomas Krichel
Westman, Stephen writes > I'm working on a Perl-based OAI harvester and have run a problem. > The module that I'm using - Net::OAI::Harvester - does a great job > of parsing out the different OAI tagged "fields" so that they can be > put into a MySQL table of retrieved OAI records for searching.

[CODE4LIB] Net::OAI::Harvester

2011-08-10 Thread Westman, Stephen
I'm working on a Perl-based OAI harvester and have run a problem. The module that I'm using - Net::OAI::Harvester - does a great job of parsing out the different OAI tagged "fields" so that they can be put into a MySQL table of retrieved OAI records for searching. Unfortunately, in using the U

Re: [CODE4LIB] net::oai::harvester [resolved]

2007-12-17 Thread Ed Summers
fwiw, my proposed solution was to use MARC::File::XML from the marc-xml cpan module [1] use Net::OAI::Harvester; use MARC::File::SAX; my $url = 'http://memory.loc.gov/cgi-bin/oai2_0'; my $harvester = Net::OAI::Harvester->new(baseURL => $url); my $response = $harvester->listRecords(metad

Re: [CODE4LIB] net::oai::harvester [resolved]

2007-12-17 Thread Eric Lease Morgan
On Dec 13, 2007, at 10:33 AM, Eric Lease Morgan wrote: Put another way, if I want to use repository using NET::OAI::Harvester to read repository data in a form other than DC will I need to write an additional module such as NET::OAI::Record::MARCXML? But I'm lazy, and even though it is not the

Re: [CODE4LIB] net::oai::harvester

2007-12-13 Thread Eric Lease Morgan
On Dec 13, 2007, at 9:48 AM, Ed Summers wrote: use Net::OAI::Harvester; use MODSHandler; my $url = 'http://memory.loc.gov/cgi-bin/oai2_0'; my $harvester = Net::OAI::Harvester->new(baseURL => $url); my $records = $harvester->listRecords( metadataPrefix => 'mods', metadataHand

Re: [CODE4LIB] net::oai::harvester

2007-12-13 Thread Ed Summers
Another option if you are in Perl land would be to take a look at Tim Brody's HTTP::OAI library [1] which returns XML::DOM::Document objects for record metadata, which you can walk around in and use to evaluate xpaths: -- use HTTP::OAI; my $harvester = HTTP::OAI::Harvester->new( baseUR

Re: [CODE4LIB] net::oai::harvester

2007-12-13 Thread Eric Lease Morgan
On Dec 13, 2007, at 9:10 AM, Don Gourley wrote: Put another way, if I want to use repository using NET::OAI::Harvester to read repository data in a form other than DC will I need to write an additional module such as NET::OAI::Record::MARCXML? I don't know if this is the only way to do it, but

Re: [CODE4LIB] net::oai::harvester

2007-12-13 Thread Ed Summers
Hey Eric: N::O::H uses XML::SAX for XML parsing, which provides a standard interface to multiple back end XML parsers, and also provides a facility known as XML Filters [1]. Net::OAI::Record::OAI_DC is an example of a SAX filter which receives SAX events for each metadata record in a response and

Re: [CODE4LIB] net::oai::harvester

2007-12-13 Thread Don Gourley
On Thu, December 13, 2007 8:18 am, Eric Lease Morgan wrote: ... > Put another way, if I want to use repository using > NET::OAI::Harvester to read repository data in a form other than DC > will I need to write an additional module such as > NET::OAI::Record::MARCXML? I don't know if this is the on

[CODE4LIB] net::oai::harvester

2007-12-13 Thread Eric Lease Morgan
I am looking for some guidelines regarding the use of NET::OAI::Harvester. Specifically, I'm hoping someone would outline one or two different techniques for using the NET::OAI::Harvester Perl modules to harvest and store OAI metadata other than oai_dc. Suppose the data provider supports MARCXML,