Re: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Saiful Amin
I also recommend using MARC::Batch. Attached is a simple script I wrote for myself. Saiful Amin +91-9343826438 On Mon, Jan 25, 2010 at 8:33 PM, Robert Fox wrote: > Assuming that memory won't be an issue, you could use MARC::Batch to > read in the record set and print out seperate files where y

Re: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Robert Fox
Assuming that memory won't be an issue, you could use MARC::Batch to read in the record set and print out seperate files where you split on X amount of records. You would have an iterative loop loading each record from the large batch, and a counter variable that would get reset after X amo

Re: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Sébastien Hinderer
Hi, The yaz-marcdump utility may be what you are looking for. See for instance options -s and -C. hth, Shérab.

RE: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Walker, David
pe.com] Sent: Monday, January 25, 2010 7:08 AM To: perl4lib@perl.org Subject: Re: Splitting a large file of MARC records into smaller files On 25/01/10 14:48, Nolte, Jennifer wrote: > Hello- > > I am working with files of MARC records that are over a million records each. > I'd

Re: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Ashley Sanders
Jennifer, I am working with files of MARC records that are over a million records each. I'd like to split them down into smaller chunks, preferably using a command line. MARCedit works, but is slow and made for the desktop. I've looked around and haven't found anything truly useful- Endeavor'

RE: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Smith,Devon
This isn't a perl solution, but it may work for you. You can use the unix split command to split a file into several other files with the same number of lines each. For that to work, you'll first have to use tr to convert the ^] record separators into newlines. Then use tr to convert them all back

Re: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Colin Campbell
On 25/01/10 14:48, Nolte, Jennifer wrote: Hello- I am working with files of MARC records that are over a million records each. I'd like to split them down into smaller chunks, preferably using a command line. MARCedit works, but is slow and made for the desktop. I've looked around and haven't

RE: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Houghton,Andrew
> From: Nolte, Jennifer [mailto:jennifer.no...@yale.edu] > Sent: Monday, January 25, 2010 09:48 AM > To: perl4lib@perl.org > Subject: Splitting a large file of MARC records into smaller files > > Hello- > > I am working with files of MARC records that are over a million records > each. I'd like t

Re: Splitting a large file of MARC records into smaller files

2010-01-25 Thread Emmanuel Di Pretoro
Hi, A long time ago, I've written the following : --- snippet --- #!/usr/bin/env perl use strict; use warnings; use MARC::File::USMARC; use MARC::Record; use Getopt::Long; my $config = { output => 'input' }; GetOptions($config, 'input=s', 'chunk=s', 'output=s', 'max=s'); if (not exists $con