Re: Slowdown when fetching multiple records

2006-02-21 Thread Ashley Sanders
Tony Bowden wrote: However, I think the slowdown I was getting is a different problem. I don't know enough about how Z39.50 servers actually work, but I think that requesting each book in turn just had a high overhead of network traffic, Correct. If you request a total of ten records one at a

Re: Slowdown when fetching multiple records

2006-02-21 Thread Tony Bowden
On Mon, Feb 20, 2006 at 09:23:00PM -0600, Bryan Baldus wrote: > I've not used Perl-based Z39.50 searching, but I think LC requires a > 6-second pause between searches, to reduce burden on their servers. > While searching using MarcEdit 4.6 (or pre-5), we were locked out for > the day for not fol

Re: Slowdown when fetching multiple records

2006-02-20 Thread Bryan Baldus
At 4:14 PM + 2/19/06, Tony Bowden wrote: So, it presumably is an issue with the Library of Congress server. Is there some sort of automatic throttling there? Or is there likely to be some sort of option that I should be setting, but not? I've not used Perl-based Z39.50 searching, but I thin

Re: Slowdown when fetching multiple records

2006-02-20 Thread Tony Bowden
On Sun, Feb 19, 2006 at 06:08:40PM -0600, Edward Summers wrote: > If you find out anything and have the time please post your findings > here for the rest of us :-) Thanks for the pointers. On further investigation I discovered the present() method in Net::Z3950::ResultSet. This pre-fetches a

Re: Slowdown when fetching multiple records

2006-02-19 Thread Edward Summers
On Feb 19, 2006, at 10:14 AM, Tony Bowden wrote: So, it presumably is an issue with the Library of Congress server. Is there some sort of automatic throttling there? Or is there likely to be some sort of option that I should be setting, but not? Yeah, I could well imagine there to be throttl

Re: Slowdown when fetching multiple records

2006-02-19 Thread Tony Bowden
On Sun, Feb 19, 2006 at 09:53:59AM -0600, Edward Summers wrote: > I haven't used the Net::Z3950 enough to be able to provide any help > with this. However, you might want to post your message to the net- > z3950 discussion list [1] which fields questions specific to the > Net::Z3950 module. The aut

Re: Slowdown when fetching multiple records

2006-02-19 Thread Edward Summers
On Feb 19, 2006, at 3:57 AM, Tony Bowden wrote: Any pointers gratefully received. I haven't used the Net::Z3950 enough to be able to provide any help with this. However, you might want to post your message to the net- z3950 discussion list [1] which fields questions specific to the Net::Z

Slowdown when fetching multiple records

2006-02-19 Thread Tony Bowden
I'm using code similar to the "get MARC record by ISBN" example in MARC::Doc::Tutorial, and everything is working fine. However, when I change the query to search by Author, rather than by ISBN, (using @attr 1=1003 $name), I've noticed that looping through the results gets dramatically slower as