Re: [GENERAL] Large selects handled inefficiently?

2000-09-05 Thread Zlatko Calusic
"Andrew Snow" <[EMAIL PROTECTED]> writes: > > I believe I can work around this problem using cursors (although I > > don't know how well DBD::Pg copes with cursors). However, that > > doesn't seem right -- cursors should be needed to fetch a large query > > without having it all in memory at onc

RE: [GENERAL] Large selects handled inefficiently?

2000-08-31 Thread Hiroshi Inoue
> -Original Message- > From: Jules Bean > > On Thu, Aug 31, 2000 at 09:58:34AM +0100, Jules Bean wrote: > > On Thu, Aug 31, 2000 at 03:28:14PM +1100, Chris wrote: > > > > > but it is true that this is a flaw in postgres. It has been > > > discussed on hackers from time to time about implem

Re: [GENERAL] Large selects handled inefficiently?

2000-08-31 Thread Jules Bean
On Thu, Aug 31, 2000 at 09:58:34AM +0100, Jules Bean wrote: > On Thu, Aug 31, 2000 at 03:28:14PM +1100, Chris wrote: > > > but it is true that this is a flaw in postgres. It has been > > discussed on hackers from time to time about implementing a "streaming" > > interface. This means that the cli

Re: [GENERAL] Large selects handled inefficiently?

2000-08-31 Thread Jules Bean
On Thu, Aug 31, 2000 at 03:28:14PM +1100, Chris wrote: > Jules Bean wrote: > > > > On Thu, Aug 31, 2000 at 12:22:36AM +1000, Andrew Snow wrote: > > > > > > > I believe I can work around this problem using cursors (although I > > > > don't know how well DBD::Pg copes with cursors). However, that

Re: [GENERAL] Large selects handled inefficiently?

2000-08-30 Thread Jules Bean
On Thu, Aug 31, 2000 at 12:22:36AM +1000, Andrew Snow wrote: > > > I believe I can work around this problem using cursors (although I > > don't know how well DBD::Pg copes with cursors). However, that > > doesn't seem right -- cursors should be needed to fetch a large query > > without having it

RE: [GENERAL] Large selects handled inefficiently?

2000-08-30 Thread Andrew Snow
> I believe I can work around this problem using cursors (although I > don't know how well DBD::Pg copes with cursors). However, that > doesn't seem right -- cursors should be needed to fetch a large query > without having it all in memory at once... Actually, I think thats why cursors were inv

[GENERAL] Large selects handled inefficiently?

2000-08-30 Thread Jules Bean
Hiya, I am running a very large SELECT - it selects every row from a ~10 000 000 row table. I'm running this in Perl using DBD:Pg, with the general sequence: $sth = $dbh->prepare("SELECT $fields FROM $from") || return 0; $fh = new FileHandle(">$file") || die "Can't open $file : $!"; $sth->execut