Re: mod_perl memory consumption

2001-08-30 Thread Paul DuBois
[EMAIL PROTECTED] (Perrin Harkins) wrote: I guess that DBI gets all records if you use fetchall_array|hashref and that it is else OK. No, the behavior that I saw was when fetching a row at a time. Behind the scenes, DBI would fetch ALL the rows into RAM and then iterate over them. This may

Re: mod_perl memory consumption

2001-08-30 Thread Jeremy Howard
Paul DuBois wrote: mysql_store_result/mysql_use_result determine whether or not the server sends all the rows to the client at once, or one at a time as the client asks for them. mysql_store_result is therefore more memory intensive for the client (which must hold the entire result set).

Re: mod_perl memory consumption

2001-08-30 Thread Paul DuBois
At 2:55 PM +1000 8/31/01, Jeremy Howard wrote: Paul DuBois wrote: mysql_store_result/mysql_use_result determine whether or not the server sends all the rows to the client at once, or one at a time as the client asks for them. mysql_store_result is therefore more memory intensive for the

Re: mod_perl memory consumption

2001-08-28 Thread Perrin Harkins
I wrote a program that converts 5 gigs of emails stored in mysql to phisical messages on disk (resulting in approximately 10 gigs). The program consumes way to much memory although I've wrote it in a very clean way (use strict, no globals, use of udef $var; to help free memory). I start it

Re: mod_perl memory consumption

2001-08-28 Thread Ken Williams
[EMAIL PROTECTED] (Perrin Harkins) wrote: It sounds like you have some data structure which you are adding to and never clearing out. One thing to be careful of is the MySQL DBI driver. The last time I used it, it fetched all returned rows into memory. With a large result set, that could take

mod_perl memory consumption

2001-08-27 Thread Miroslav Madzarevic
BlankI wrote a program that converts 5 gigs of emails stored in mysql to phisical messages on disk (resulting in approximately 10 gigs). The program consumes way to much memory although I've wrote it in a very clean way (use strict, no globals, use of udef $var; to help free memory). I start it