Re: [PERFORM] Simple (hopefully) throughput question?

2010-11-03 Thread Andy Colson
On 11/3/2010 10:52 AM, Nick Matheson wrote: Hello We have an application that needs to do bulk reads of ENTIRE Postgres tables very quickly (i.e. select * from table). We have observed that such sequential scans run two orders of magnitude slower than observed raw disk reads (5 MB/s versus 100 M

Re: [PERFORM] Simple (hopefully) throughput question?

2010-11-03 Thread Marti Raudsepp
Just some ideas that went through my mind when reading your post. On Wed, Nov 3, 2010 at 17:52, Nick Matheson wrote: > than observed raw disk reads (5 MB/s versus 100 MB/s). Part of this is > due to the storage overhead we have observed in Postgres. In the > example below, it takes 1 GB to stor

Re: [PERFORM] Simple (hopefully) throughput question?

2010-11-03 Thread Heikki Linnakangas
On 03.11.2010 17:52, Nick Matheson wrote: We have an application that needs to do bulk reads of ENTIRE Postgres tables very quickly (i.e. select * from table). We have observed that such sequential scans run two orders of magnitude slower than observed raw disk reads (5 MB/s versus 100 MB/s). Par

Re: [PERFORM] Bufer cache replacement LRU algorithm?

2010-11-03 Thread Kevin Grittner
Kenneth Marshall wrote: > On Wed, Nov 03, 2010 at 12:35:33PM -0400, Mladen Gogala wrote: >> Where can I find the documentation describing the buffer >> replacement policy? Are there any parameters governing the page >> replacement policy? > You would need to check the mailing lists. The release

[PERFORM] Simple (hopefully) throughput question?

2010-11-03 Thread Nick Matheson
Hello We have an application that needs to do bulk reads of ENTIRE Postgres tables very quickly (i.e. select * from table). We have observed that such sequential scans run two orders of magnitude slower than observed raw disk reads (5 MB/s versus 100 MB/s). Part of this is due to the storage ov

Re: [PERFORM] Bufer cache replacement LRU algorithm?

2010-11-03 Thread Kenneth Marshall
Mladen, You would need to check the mailing lists. The release notes have it as being a clock sweep algorithm starting in version 8. Then additional changes were added to eliminate the cache blowout caused by a sequential scan and by vacuum/autovacuum. I do not believe that there are any parameter

[PERFORM] Bufer cache replacement LRU algorithm?

2010-11-03 Thread Mladen Gogala
Where can I find the documentation describing the buffer replacement policy? Are there any parameters governing the page replacement policy? -- Mladen Gogala Sr. Oracle DBA 1500 Broadway New York, NY 10036 (212) 329-5251 http://www.vmsinfo.com The Leader in Integrated Media Intelligence Solu

Re: [PERFORM] Test

2010-11-03 Thread Robert Gravsjö
On 2010-11-02 22.21, Mladen Gogala wrote: Can you hear me now? sure -- Regards, Robert "roppert" Gravsjö -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Array interface

2010-11-03 Thread Mladen Gogala
Conor Walsh wrote: I generally suspect this is a Perl problem rather than a Postgres problem, So do I. I had the same situation with Oracle, until John Scoles had the DBD::Oracle driver fixed and started utilizing the Oracle array interface. but can't say more without code. Maybe try pas