[PERFORM] How to configure a read-only database server?

2011-04-18 Thread Stefan Keller
I browsed the faq and looked at PostgreSQL performance books but I could not find the obvious: How to configure a read-only database server? I have a single-disk virtual Linux system and a read-only dataset which is exposed to internet and completely replaced from time to time. This is what I fou

Re: [PERFORM] big distinct clause vs. group by

2011-04-18 Thread Uwe Bartels
Hi Robert, thanks for your answer. the aggregate function I was talking about is the function I need to use for the non-group by columns like min() in my example. There are of course several function to choose from, and I wanted to know which causes as less as possible resources. best regards, Uw

Re: [PERFORM] Select in subselect vs select = any array

2011-04-18 Thread Robert Haas
On Sun, Mar 20, 2011 at 11:20 PM, Adam Tistler wrote: > logicops2=# explain analyze select count(*) from nodes where node_id = any(   > Array(select node_id from nodes limit 10) ); >                                                               QUERY PLAN >

Re: [PERFORM] Background fsck

2011-04-18 Thread Pierre C
What's more, this is already a new controller. It replaced the previous one because of exactly the same persisting problem. I think tech support people not knowing a solution just buy some time for them and say "flash this beta firmware maybe it helps" or "replace your hardware". We had a

Re: [PERFORM] Assessing performance of fetches

2011-04-18 Thread Tom Lane
John Rouillard writes: > I am seeing: > 2011-04-16 00:55:33 UTC user@database(3516): LOG: duration: > 371954.811 ms statement: FETCH FORWARD 1 FROM c_2aaeea50_a08 > While I obviously have a problem here, is there any way to log the > actual select associated with the cursor other th

[PERFORM] Assessing performance of fetches

2011-04-18 Thread John Rouillard
Hi all: An application running against a postgres 8.4.5 database under CentOS 5.5 uses cursors (I think via SqlAlchemy). To look for database performance issues I log any query that takes > 2 seconds to complete. I am seeing: 2011-04-16 00:55:33 UTC user@database(3516): LOG: duration: 37

Re: [PERFORM] Adding additional index causes 20,000x slowdown for certain select queries - postgres 9.0.3

2011-04-18 Thread Robert Haas
On Wed, Mar 16, 2011 at 1:38 PM, Tom Lane wrote: > That isn't going to dissuade the planner from using that index for this > query.  It would result in the scan being a forward indexscan instead of > backwards.  Now it'd be worth trying that, to see if you and Kevin are > right that it's the backw

Re: [PERFORM] Custom operator class costs

2011-04-18 Thread Robert Haas
On Wed, Mar 16, 2011 at 10:10 AM, Ben Beecher wrote: > Hey! > I'm having some trouble optimizing a query that uses a custom operator class. > #Postgres has given me a solution for natural sort - > http://www.rhodiumtoad.org.uk/junk/naturalsort.sql > > I'm trying to run it over a huge table - when

Re: [PERFORM] big distinct clause vs. group by

2011-04-18 Thread Robert Haas
On Wed, Mar 16, 2011 at 4:45 AM, Uwe Bartels wrote: > I'm having trouble with some sql statements which use an expression with > many columns and distinct in the column list of the select. > select distinct col1,col2,.col20,col21 > from table1 left join table2 on ,... > where >  ; > > The nega

Re: [PERFORM] Index use difference betweer LIKE, LIKE ANY?

2011-04-18 Thread Robert Haas
On Tue, Mar 15, 2011 at 8:30 AM, Chetan Suttraway wrote: > On Sun, Feb 27, 2011 at 2:43 AM, Josh Berkus wrote: >> >> On 2/25/11 5:31 AM, Sam Wong wrote: >> > I found that "LIKE", "= ANY (...)", "LIKE .. OR LIKE .." against a text >> > field used the index correctly, but not "LIKE ANY (...)". Woul

Re: [PERFORM] Is there a way to selective dump of records in Postgres 9.0.3?

2011-04-18 Thread Samuel Gendler
On Mon, Apr 18, 2011 at 8:11 AM, Nikolas Everett wrote: > This probably isn't the right place to ask that question but you may as > well try `pg_dump -t PATTERN`. Man pg_dump for more information on how to > form that pattern. > > > On Mon, Apr 18, 2011 at 11:05 AM, Sethu Prasad > wrote: > >> H

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-04-18 Thread tv
> Thanks. But let me do the "top" stuff later. I think I have a bigger > problem now. > > While doing a PG dump, I seem to get this error: > > ERROR: invalid memory alloc request size 4294967293 > > Upon googling, this seems to be a data corruption issue! > > One of the older messages suggests

Re: [PERFORM] Is there a way to selective dump of records in Postgres 9.0.3?

2011-04-18 Thread Nikolas Everett
This probably isn't the right place to ask that question but you may as well try `pg_dump -t PATTERN`. Man pg_dump for more information on how to form that pattern. On Mon, Apr 18, 2011 at 11:05 AM, Sethu Prasad wrote: > Hi List, > I am using PostgreSQL 9.0.3 and I have a need to dump only the s

[PERFORM] Is there a way to selective dump of records in Postgres 9.0.3?

2011-04-18 Thread Sethu Prasad
Hi List, I am using PostgreSQL 9.0.3 and I have a need to dump only the selective data from partial list of tables of a database. Is there a straight way to do it with pg_dump or any alternative work around to suggest here?! Sethu Prasad. G.

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-04-18 Thread Sethu Prasad
You mean the maintenance instead of mentioning the recovery? If yes The following types of administration commands are not accepted during recovery mode: - * Data Definition Language (DDL) - e.g. CREATE INDEX* - * Privilege and Ownership - GRANT, REVOKE, REASSIGN* - * Mainten

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-04-18 Thread Scott Marlowe
On Mon, Apr 18, 2011 at 1:45 AM, Phoenix Kiula wrote: > On Mon, Apr 18, 2011 at 3:38 PM, Scott Marlowe > wrote: >> On Sun, Apr 17, 2011 at 11:19 PM, Phoenix Kiula >> wrote: >>> Btw, hardware is not an issue. My db has been working fine for a >>> while. Smaller poorer systems around the web run

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-04-18 Thread Phoenix Kiula
On Mon, Apr 18, 2011 at 3:38 PM, Scott Marlowe wrote: > On Sun, Apr 17, 2011 at 11:19 PM, Phoenix Kiula > wrote: >> Btw, hardware is not an issue. My db has been working fine for a >> while. Smaller poorer systems around the web run InnoDB databases. I >> wouldn't touch that with a barge pole. >

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-04-18 Thread Scott Marlowe
On Sun, Apr 17, 2011 at 11:19 PM, Phoenix Kiula wrote: > Btw, hardware is not an issue. My db has been working fine for a > while. Smaller poorer systems around the web run InnoDB databases. I > wouldn't touch that with a barge pole. > > I have a hardware RAID controller, not "fake". It's a good q

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-04-18 Thread Scott Marlowe
On Mon, Apr 18, 2011 at 1:26 AM, Scott Marlowe wrote: > On Sun, Apr 17, 2011 at 11:19 PM, Phoenix Kiula > wrote: >> Btw, hardware is not an issue. My db has been working fine for a >> while. Smaller poorer systems around the web run InnoDB databases. I >> wouldn't touch that with a barge pole. >

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-04-18 Thread Scott Marlowe
On Sun, Apr 17, 2011 at 11:19 PM, Phoenix Kiula wrote: > Btw, hardware is not an issue. My db has been working fine for a > while. Smaller poorer systems around the web run InnoDB databases. I > wouldn't touch that with a barge pole. Did you or someone in an earlier post say that you didn't have

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-04-18 Thread Shashank Tripathi
People are running larger InnoDB databases on poorer hardware. Note that I wouldn't dream of it because I care about data integrity and stability, but this discussion is purely about performance and I know it is possible. I am sure throwing hardware at it is not the solution. Just trying to highli