Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Scott Marlowe
On Thu, Mar 13, 2008 at 4:53 PM, justin [EMAIL PROTECTED] wrote: I'm ran pgbench from my laptop to the new server My laptop is dual core with 2 gigs of ram and 1 gig enthernet connection to server. so i don't think the network is going to be a problem in the test. When i look at the

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Scott Marlowe
On Thu, Mar 13, 2008 at 3:09 PM, justin [EMAIL PROTECTED] wrote: I chose to use ext3 on these partition You should really consider another file system. ext3 has two flaws that mean I can't really use it properly. A 2TB file system size limit (at least on the servers I've tested) and it locks

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Scott Marlowe
On Fri, Mar 14, 2008 at 12:17 AM, Jesper Krogh [EMAIL PROTECTED] wrote: Scott Marlowe wrote: On Thu, Mar 13, 2008 at 3:09 PM, justin [EMAIL PROTECTED] wrote: I chose to use ext3 on these partition You should really consider another file system. ext3 has two flaws that mean I

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Scott Marlowe
On Fri, Mar 14, 2008 at 12:19 AM, Scott Marlowe [EMAIL PROTECTED] wrote: On Fri, Mar 14, 2008 at 12:17 AM, Jesper Krogh [EMAIL PROTECTED] wrote: Scott Marlowe wrote: On Thu, Mar 13, 2008 at 3:09 PM, justin [EMAIL PROTECTED] wrote: I chose to use ext3 on these partition

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Jesper Krogh
Scott Marlowe wrote: On Fri, Mar 14, 2008 at 12:17 AM, Jesper Krogh [EMAIL PROTECTED] wrote: Scott Marlowe wrote: On Thu, Mar 13, 2008 at 3:09 PM, justin [EMAIL PROTECTED] wrote: I chose to use ext3 on these partition You should really consider another file system. ext3 has two

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Jesper Krogh
Scott Marlowe wrote: On Thu, Mar 13, 2008 at 3:09 PM, justin [EMAIL PROTECTED] wrote: I chose to use ext3 on these partition You should really consider another file system. ext3 has two flaws that mean I can't really use it properly. A 2TB file system size limit (at least on the servers

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Greg Smith
On Fri, 14 Mar 2008, Justin wrote: I played with shared_buffer and never saw much of an improvement from 100 all the way up to 800 megs moved the checkpoints from 3 to 30 and still never saw no movement in the numbers. Increasing shared_buffers normally improves performance as the size of

Re: [PERFORM] ER diagram tool

2008-03-14 Thread sathiya psql
14:31 rtfm_please For information about erd 14:31 rtfm_please see http://druid.sf.net/ 14:31 rtfm_please or http://schemaspy.sourceforge.net/ A very great Thanks. SchemaSpy drawn ER diagram by referring my database... it done a very good job Thanks a lot GUY...

[PERFORM] Lots of semop calls under load

2008-03-14 Thread Albe Laurenz
On a database (PostgreSQL 8.2.4 on 64-bit Linux 2.6.18 on 8 AMD Opterons) that is under high load, I observe the following: - About 200 database sessions concurrently issue queries, most of them small, but I have found one that touches 38000 table and index blocks. - vmstat shows that CPU time

Re: [PERFORM] Lots of semop calls under load

2008-03-14 Thread Tom Lane
Albe Laurenz [EMAIL PROTECTED] writes: On a database (PostgreSQL 8.2.4 on 64-bit Linux 2.6.18 on 8 AMD Opterons) that is under high load, I observe the following: ... - vmstat shows that CPU time is divided between idle and iowait, with user and sys time practically zero. - sar says that

[PERFORM] Adaptec 5805 SAS Raid

2008-03-14 Thread Glyn Astill
Any of you chaps used this controller? ___ Rise to the challenge for Sport Relief with Yahoo! For Good http://uk.promotions.yahoo.com/forgood/ -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To

[PERFORM] The many nulls problem

2008-03-14 Thread Kynn Jones
It often happens that a particular pieces of information is non-null for a small minority of cases. A superficially different manifestation of this is when two pieces of information are identical in all but a small minority of cases. This can be easily mapped to the previous description by

Re: [PERFORM] The many nulls problem

2008-03-14 Thread Oleg Bartunov
Kynn, have you seen contrib/hstore ? You can have one table with common attributes and hide others in hstore Oleg On Fri, 14 Mar 2008, Kynn Jones wrote: It often happens that a particular pieces of information is non-null for a small minority of cases. A superficially different manifestation

Re: [PERFORM] Hardware question for a DB server

2008-03-14 Thread Pascal Cohen
Greg Smith wrote: On Wed, 12 Mar 2008, Mark Lewis wrote: One question that's likely going to be important depending on your answers above is whether or not you're getting a battery-backed write cache for that ServeRAID-8K. Apparently there's a 8k-l and an regular 8-k; the l doesn't have the

Re: [PERFORM] Hardware question for a DB server

2008-03-14 Thread Scott Marlowe
On Fri, Mar 14, 2008 at 1:24 PM, Pascal Cohen [EMAIL PROTECTED] wrote: I agree with what you are saying. We are using Java with a pool of connections to access the DB. Today our database is really small compared to the RAM but it may evolve and even will probably grow (hope so which would

Re: [PERFORM] The many nulls problem

2008-03-14 Thread Heikki Linnakangas
Kynn Jones wrote: In all these cases, the design choice, at least according to RDb's 101, is between including a column in the table that will be NULL most of the time, or defining a second auxiliary column that references the first one and holds the non-redundant information for the minority of

Re: [PERFORM] The many nulls problem

2008-03-14 Thread Kynn Jones
On Fri, Mar 14, 2008 at 3:46 PM, Heikki Linnakangas [EMAIL PROTECTED] wrote: tons of useful info snipped From performance point of view, I would go with a single table with NULL fields on PostgreSQL. Wow. I'm so glad I asked! Thank you very much! Kynn

Re: [PERFORM] The many nulls problem

2008-03-14 Thread Kynn Jones
On Fri, Mar 14, 2008 at 2:59 PM, Oleg Bartunov [EMAIL PROTECTED] wrote: have you seen contrib/hstore ? You can have one table with common attributes and hide others in hstore That's interesting. I'll check it out. Thanks! Kynn

Re: [PERFORM] The many nulls problem

2008-03-14 Thread Oleg Bartunov
On Fri, 14 Mar 2008, Kynn Jones wrote: On Fri, Mar 14, 2008 at 2:59 PM, Oleg Bartunov [EMAIL PROTECTED] wrote: have you seen contrib/hstore ? You can have one table with common attributes and hide others in hstore That's interesting. I'll check it out. Thanks! actually, hstore was

Re: [PERFORM] Anyone using a SAN?

2008-03-14 Thread Peter Koczan
Hi all, I had a few meetings with SAN vendors and I thought I'd give you some follow-up on points of potential interest. - Dell/EMC The representative was like the Dell dude grown up. The sales pitch mentioned price point about twenty times (to the point where it was annoying), and the pitch

Re: [PERFORM] Adaptec 5805 SAS Raid

2008-03-14 Thread Leigh Dyer
Glyn Astill wrote: Any of you chaps used this controller? It looks very similar to the rebadged Adaptec that Sun shipped in the X4150 I ordered a few weeks ago, though the Sun model had only 256MB of cache RAM. I was wary of going Adaptec after my experiences with the PERC/3i, which

[PERFORM] best way to run maintenance script

2008-03-14 Thread Vinubalaji Gopal
Hi all, I have been searching for the best way to run maintenance scripts which does a vacuum, analyze and deletes some old data. Whenever the maintenance script runs - mainly the pg_maintenance --analyze script - it slows down postgresql inserts and I want to avoid that. The system is under

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Joshua D. Drake
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Fri, 14 Mar 2008 17:00:21 -0800 Vinubalaji Gopal [EMAIL PROTECTED] wrote: Hi all, I have been searching for the best way to run maintenance scripts which does a vacuum, analyze and deletes some old data. Whenever the maintenance script runs

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Vinubalaji Gopal
Hi Joshua, You can use parameters such as vacuum_cost_delay to help this... see the docs: http://www.postgresql.org/docs/8.3/static/runtime-config-autovacuum.html I am checking it out. Seems to be a nice option for vacuum - but wish there was a way to change the delete priority or I will

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Tom Lane
Vinubalaji Gopal [EMAIL PROTECTED] writes: If you are truly running 8.0 and not something like 8.0.15 vacuum is the least of your worries. Its 8.0.4. That's only a little bit better. Read about all the bug fixes you're missing at http://www.postgresql.org/docs/8.0/static/release.html and

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Joshua D. Drake
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Fri, 14 Mar 2008 17:51:52 -0800 Vinubalaji Gopal [EMAIL PROTECTED] wrote: Hi Joshua, You can use parameters such as vacuum_cost_delay to help this... see the docs:

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Vinubalaji Gopal
On Fri, 2008-03-14 at 18:37 -0700, Tom Lane wrote: That's only a little bit better. Read about all the bug fixes you're Sure - will eventually upgrade it sometime - but it has to wait for now :( -- Vinu -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Vinubalaji Gopal
I think you will find if you do it the right way, which is to say the way that it is meant to be done with the configurable options, your life will be a great deal more pleasant than some one off hack. yeah I agree. The pg_maintanence script which calls vacuum and analyze is the one of