Re: [PERFORM] scalablility problem

2007-04-01 Thread Dave Cramer
I may have missed this but have you tuned your postgresql configuration ? 8.2 tuning guidelines are significantly different than 7.3 Dave On 1-Apr-07, at 1:51 PM, Xiaoning Ding wrote: I repeated the test again. It took 0.92 second under 8.2.3. I checked system load using top and ps. There i

Re: [PERFORM] scalablility problem

2007-04-01 Thread Xiaoning Ding
I repeated the test again. It took 0.92 second under 8.2.3. I checked system load using top and ps. There is no other active processes. Xiaoning Ron Mayer wrote: Xiaoning Ding wrote: Postgresql is 7.3.18. [...] 1 process takes 0.65 second to finish. I update PG to 8.2.3. The results are [..

Re: [PERFORM] scalablility problem

2007-04-01 Thread Ron Mayer
Xiaoning Ding wrote: > Postgresql is 7.3.18. [...] > 1 process takes 0.65 second to finish. > I update PG to 8.2.3. The results are [...] now. > 1 process :0.94 second You sure about your test environment? Anything else running at the same time, perhaps? I'm a bit surprised that 8.2.3 would

Re: [PERFORM] scalablility problem

2007-03-31 Thread Xiaoning Ding
Tom Lane wrote: "Joshua D. Drake" <[EMAIL PROTECTED]> writes: I use RHEL 4. I can not understand how the scalability related with shared memory? It isn't RHEL4 and shared memory. It is PostgreSQL and shared memory. Things have changed with PostgreSQL since 7.3 (7.3 is really god awful old) t

Re: [PERFORM] scalablility problem

2007-03-31 Thread Tom Lane
"Joshua D. Drake" <[EMAIL PROTECTED]> writes: >> I use RHEL 4. I can not understand how the scalability related with >> shared memory? > It isn't RHEL4 and shared memory. It is PostgreSQL and shared memory. > Things have changed with PostgreSQL since 7.3 (7.3 is really god awful > old) that all

Re: [PERFORM] scalablility problem

2007-03-31 Thread Xiaoning Ding
Michael Stone wrote: On Fri, Mar 30, 2007 at 10:00:30PM -0600, Guido Neitzer wrote: On 30.03.2007, at 19:18, Christopher Browne wrote: 2. There are known issues with the combination of Xeon processors and PAE memory addressing; that sort of hardware tends to be *way* less speedy than the specs

Re: [PERFORM] scalablility problem

2007-03-31 Thread Xiaoning Ding
Christopher Browne wrote: Quoth [EMAIL PROTECTED] (Xiaoning Ding): When I run multiple TPC-H queries (DBT3) on postgresql, I found the system is not scalable. My machine has 8GB memory, and 4 Xeon Dual Core processor ( 8 cores in total). OS kernel is linux 2.6.9. Postgresql is 7.3.18. I I t

Re: [PERFORM] scalablility problem

2007-03-31 Thread Joshua D. Drake
pgsql 7.3 cannot take advantage of lots of shared memory, and has some issues scaling to lots of CPUs / processes. I use RHEL 4. I can not understand how the scalability related with shared memory? It isn't RHEL4 and shared memory. It is PostgreSQL and shared memory. Things have changed wi

Re: [PERFORM] scalablility problem

2007-03-31 Thread Xiaoning Ding
Scott Marlowe wrote: On Fri, 2007-03-30 at 15:25, Xiaoning Ding wrote: Hi all, When I run multiple TPC-H queries (DBT3) on postgresql, I found the system is not scalable. My machine has 8GB memory, and 4 Xeon Dual Core processor ( 8 cores in total). OS kernel is linux 2.6.9. Postgresql is 7.3

Re: [PERFORM] scalablility problem

2007-03-31 Thread Michael Stone
On Fri, Mar 30, 2007 at 10:00:30PM -0600, Guido Neitzer wrote: On 30.03.2007, at 19:18, Christopher Browne wrote: 2. There are known issues with the combination of Xeon processors and PAE memory addressing; that sort of hardware tends to be *way* less speedy than the specs would suggest. That

Re: [PERFORM] scalablility problem

2007-03-30 Thread Guido Neitzer
On 30.03.2007, at 19:18, Christopher Browne wrote: 2. There are known issues with the combination of Xeon processors and PAE memory addressing; that sort of hardware tends to be *way* less speedy than the specs would suggest. That is not true as the current series of processors (Woodcrest and

Re: [PERFORM] scalablility problem

2007-03-30 Thread Christopher Browne
Quoth [EMAIL PROTECTED] (Xiaoning Ding): > When I run multiple TPC-H queries (DBT3) on postgresql, I found the system > is not scalable. My machine has 8GB memory, and 4 Xeon Dual Core processor > ( 8 cores in total). OS kernel is linux 2.6.9. Postgresql is 7.3.18. I > I think it might be caused

Re: [PERFORM] scalablility problem

2007-03-30 Thread Scott Marlowe
On Fri, 2007-03-30 at 16:38, Xiaoning Ding wrote: > Thanks guys, > > I update PG to 8.2.3. The results are much better now. > 1 process :0.94 second > 2 processes: 1.32 seconds > 4 processes: 2.03 seconds > 8 processes: 2.54 seconds > > Do you think they are good enough? > BTW where can I fou

Re: [PERFORM] scalablility problem

2007-03-30 Thread Scott Marlowe
On Fri, 2007-03-30 at 15:25, Xiaoning Ding wrote: > Hi all, > > When I run multiple TPC-H queries (DBT3) on postgresql, I found the system > is not scalable. My machine has 8GB memory, and 4 Xeon Dual Core processor > ( 8 cores in total). OS kernel is linux 2.6.9. Postgresql is 7.3.18. I > run

Re: [PERFORM] scalablility problem

2007-03-30 Thread Xiaoning Ding
Thanks guys, I update PG to 8.2.3. The results are much better now. 1 process :0.94 second 2 processes: 1.32 seconds 4 processes: 2.03 seconds 8 processes: 2.54 seconds Do you think they are good enough? BTW where can I found some info on what 8.2.3 did to improve scalability compared with p

Re: [PERFORM] scalablility problem

2007-03-30 Thread Tom Lane
Xiaoning Ding <[EMAIL PROTECTED]> writes: > When I run multiple TPC-H queries (DBT3) on postgresql, I found the system > is not scalable. My machine has 8GB memory, and 4 Xeon Dual Core processor > ( 8 cores in total). OS kernel is linux 2.6.9. Postgresql is 7.3.18. If you are not running PG 8.1

Re: [PERFORM] scalablility problem

2007-03-30 Thread Dave Dutcher
> From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Xiaoning Ding > > > Hi all, > > When I run multiple TPC-H queries (DBT3) on postgresql, I > found the system > is not scalable. My machine has 8GB memory, and 4 Xeon Dual > Core processor > ( 8 cores in total). OS kernel

[PERFORM] scalablility problem

2007-03-30 Thread Xiaoning Ding
Hi all, When I run multiple TPC-H queries (DBT3) on postgresql, I found the system is not scalable. My machine has 8GB memory, and 4 Xeon Dual Core processor ( 8 cores in total). OS kernel is linux 2.6.9. Postgresql is 7.3.18. I run multiple q2 queries simultaneously. The results are: 1 proc