Re: [PERFORM] Master/Slave, DB separation or just spend $$$?

2009-07-22 Thread David Rees
On Wed, Jul 22, 2009 at 12:52 AM, Kelvin Quee wrote: > I have been staring at *top* for a while and it's mostly been 40% in > userspace and 30% in system. Wait is rather low and never ventures > beyond 1%. Certainly seems like you are CPU bound. > My hardware is a duo core AMD Athlon64 X2 5000+,

Re: [PERFORM] Atomic access to large arrays

2009-07-22 Thread Victor de Buen
Thank a lot, Merlin. I will try to fill a sample of grids in a new table with different sizes of subgrids in order to get the better relation between space and speed. Regards 2009/7/22 Merlin Moncure > On Tue, Jul 21, 2009 at 7:43 PM, Victor de Buen > (Bayes) wrote: > > Hi > > > > I'm storing

Re: [PERFORM] regression ? 8.4 do not apply One-Time Filter to subquery

2009-07-22 Thread Robert Haas
On Wed, Jul 1, 2009 at 8:08 PM, Sergey Burladyan wrote: > > 8.4 from CVS HEAD: > EXPLAIN ANALYZE select * from (select n, 1 as r from generate_series(1, > 10) as n union all select n, 2 from generate_series(1, 10) as n) as x > where r = 3; >                                                

Re: [PERFORM] Odd performance / query plan with bitmasked field as opposed to equality

2009-07-22 Thread Robert Haas
On Mon, Jul 13, 2009 at 4:46 PM, Frank Joerdens wrote: > I can't figure what is going on below; first of all, this count  which > returns 1.5 million from a ~2 million row table: > > woome=# explain analyze SELECT COUNT(*) FROM "webapp_person" WHERE > "webapp_person"."permissionflags" = > B'000

Re: [PERFORM] Atomic access to large arrays

2009-07-22 Thread Merlin Moncure
On Tue, Jul 21, 2009 at 7:43 PM, Victor de Buen (Bayes) wrote: > Hi > > I'm storing historical meteorological gridded data from GFS > (http://www.nco.ncep.noaa.gov/pmb/products/gfs/) into an array field in a > table like this: > > CREATE TABLE grid_f_data_i2 ( >   //Specifies the variable and other

Re: [PERFORM] Master/Slave, DB separation or just spend $$$?

2009-07-22 Thread Chris Browne
kelv...@gmail.com (Kelvin Quee) writes: > I will go look at Slony now. It's worth looking at, but it is not always to be assumed that replication will necessarily improve scalability of applications; it's not a "magic wand" to wave such that "presto, it's all faster!" Replication is helpful from

Re: [PERFORM] Atomic access to large arrays

2009-07-22 Thread Victor de Buen (Bayes)
Thank you very much, Tom I will try vector 'parallel' and 'vertical' strategies. Regards 2009/7/22 Tom Lane > "Victor de Buen (Bayes)" writes: > > I'm storing historical meteorological gridded data from GFS ( > > http://www.nco.ncep.noaa.gov/pmb/products/gfs/) into an array field in a > > tab

Re: [PERFORM] Master/Slave, DB separation or just spend $$$?

2009-07-22 Thread Greg Sabino Mullane
-BEGIN PGP SIGNED MESSAGE- Hash: RIPEMD160 > I have a db which is being constantly updated and queried by a few > computers. We are doing datamining. The machine is running on a > moderately powered

Re: [PERFORM] Atomic access to large arrays

2009-07-22 Thread Victor de Buen
Thank you very much, Tom I will try vector 'parallel' and 'vertical' strategies. Regards 2009/7/22 Tom Lane > "Victor de Buen (Bayes)" writes: > > I'm storing historical meteorological gridded data from GFS ( > > http://www.nco.ncep.noaa.gov/pmb/products/gfs/) into an array field in a > > tab

Re: [PERFORM] Atomic access to large arrays

2009-07-22 Thread Tom Lane
"Victor de Buen (Bayes)" writes: > I'm storing historical meteorological gridded data from GFS ( > http://www.nco.ncep.noaa.gov/pmb/products/gfs/) into an array field in a > table like this: > vl_grid smallint[361][720], >- It's posible to tune some TOAST parameters to get faster atomic ac

Re: [PERFORM] Master/Slave, DB separation or just spend $$$?

2009-07-22 Thread Scott Marlowe
On Wed, Jul 22, 2009 at 1:52 AM, Kelvin Quee wrote: > Hi Scott, > > Thanks for the quick reply. > > I have been staring at *top* for a while and it's mostly been 40% in > userspace and 30% in system. Wait is rather low and never ventures > beyond 1%. > > My hardware is a duo core AMD Athlon64 X2 50

Re: [PERFORM] Atomic access to large arrays

2009-07-22 Thread Victor de Buen
Hi I'm storing historical meteorological gridded data from GFS ( http://www.nco.ncep.noaa.gov/pmb/products/gfs/) into an array field in a table like this: CREATE TABLE grid_f_data_i2 ( //Specifies the variable and other features of data id_inventory integer REFERENCES grid_d_inventory(id_inve

Re: [PERFORM] Master/Slave, DB separation or just spend $$$?

2009-07-22 Thread Kelvin Quee
Hi Scott, Thanks for the quick reply. I have been staring at *top* for a while and it's mostly been 40% in userspace and 30% in system. Wait is rather low and never ventures beyond 1%. My hardware is a duo core AMD Athlon64 X2 5000+, 1GB RAM and a single 160 GB SATA II hard disk drive. I will g