Re: [PERFORM] Shared memory for large PostGIS operations

2012-03-16 Thread Kevin Grittner
Brian Hamlin wrote: > On Mar 16, 2012, at 7:17 AM, Kevin Grittner wrote: >> Andy Colson wrote: >> >>> I tried shared_buffers at both 2400M and 18000M, and it took 4.5 >>> hours both times. ... (weak attempts at humor omitted) Ah, I didn't pick up on the attempts at humor; perhaps that's w

Re: [PERFORM] Obtaining resource usage statistics from execution? (v 9.1)

2012-03-16 Thread Ants Aasma
On Fri, Mar 16, 2012 at 4:31 PM, Karl Denninger wrote: > What I'd > like to be able to do is have the code track performance all the time and > raise alerts when it sees "outliers" giving me a continually-improving set > of targets for reduction of resource consumption (up until I reach the point

Re: [PERFORM] Obtaining resource usage statistics from execution? (v 9.1)

2012-03-16 Thread Karl Denninger
On 3/16/2012 9:53 AM, Tom Lane wrote: > Karl Denninger writes: >> I am trying to continue profiling which in turn feeds query and index >> tuning changes for the AKCS-WWW forum software, and appear to have no >> good way to do what I need to do -- or I've missed something obvious. > Do you really

Re: [PERFORM] Obtaining resource usage statistics from execution? (v 9.1)

2012-03-16 Thread Tomas Vondra
Hi, first of all, which PostgreSQL version are you using, what platform is it running on? What level of control do you have over the database (are you just a user or can you modify the postgresql.conf file)? On 16 Březen 2012, 15:31, Karl Denninger wrote: > Hi folks; > > I am trying to continue p

Re: [PERFORM] Obtaining resource usage statistics from execution? (v 9.1)

2012-03-16 Thread Tom Lane
Karl Denninger writes: > I am trying to continue profiling which in turn feeds query and index > tuning changes for the AKCS-WWW forum software, and appear to have no > good way to do what I need to do -- or I've missed something obvious. Do you really want the application involved in this? Usua

[PERFORM] Obtaining resource usage statistics from execution? (v 9.1)

2012-03-16 Thread Karl Denninger
Hi folks; I am trying to continue profiling which in turn feeds query and index tuning changes for the AKCS-WWW forum software, and appear to have no good way to do what I need to do -- or I've missed something obvious. The application uses the libpq interface from "C" to talk to Postgres which c

Re: [PERFORM] Shared memory for large PostGIS operations

2012-03-16 Thread Kevin Grittner
Andy Colson wrote: > I tried shared_buffers at both 2400M and 18000M, and it took 4.5 > hours both times. I dont know if I am CPU bound or IO bound, but > since giving PG more ram didnt help much, I'll assume I'm CPU > bound. All else being the same, adjusting shared_buffers affects how much

Re: [PERFORM] Shared memory for large PostGIS operations

2012-03-16 Thread Andy Colson
So let me clean that up for you: > On 3/14/2012 11:29 PM, mapl...@light42.com wrote: Hello list, my name is Brian Hamlin, but I prefer to go by darkblue, its mysterious and dangerous! I run PG 9.1, PostGIS 1.5.3, Linux 64 on Dual Xeons, OS on a single drive, and db is on 3-disk raid 5. I'

[PERFORM] Shared memory for large PostGIS operations

2012-03-16 Thread maplabs
(from #postgresql IRC on freenode) darkblue_b I did an interesting experiment the other day davidfetter_vmw .. davidfetter_vmw do tell darkblue_b well you know I do these huge monolithic postGIS queries on an otherwise idle linux machine.. and there was a persistant thought in my head that Post