Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being monitored ... ?

2006-07-10 Thread hubert depesz lubaczewski
On 7/9/06, Jeff Frost [EMAIL PROTECTED] wrote:
Do you already have a MRTG plugin for postgres that you've written and if so,care to share it with the rest of us?Or better yet, share it with themrtg.org folks?I was thinking of writing one, but if you have one already, I
hate to reinvent the wheel.this is not mrtg plugin. i use snmpd (net-snmpd to be exact), and connect custom scripts to it using exec directive in config.so basically i have series of scripts which all look more or less like this:
#!/bin/bashpsql -U pgdba -d some_database -qAt 'select .';and a series of:Exec some-name /etc/snmpd/addons/somescript.shthat's all.depesz-- 
http://www.depesz.com/ - nowy, lepszy depesz


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being

2006-07-09 Thread Jeff Frost

On Fri, 7 Jul 2006, hubert depesz lubaczewski wrote:


periodically (every 5 minutes) i do:
select sum(xact_commit) + sum(xact_rollback) from pg_stat_database
and then just check against previous value, and calculate per/second. this
is actually handled nicely by mrtg itself.


Hubert,

Do you already have a MRTG plugin for postgres that you've written and if so, 
care to share it with the rest of us?  Or better yet, share it with the 
mrtg.org folks?  I was thinking of writing one, but if you have one already, I 
hate to reinvent the wheel.


--
Jeff Frost, Owner   [EMAIL PROTECTED]
Frost Consulting, LLC   http://www.frostconsultingllc.com/
Phone: 650-780-7908 FAX: 650-649-1954

---(end of broadcast)---
TIP 5: don't forget to increase your free space map settings


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being monitored ... ?

2006-07-07 Thread hubert depesz lubaczewski
On 7/7/06, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote:
Interesting, Hubert.Where/how do you get the data for:- number of transactions per second
periodically (every 5 minutes) i do:select sum(xact_commit) + sum(xact_rollback) from pg_stat_databaseand then just check against previous value, and calculate per/second. this is actually handled nicely by mrtg itself.
- duration of longest queryselect * from pg_stat_activity where current_query !~ 'IDLE' order by query_start asc limit 1;
this has some problems though, but are more or less easily avoidable.depesz-- http://www.depesz.com/ - nowy, lepszy depesz


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being monitored ... ?

2006-07-06 Thread ogjunk-pgjedan
Interesting, Hubert.
Where/how do you get the data for:
  - number of transactions per second 
  - duration of longest query  
 ?

Thanks,
Otis
 
- Original Message  
From: hubert depesz lubaczewski  
To: Marc G. Fournier  
Cc: pgsql-admin@postgresql.org 
Sent: Sunday, June 11, 2006 11:10:20 AM 
Subject: Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being 
monitored ... ? 
 
On 6/10/06, Marc G. Fournier  wrote: The subject kinda says it all ... I know 
there are SNMP patches available 
out there now, but without those ... ? 
 
 
i can tell you what we do monitor: 
1. general server things (free disk space, cpu-idle, load, memory used, swap 
used, context switches, io operations, sockets in state close_wait).  
2. db stuff: 
  - numer of transactions per second 
  - database size 
  - size of specific tables/indices that we know have nasty tendency to grow 
  - number of objects in database 
  - duration of longest query  
  - replication lag (in events, and in time) 
 
to make mrtg graphs of db stuff we made some perl scripts, which are bound to 
snmp using snmp's exec feature. then we just grab the values using mrtg and 
draw. quite simple actually.  
 
depesz 
 
--  
http://www.depesz.com/ - nowy, lepszy depesz 
 
 



---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being monitored ... ?

2006-06-11 Thread hubert depesz lubaczewski
On 6/10/06, Marc G. Fournier [EMAIL PROTECTED] wrote:
The subject kinda says it all ... I know there are SNMP patches availableout there now, but without those ... ?i can tell you what we do monitor:1. general server things (free disk space, cpu-idle, load, memory used, swap used, context switches, io operations, sockets in state close_wait).
2. db stuff: - numer of transactions per second - database size - size of specific tables/indices that we know have nasty tendency to grow - number of objects in database - duration of longest query
 - replication lag (in events, and in time)to make mrtg graphs of db stuff we made some perl scripts, which are bound to snmp using snmp's exec feature. then we just grab the values using mrtg and draw. quite simple actually.
depesz-- http://www.depesz.com/ - nowy, lepszy depesz


[ADMIN] How are ppl monitoring PostgreSQL ... ? What is being monitored ... ?

2006-06-10 Thread Marc G. Fournier


The subject kinda says it all ... I know there are SNMP patches available 
out there now, but without those ... ?



Marc G. Fournier   Hub.Org Networking Services (http://www.hub.org)
Email . [EMAIL PROTECTED]  MSN . [EMAIL PROTECTED]
Yahoo . yscrappy   Skype: hub.orgICQ . 7615664

---(end of broadcast)---
TIP 6: explain analyze is your friend


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being

2006-06-10 Thread Andy Shellam
I'm using a great little Linux program called monit to check that
there's something listening on the 5432 port.  It also monitors
individual process memory and CPU usage etc.  Quite good.

http://www.tildeslash.com/monit/

Andy

Marc G. Fournier wrote:
 
 The subject kinda says it all ... I know there are SNMP patches
 available out there now, but without those ... ?
 
 
 Marc G. Fournier   Hub.Org Networking Services (http://www.hub.org)
 Email . [EMAIL PROTECTED]  MSN . [EMAIL PROTECTED]
 Yahoo . yscrappy   Skype: hub.orgICQ . 7615664
 
 ---(end of broadcast)---
 TIP 6: explain analyze is your friend
 
 !DSPAM:14,448b0f39256841201919775!
 
 


---(end of broadcast)---
TIP 5: don't forget to increase your free space map settings


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being

2006-06-10 Thread Michael Fuhr
On Sat, Jun 10, 2006 at 07:29:52PM +0100, Andy Shellam wrote:
 I'm using a great little Linux program called monit to check that
 there's something listening on the 5432 port.  It also monitors
 individual process memory and CPU usage etc.  Quite good.

A server can be quite broken yet still respond to transport- and
network-layer probes like TCP connections and pings.  Some NMSs
support custom monitors, so whenever possible I like to do
application-layer tests to ensure that the server not only accepts
connections but is indeed behaving as expected.

 Marc G. Fournier wrote:
  
  The subject kinda says it all ... I know there are SNMP patches
  available out there now, but without those ... ?

MRTG can generate graphs of anything you can write a script to
measure, as long as the script returns output in a certain format.
Other packages of that ilk probably have similar capabilities.

-- 
Michael Fuhr

---(end of broadcast)---
TIP 4: Have you searched our list archives?

   http://archives.postgresql.org


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being

2006-06-10 Thread Christopher Browne
[EMAIL PROTECTED] (Michael Fuhr) wrote:
 On Sat, Jun 10, 2006 at 07:29:52PM +0100, Andy Shellam wrote:
 I'm using a great little Linux program called monit to check that
 there's something listening on the 5432 port.  It also monitors
 individual process memory and CPU usage etc.  Quite good.

 A server can be quite broken yet still respond to transport- and
 network-layer probes like TCP connections and pings.  Some NMSs
 support custom monitors, so whenever possible I like to do
 application-layer tests to ensure that the server not only accepts
 connections but is indeed behaving as expected.

I'd generally agree with this; it points to having tests that aren't
so much about PostgreSQL as they are about the applications using
PostgreSQL...

 Marc G. Fournier wrote:
  
  The subject kinda says it all ... I know there are SNMP patches
  available out there now, but without those ... ?

 MRTG can generate graphs of anything you can write a script to
 measure, as long as the script returns output in a certain format.
 Other packages of that ilk probably have similar capabilities.

Our NOC group runs replication tests against various servers that
feed MRTG; they point at a view that is normally frequently updated,
and check to see how elderly the latest value is.

On replicated nodes, this checks the health of replication.

On master nodes, this checks the health of the application itself.
-- 
select 'cbbrowne' || '@' || 'gmail.com';
http://linuxdatabases.info/info/slony.html
Rules of the Evil Overlord #66. My security keypad will actually be a
fingerprint scanner.  Anyone who watches  someone press a  sequence of
buttons or dusts  the pad for fingerprints then  subsequently tries to
enter  by repeating  that  sequence will  trigger  the alarm  system.
http://www.eviloverlord.com/

---(end of broadcast)---
TIP 6: explain analyze is your friend


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being

2006-06-10 Thread Joshua D. Drake

Marc G. Fournier wrote:


The subject kinda says it all ... I know there are SNMP patches 
available out there now, but without those ... ?


We use Nagios to call shell scripts that perform specific requests to a 
PostgreSQL server. Usually over SSH via psql, but you could use anything.


Joshua D. Drake




Marc G. Fournier   Hub.Org Networking Services (http://www.hub.org)
Email . [EMAIL PROTECTED]  MSN . [EMAIL PROTECTED]
Yahoo . yscrappy   Skype: hub.orgICQ . 7615664

---(end of broadcast)---
TIP 6: explain analyze is your friend




--

=== The PostgreSQL Company: Command Prompt, Inc. ===
  Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
  Providing the most comprehensive  PostgreSQL solutions since 1997
 http://www.commandprompt.com/



---(end of broadcast)---
TIP 1: if posting/reading through Usenet, please send an appropriate
  subscribe-nomail command to [EMAIL PROTECTED] so that your
  message can get through to the mailing list cleanly


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being

2006-06-10 Thread Marc G. Fournier

On Sat, 10 Jun 2006, Joshua D. Drake wrote:


Marc G. Fournier wrote:


The subject kinda says it all ... I know there are SNMP patches available 
out there now, but without those ... ?


We use Nagios to call shell scripts that perform specific requests to a 
PostgreSQL server. Usually over SSH via psql, but you could use anything.


'k, so what are you testing for?  Just that a query runs?  time it takes 
to run?  specific results?


SELECT count(1) FROM pg_connections;

would be a good one to graph ...


Marc G. Fournier   Hub.Org Networking Services (http://www.hub.org)
Email . [EMAIL PROTECTED]  MSN . [EMAIL PROTECTED]
Yahoo . yscrappy   Skype: hub.orgICQ . 7615664

---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster


Re: [ADMIN] How are ppl monitoring PostgreSQL ... ? What is being

2006-06-10 Thread Joshua D. Drake


SELECT count(1) FROM pg_connections;

would be a good one to graph ...


Well you should use pg_stat_databases for that :)

We have complete graphing and monitoring service coming out at the end 
of this month.


Joshua D. Drake





Marc G. Fournier   Hub.Org Networking Services (http://www.hub.org)
Email . [EMAIL PROTECTED]  MSN . [EMAIL PROTECTED]
Yahoo . yscrappy   Skype: hub.orgICQ . 7615664




--

=== The PostgreSQL Company: Command Prompt, Inc. ===
  Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
  Providing the most comprehensive  PostgreSQL solutions since 1997
 http://www.commandprompt.com/



---(end of broadcast)---
TIP 3: Have you checked our extensive FAQ?

  http://www.postgresql.org/docs/faq