Re: [GENERAL] checkpoints anatomy

2015-10-11 Thread Achilleas Mantzios
http://dba.stackexchange.com/questions/61822/what-happens-in-postgresql-checkpoint and the now classic : http://www.depesz.com/2011/07/14/write-ahead-log-understanding-postgresql-conf-checkpoint_segments-checkpoint_timeout-checkpoint_warning/ On 12/10/2015 04:39, Richardson Hinestroza wrote: He

[GENERAL] checkpoints anatomy

2015-10-11 Thread Richardson Hinestroza
Hello, excuse me for my poor english. i am writting from Colombia and i am postgresql fan. I want to know if postgresql checkpoints prevent current transactions to write the same page being flush to disk by checkpoint proccess. And I want know if the postgresql checkpoint use the ARIES algorithmo

Re: [GENERAL] checkpoints are occurring too frequently

2011-11-17 Thread Anibal David Acosta
Thanks! -Mensaje original- De: Gabriele Bartolini [mailto:gabriele.bartol...@2ndquadrant.it] Enviado el: jueves, 17 de noviembre de 2011 10:14 a.m. Para: Anibal David Acosta CC: pgsql-general@postgresql.org Asunto: Re: [GENERAL] checkpoints are occurring too frequently Hi Anibal

Re: [GENERAL] checkpoints are occurring too frequently

2011-11-17 Thread Gabriele Bartolini
Hi Anibal, On Thu, 17 Nov 2011 09:48:10 -0300, "Anibal David Acosta" wrote: What should be a correct value for checkpoint_segments to avoid excessive checkpoint events? There is no golden rule or value that fits all scenarios. Usually 32 is a good value to start with, however it might not b

Re: [GENERAL] checkpoints are occurring too frequently

2011-11-17 Thread Gregg Jaskiewicz
increase your checkpoint segments -- GJ -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

[GENERAL] checkpoints are occurring too frequently

2011-11-17 Thread Anibal David Acosta
I have a lot of entries like this in the log file 2011-11-17 02:02:46 PYST LOG: checkpoints are occurring too frequently (13 seconds apart) 2011-11-17 02:02:46 PYST HINT: Consider increasing the configuration parameter "checkpoint_segments". No, checkpoint parameters in postgres.conf are

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-11-20 Thread Andres Freund
On Friday 30 October 2009 15:30:34 Vick Khera wrote: > I really don't think I'm saturating the disk bandwidth. I see spikes > of 18MB/s or more, but it usually hovers at under 3MB/s according to > iostat output. Looking at the iostat -x output is often more interesting - especially the utilizatio

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Vick Khera
On Thu, Oct 29, 2009 at 10:24 PM, Greg Smith wrote: > There are two ways that that writes can hang: > > 1) You've gotten to the point in the checkpoint cycle where it's calling > fsync to flush everything out of the filesystem.  At this point you could > potentially have a big chunk of data that n

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Vick Khera
On Thu, Oct 29, 2009 at 4:42 PM, Scott Marlowe wrote: > First step to speed things up is putting pg_xlog on its own disk(s). > Since pg_xlog is mostly sequentially access, it's much faster when > Did that with a symlink. I always do that. My frustration is that I have this really fast RAID subs

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Guillaume Lelarge
Le vendredi 30 octobre 2009 à 03:24:05, Greg Smith a écrit : > On Thu, 29 Oct 2009, Vick Khera wrote: > > Greg, do you have a performance tuning book? If so, I really want to > > buy it! Your articles are awesome. > > Give me a few more months... > Are you kidding or is it a great teaser? it w

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Brad Nicholson
On Fri, 2009-10-30 at 07:15 -0400, Steve Clark wrote: > On 10/29/2009 04:42 PM, Scott Marlowe wrote: > > On Thu, Oct 29, 2009 at 12:46 PM, Vick Khera wrote: > >> On my primary DB I'm observing random slowness which just doesn't make > >> sense to me. The I/O system can easily do 40MB/sec writes,

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-30 Thread Steve Clark
On 10/29/2009 04:42 PM, Scott Marlowe wrote: On Thu, Oct 29, 2009 at 12:46 PM, Vick Khera wrote: On my primary DB I'm observing random slowness which just doesn't make sense to me. The I/O system can easily do 40MB/sec writes, but I'm only seeing a sustained 5MB/sec, even as the application is

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-29 Thread Greg Smith
On Thu, 29 Oct 2009, Vick Khera wrote: Greg, do you have a performance tuning book? If so, I really want to buy it! Your articles are awesome. Give me a few more months... basically, the next checkpoint starts within a few seconds of the prior one completing. That's the expected behavior

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-29 Thread Scott Marlowe
On Thu, Oct 29, 2009 at 12:46 PM, Vick Khera wrote: > On my primary DB I'm observing random slowness which just doesn't make > sense to me.  The I/O system can easily do 40MB/sec writes, but I'm > only seeing a sustained 5MB/sec, even as the application is stalling > waiting on the DB. Just one p

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-10-29 Thread Brad Nicholson
On Thu, 2009-10-29 at 14:46 -0400, Vick Khera wrote: > On my primary DB I'm observing random slowness which just doesn't make > sense to me. The I/O system can easily do 40MB/sec writes, but I'm > only seeing a sustained 5MB/sec, even as the application is stalling > waiting on the DB. > > My onl

[GENERAL] checkpoints/bgwriter tuning verification

2009-10-29 Thread Vick Khera
On my primary DB I'm observing random slowness which just doesn't make sense to me. The I/O system can easily do 40MB/sec writes, but I'm only seeing a sustained 5MB/sec, even as the application is stalling waiting on the DB. My only guess is that I'm getting hit by checkpoints too often, and thi

Re: [GENERAL] Checkpoints writes

2008-08-12 Thread Cyril SCETBON
Greg Smith wrote: On Thu, 7 Aug 2008, Cyril SCETBON wrote: What's the way to count the read/write bytes of the checkpoint process before 8.3 (no pg_stat_bgwriter view :-[ ) I want to distinguish bytes written by checkpoints and others written by the background process The reason that view

Re: [GENERAL] Checkpoints writes

2008-08-08 Thread Greg Smith
On Thu, 7 Aug 2008, Cyril SCETBON wrote: What's the way to count the read/write bytes of the checkpoint process before 8.3 (no pg_stat_bgwriter view :-[ ) I want to distinguish bytes written by checkpoints and others written by the background process The reason that view was added was because

[GENERAL] Checkpoints writes

2008-08-07 Thread Cyril SCETBON
Hi guys, What's the way to count the read/write bytes of the checkpoint process before 8.3 (no pg_stat_bgwriter view :-[ ) I want to distinguish bytes written by checkpoints and others written by the background process thanks -- Cyril SCETBON -- Sent via pgsql-general mailing list (pgsql-gen

Re: [GENERAL] Checkpoints questions

2008-03-04 Thread Henrik
4 mar 2008 kl. 13.45 skrev Greg Smith: On Tue, 4 Mar 2008, Henrik wrote: As a starter does anyone have some clues how to analyse this: db=# select * from pg_stat_bgwriter; checkpoints_timed | checkpoints_req | buffers_checkpoint | buffers_clean | maxwritten_clean | buffers_backend | buffer

Re: [GENERAL] Checkpoints questions

2008-03-04 Thread Greg Smith
On Tue, 4 Mar 2008, Henrik wrote: As a starter does anyone have some clues how to analyse this: db=# select * from pg_stat_bgwriter; checkpoints_timed | checkpoints_req | buffers_checkpoint | buffers_clean | maxwritten_clean | buffers_backend | buffers_alloc ---+--

Re: [GENERAL] Checkpoints questions

2008-03-04 Thread Devi
Hi, Hope this helps http://www.westnet.com/~gsmith/content/postgresql/chkp-bgw-83.htm Thanks DEVI.G - Original Message - From: "Henrik" <[EMAIL PROTECTED]> To: Sent: Tuesday, March 04, 2008 3:28 PM Subject: [GENERAL] Checkpoints questions Hi list, I'm using

[GENERAL] Checkpoints questions

2008-03-04 Thread Henrik
Hi list, I'm using 8.3 and I've started looking at the new checkpoint features. As a starter does anyone have some clues how to analyse this: db=# select * from pg_stat_bgwriter; checkpoints_timed | checkpoints_req | buffers_checkpoint | buffers_clean | maxwritten_clean | buffers_backend | b

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Tom Lane
"Joshua D. Drake" <[EMAIL PROTECTED]> writes: >> The "factory default" has never been 1; AFAIR it's always been 3, >> and like many of the other defaults that's aimed for small-and-slow >> machines. If you're not short of disk space, something like 30 >> is reasonable. (Note this can cost you 32M

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Joshua D. Drake
It's been suggested in the past that we ought to document multiple sets of parameter choices from "small test platform" to "big fast machine"; MySQL have done something of the sort for a long time. That is probably a good idea. regards, tom lane -- Your PostgreSQL

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Joshua D. Drake
The "factory default" has never been 1; AFAIR it's always been 3, and like many of the other defaults that's aimed for small-and-slow machines. If you're not short of disk space, something like 30 is reasonable. (Note this can cost you 32MB per increment, so a setting of 30 means you're willin

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Scott Marlowe
On Tue, 2005-07-12 at 15:55, Greg Patnude wrote: > -Original Message- > From: Scott Marlowe [mailto:[EMAIL PROTECTED] > Sent: Tuesday, July 12, 2005 11:40 AM > To: Greg Patnude > Cc: pgsql-general@postgresql.org > Subject: Re: [GENERAL] Checkpoints are occurring too fre

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Tom Lane
"Greg Patnude" <[EMAIL PROTECTED]> writes: > From: Scott Marlowe [mailto:[EMAIL PROTECTED] >> So, how often is this running? Once a second, once a minute, once and >> hour? If it's only running once an hour, then something else is wrong. > I've been running it about 2 or 3 times a minute on ave

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Greg Patnude
-Original Message- From: Scott Marlowe [mailto:[EMAIL PROTECTED] Sent: Tuesday, July 12, 2005 11:40 AM To: Greg Patnude Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Checkpoints are occurring too frequently... On Tue, 2005-07-12 at 13:29, Greg Patnude wrote: > "Scott

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Christopher Browne
> LOG: checkpoints are occurring too frequently (19 seconds apart) > HINT: Consider increasing the configuration parameter > "checkpoint_segments". > LOG: checkpoints are occurring too frequently (12 seconds apart) > HINT: Consider increasing the configuration parameter > "checkpoint_segments

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Scott Marlowe
On Tue, 2005-07-12 at 13:29, Greg Patnude wrote: > "Scott Marlowe" <[EMAIL PROTECTED]> wrote in message > news:[EMAIL PROTECTED] > > On Tue, 2005-07-12 at 13:04, Greg Patnude wrote: > >> LOG: checkpoints are occurring too frequently (19 seconds apart) > >> HINT: Consider increasing the configura

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Greg Patnude
"Scott Marlowe" <[EMAIL PROTECTED]> wrote in message news:[EMAIL PROTECTED] > On Tue, 2005-07-12 at 13:04, Greg Patnude wrote: >> LOG: checkpoints are occurring too frequently (19 seconds apart) >> HINT: Consider increasing the configuration parameter >> "checkpoint_segments". >> LOG: checkpoi

Re: [GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Scott Marlowe
On Tue, 2005-07-12 at 13:04, Greg Patnude wrote: > LOG: checkpoints are occurring too frequently (19 seconds apart) > HINT: Consider increasing the configuration parameter > "checkpoint_segments". > LOG: checkpoints are occurring too frequently (12 seconds apart) > HINT: Consider increasing th

[GENERAL] Checkpoints are occurring too frequently...

2005-07-12 Thread Greg Patnude
LOG: checkpoints are occurring too frequently (19 seconds apart) HINT: Consider increasing the configuration parameter "checkpoint_segments". LOG: checkpoints are occurring too frequently (12 seconds apart) HINT: Consider increasing the configuration parameter "checkpoint_segments". LOG: che

[GENERAL] checkpoints

2004-11-11 Thread David Parker
We are starting to ramp-up testing of our application, and we started getting these messages in our log file: LOG: checkpoints are occurring too frequently (15 seconds apart) HINT: Consider increasing the configuration parameter "checkpoint_segments". LOG: recycled transaction log file "00

Re: [GENERAL] Checkpoints

2003-07-22 Thread Dennis Gearon
I mean, what is getting buffered? What performance effects is it supposed allow? Nailah Ogeer wrote: Hello, I have written code to support multiple buffer pools in postgres 7.3.2. Now i am looking at changing the sizes of these buffer pools, but first i need to write all pages to disk. I also nee

Re: [GENERAL] Checkpoints

2003-07-22 Thread Dennis Gearon
pool of what? Nailah Ogeer wrote: Hello, I have written code to support multiple buffer pools in postgres 7.3.2. Now i am looking at changing the sizes of these buffer pools, but first i need to write all pages to disk. I also need to incorporate this code into the backend instead of it being a s

[GENERAL] Checkpoints

2003-07-22 Thread Nailah Ogeer
Hello, I have written code to support multiple buffer pools in postgres 7.3.2. Now i am looking at changing the sizes of these buffer pools, but first i need to write all pages to disk. I also need to incorporate this code into the backend instead of it being a sql statement as it is now. I noticed