[ADMIN] streaming replication questions

2011-08-11 Thread Lonni J Friedman
I've got three Linux systems (each with Fedora15-x86_64 running PostgreSQL-9.0.4). I'm attempting to get a basic streaming replication setup going with one master & two standby servers. At this point, the replication portion appears to be working. I can run an 'update' statement on the master, a

Re: [ADMIN] monitoring replicatgion : lag calculation

2011-09-12 Thread Lonni J Friedman
On Mon, Sep 12, 2011 at 10:04 AM, Ben Ciceron wrote: > hello, > > question about WAL on pg 9.0 : > > the doc at > http://www.postgresql.org/docs/9.1/static/warm-standby.html#SYNCHRONOUS-REPLICATION > (section 25.2.5.2. Monitoring) says: > >  You can calculate this lag by comparing the current WAL

Re: [ADMIN] RESTORE IS TO SLOW

2011-09-15 Thread Lonni J Friedman
On Thu, Sep 15, 2011 at 3:32 PM, marvin.deoliveira wrote: > Hi. > I'm restoring a database (only rows) that has some tables with 9 millions > rows and others have even more. > It's going to slow ( more than 24 hours by now ). > I'm disabling the triggers but I guess if I drop the indexes it will h

Re: [ADMIN] RESTORE IS TO SLOW

2011-09-15 Thread Lonni J Friedman
On Thu, Sep 15, 2011 at 4:12 PM, marvin.deoliveira wrote: > I'm using postgres 9.0.2 32 bits on Debian 5. > The hardware is a pc with 2 GB RAM, with 2 sata disks. Well, that's what I > have at the moment. > > The restore was started like:  pg_restore -U postgres --data-only > --disable-triggers -v

Re: [ADMIN] RESTORE IS TO SLOW

2011-09-16 Thread Lonni J Friedman
On Fri, Sep 16, 2011 at 3:27 AM, marvin.deoliveira wrote: > I'll certainly follow your advices. > The log_truncate_on_rotation parameter is set to on. > I figured that saves a lot of disk space in this context. this is hurting > the performance? That option shouldn't have any impact on performanc

Re: [ADMIN] returning id

2011-09-20 Thread Lonni J Friedman
On Tue, Sep 20, 2011 at 12:31 PM, Marc Fromm wrote: > Can I use “RETURNING id” in an insert statement with postgresql version > 8.1.10? > > I cannot find a clear example on how to use it to capture the id created by > the insert statement into a variable in PHP. > > > > Many examples are like this

[ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-07 Thread Lonni J Friedman
Greetings, I have a 4 server postgresql-9.1.3 cluster (one master doing streaming replication to 3 hot standby servers).  All of them are running Fedora-16-x86_64. http://wiki.postgresql.org/wiki/Lock_Monitoring I'm finding that I cannot runpg_basebackup at all, or it slows down all SQL queries f

Re: [ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-07 Thread Lonni J Friedman
On Thu, Jun 7, 2012 at 10:41 AM, Lonni J Friedman wrote: > Greetings, > I have a 4 server postgresql-9.1.3 cluster (one master doing streaming > replication to 3 hot standby servers).  All of them are running > Fedora-16-x86_64. > > http://wiki.postgresql.org/wiki/Lock_Monitorin

Re: [ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-07 Thread Lonni J Friedman
On Thu, Jun 7, 2012 at 12:40 PM, Magnus Hagander wrote: > On Thu, Jun 7, 2012 at 8:04 PM, Lonni J Friedman wrote: >> On Thu, Jun 7, 2012 at 10:41 AM, Lonni J Friedman wrote: >>> Greetings, >>> I have a 4 server postgresql-9.1.3 cluster (one master doing streami

Re: [ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-07 Thread Lonni J Friedman
On Thu, Jun 7, 2012 at 5:07 PM, Jerry Sievers wrote: > Lonni J Friedman writes: > >> On Thu, Jun 7, 2012 at 12:40 PM, Magnus Hagander wrote: >> >>> On Thu, Jun 7, 2012 at 8:04 PM, Lonni J Friedman wrote: >>>> On Thu, Jun 7, 2012 at 10:41 AM, Lonni J

Re: [ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-08 Thread Lonni J Friedman
On Thu, Jun 7, 2012 at 11:04 PM, Craig Ringer wrote: > On 06/08/2012 09:01 AM, Lonni J Friedman wrote: >> >> On Thu, Jun 7, 2012 at 5:07 PM, Jerry Sievers >>  wrote: >>> >>> You might try stopping pg_basebackup in place with SIGSTOP and check >>> &

Re: [ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-11 Thread Lonni J Friedman
On Fri, Jun 8, 2012 at 7:29 PM, Fujii Masao wrote: > On Sat, Jun 9, 2012 at 4:30 AM, Lonni J Friedman wrote: >> On Thu, Jun 7, 2012 at 11:04 PM, Craig Ringer wrote: >>> On 06/08/2012 09:01 AM, Lonni J Friedman wrote: >>>> >>>> On Thu, Jun 7,

Re: [ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-12 Thread Lonni J Friedman
On Tue, Jun 12, 2012 at 10:49 AM, Fujii Masao wrote: > On Tue, Jun 12, 2012 at 2:37 AM, Lonni J Friedman wrote: >> On Fri, Jun 8, 2012 at 7:29 PM, Fujii Masao wrote: >>> On Sat, Jun 9, 2012 at 4:30 AM, Lonni J Friedman wrote: >>>> On Thu, Jun 7, 2012 at 11:04

Re: [ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-20 Thread Lonni J Friedman
On Wed, Jun 20, 2012 at 5:02 AM, Simon Riggs wrote: > On 13 June 2012 02:39, Magnus Hagander wrote: > >>> I'm running the following, which gets piped over ssh to a remote >>> server (at gigabit ethernet speed): >>> pg_basebackup -v -D - -x -Ft -U postgres >>> >>> One thing that I've discovered is

Re: [ADMIN] pg_basebackup blocking all queries with horrible performance

2012-06-20 Thread Lonni J Friedman
On Wed, Jun 20, 2012 at 6:56 AM, Welty, Richard wrote: > Lonni J Friedman writes: > >>I'm not using SSL. > > ummm, ssh uses ssl. > Sure, although I thought that Simon was referring to the database itself. However, I don't think ssh is the problem, as I can scp

Re: [ADMIN] Streaming Replication (Master Delta Sync)

2012-10-17 Thread Lonni J Friedman
On Wed, Oct 17, 2012 at 1:34 PM, Parkirat Bagga wrote: > Hi > > We are using streaming replication for c++ Postgres-9.1 server. > > We have setup 1 master and 1 slave and streaming replication is working > fine. > > On checking the x-log status for both master and slave, we observed that the > mas

Re: [ADMIN] Streaming Replication (Master Delta Sync)

2012-10-17 Thread Lonni J Friedman
On Wed, Oct 17, 2012 at 2:01 PM, Parkirat Bagga wrote: > Thanks Netllama for the reply. > > Does rsysc sync's the partial logs as well. As I would be doing the rsync > from old master to new master (when the old master recovers), there might be > some partial logs present in the old master? I don

[ADMIN] pg_upgrade from 9.1 to 9.2 takes a really long time (compared to previous versions)?

2012-10-19 Thread Lonni J Friedman
Greetings, I'm in the process of planning for a production upgrade from 9.1.6 to 9.2.x (all Linux-x86-64). In my staging environment (which has the same versions), I kicked off pg_upgrade about 5 hours ago, and its still not done. It is making progress, so I don't think anything has gone wrong, b

Re: [ADMIN] pg_upgrade from 9.1 to 9.2 takes a really long time (compared to previous versions)?

2012-11-07 Thread Lonni J Friedman
On Wed, Nov 7, 2012 at 10:42 AM, Bruce Momjian wrote: > On Fri, Oct 19, 2012 at 02:44:05PM -0700, Lonni J Friedman wrote: >> Greetings, >> I'm in the process of planning for a production upgrade from 9.1.6 to >> 9.2.x (all Linux-x86-64). In my staging environment (whic

Re: [ADMIN] pg_upgrade from 9.1 to 9.2 takes a really long time (compared to previous versions)?

2012-11-07 Thread Lonni J Friedman
On Wed, Nov 7, 2012 at 12:59 PM, Bruce Momjian wrote: > On Wed, Nov 7, 2012 at 10:44:12AM -0800, Lonni J Friedman wrote: >> On Wed, Nov 7, 2012 at 10:42 AM, Bruce Momjian wrote: >> > On Fri, Oct 19, 2012 at 02:44:05PM -0700, Lonni J Friedman wrote: >> >> Greeting

Re: [ADMIN] pg_upgrade from 9.1 to 9.2 takes a really long time (compared to previous versions)?

2012-11-07 Thread Lonni J Friedman
On Wed, Nov 7, 2012 at 1:07 PM, Bruce Momjian wrote: > On Wed, Nov 7, 2012 at 01:06:19PM -0800, Lonni J Friedman wrote: >> On Wed, Nov 7, 2012 at 12:59 PM, Bruce Momjian wrote: >> > On Wed, Nov 7, 2012 at 10:44:12AM -0800, Lonni J Friedman wrote: >> >> On Wed,

Re: [ADMIN] pg_upgrade from 9.1 to 9.2 takes a really long time (compared to previous versions)?

2012-11-07 Thread Lonni J Friedman
On Wed, Nov 7, 2012 at 1:15 PM, Bruce Momjian wrote: > On Wed, Nov 7, 2012 at 01:09:19PM -0800, Lonni J Friedman wrote: >> On Wed, Nov 7, 2012 at 1:07 PM, Bruce Momjian wrote: >> > On Wed, Nov 7, 2012 at 01:06:19PM -0800, Lonni J Friedman wrote: >> >> On Wed,

Re: [ADMIN] Backup

2012-11-29 Thread Lonni J Friedman
Yes. Works fine in 9.2.x. On Thu, Nov 29, 2012 at 4:59 PM, Sabry Sadiq wrote: > Hi All, > > > > Has anyone been successful in offloading the database backup from the > production database to the standby database? > > > > Kind Regards, > > Sabry > > > -- Sent via pgsql-admin mailing list (pgsq

Re: [ADMIN] Backup

2012-11-29 Thread Lonni J Friedman
gt; Kind Regards, > Sabry > > > > > Sabry Sadiq > Systems Administrator > -----Original Message- > From: Lonni J Friedman [mailto:netll...@gmail.com] > Sent: Friday, 30 November 2012 12:11 PM > To: Sabry Sadiq > Cc: pgsql-admin@postgresql.org > Subject: Re:

Re: [ADMIN] Backup

2012-11-29 Thread Lonni J Friedman
that the communication is free of errors, virus, interception > or interference. > > > -Original Message- > From: Lonni J Friedman [mailto:netll...@gmail.com] > Sent: Friday, 30 November 2012 12:13 PM > To: Sabry Sadiq > Cc: pgsql-admin@postgresql.org > Subject: R

Re: [ADMIN] Backup

2012-11-29 Thread Lonni J Friedman
360 Collins Street > Melbourne / Victoria 3000 / Australia > GPO Box 130 / Victoria 3001 / Australia > T +61 3 8630 9900 / M +61 428 571 636 > F +61 3 8630 9990 / E mailto:ssa...@whispir.com > 1300 WHISPIR / 1300 944 774 > www.whispir.com > > > -Original Message- &g

Re: [ADMIN] Backup

2012-11-30 Thread Lonni J Friedman
s them to be > the views of Whispir. Except as required at law, Whispir does not represent, > warrant and/or guarantee that the integrity of this communication has been > maintained nor that the communication is free of errors, virus, interception > or interference. > > > -Origi

Re: [ADMIN] pg_basebackup WAL -- invalid pages

2012-12-03 Thread Lonni J Friedman
On Mon, Dec 3, 2012 at 12:44 PM, Darron wrote: > Running PostgreSQL 9.2.1 on x86_64-unknown-linux-gnu, compiled by gcc > (Debian 4.4.5-8) 4.4.5, 64-bit > > > > Having some issues with streaming replication. After creating a basebackup > with pg_basebackup, I get the following in the logs when star

[ADMIN] corrupted indexes when using base backups generated from hot standby

2013-01-09 Thread Lonni J Friedman
Greetings, I'm running postgres-9.2.2 in a Linux-x86_64 cluster with 1 master and several hot standby servers. Since upgrading to 9.2.2 from 9.1.x a few months ago, I switched from generating a base backup on the master, to generating it on a dedicated slave/standby (to reduce the load on the mast

Re: [ADMIN] Postgres WAL Recovery Fails... And Then Works...

2013-01-14 Thread Lonni J Friedman
Your errors look somewhat similar to a problem I reported last week (no replies thus far): http://www.postgresql.org/message-id/CAP=oouE5niXgAO_34Q+FGq=ts6esmhxxrrobyov3zn9pu42...@mail.gmail.com Except in my case no number of restarts helped. You didn't say, were you explicitly copying $PGDATA or

Re: [ADMIN] corrupted indexes when using base backups generated from hot standby

2013-01-25 Thread Lonni J Friedman
On Tue, Jan 15, 2013 at 2:57 AM, Heikki Linnakangas wrote: > On 09.01.2013 20:28, Lonni J Friedman wrote: >> >> Greetings, >> I'm running postgres-9.2.2 in a Linux-x86_64 cluster with 1 master and >> several hot standby servers. Since upgrading to 9.2.2 from 9.1.x

Re: [ADMIN] corrupted indexes when using base backups generated from hot standby

2013-01-29 Thread Lonni J Friedman
On Tue, Jan 29, 2013 at 8:32 AM, Heikki Linnakangas wrote: > On 26.01.2013 01:28, Lonni J Friedman wrote: >> >> On Tue, Jan 15, 2013 at 2:57 AM, Heikki Linnakangas >> wrote: >>> >>> That process sounds correct. Since you're using pg_basebackup -x opt

Re: [ADMIN] corrupted indexes when using base backups generated from hot standby

2013-01-29 Thread Lonni J Friedman
On Tue, Jan 29, 2013 at 8:38 AM, Heikki Linnakangas wrote: > On 29.01.2013 18:36, Lonni J Friedman wrote: >> >> On Tue, Jan 29, 2013 at 8:32 AM, Heikki Linnakangas >> wrote: >>> >>> Thanks. I'm afraid I didn't get any wiser from the log output. S

[ADMIN] viewing the slaves which are connected to a master in streaming replication

2013-02-14 Thread Lonni J Friedman
I've got a postgres-9.2.x cluster, doing streaming replication to several hot standby servers. I'd like to be able to query the master to see the hostname or IP address of each connected streaming replication standby server. I know that I can view which servers are connected to the master by look

Re: [ADMIN] viewing the slaves which are connected to a master in streaming replication

2013-02-14 Thread Lonni J Friedman
On Thu, Feb 14, 2013 at 10:05 AM, Raghavendra wrote: > > On Thu, Feb 14, 2013 at 11:30 PM, Lonni J Friedman > wrote: >> >> I've got a postgres-9.2.x cluster, doing streaming replication to >> several hot standby servers. I'd like to be able to query th

Re: [ADMIN] Problems with Streaming Replication and PostgreSQL 9.2.2

2013-04-01 Thread Lonni J Friedman
If you're not running pg_basebackup with the -x option, how are you getting the WAL files onto the slave? On Mon, Apr 1, 2013 at 11:19 AM, JotaComm wrote: > Hello, everybody > > I have one problem and I need some help. > > My environment: one master and one slave (PostgreSQL 9.2.2). > > My cluste

Re: [ADMIN] Problems with Streaming Replication and PostgreSQL 9.2.2

2013-04-01 Thread Lonni J Friedman
vetransactionlogs/%f > > In my recovery.conf (slave) I have the following statement: > > restore_command = 'test -f $slavetransactionlogs/%f && cp > $slavetransactionlogs/%f %p' > > Best Regards > > > > 2013/4/1 Lonni J Friedman >> >> If

Re: [ADMIN] postmaster is restarting

2013-04-29 Thread Lonni J Friedman
On Mon, Apr 29, 2013 at 2:35 PM, Rodrigo Barboza wrote: > Hi, guys. > I am using the script that comes with postgres installation to start and > stop my database. > When I stop the database, it restarts after some minutes. > I have looked through every path and I don't find who starts it again. >

[ADMIN] pg_upgrade with -j shows no perf improvement

2013-06-14 Thread Lonni J Friedman
Greetings, I'm in the early stages of preparing to upgrade a production 9.2 cluster to 9.3, by testing the beta of 9.3. All of my testing is happening on RHEL6-x86_64 on a dedicated server with 128GB RAM and 2x Intel Xeon E5-2670 CPUs, with all of $PGDATA residing on an 8 disk RAID10 array. Curre

Re: [ADMIN] pg_upgrade with -j shows no perf improvement

2013-06-17 Thread Lonni J Friedman
On Sat, Jun 15, 2013 at 8:03 PM, Bruce Momjian wrote: > On Fri, Jun 14, 2013 at 02:29:24PM -0700, Lonni J Friedman wrote: >> Greetings, >> I'm in the early stages of preparing to upgrade a production 9.2 >> cluster to 9.3, by testing the beta of 9.3. All of my testin

Re: [ADMIN] pg_upgrade with -j shows no perf improvement

2013-06-17 Thread Lonni J Friedman
On Mon, Jun 17, 2013 at 10:23 AM, Matheus de Oliveira wrote: > > On Mon, Jun 17, 2013 at 12:18 PM, Lonni J Friedman > wrote: >> >> On Sat, Jun 15, 2013 at 8:03 PM, Bruce Momjian wrote: >> > On Fri, Jun 14, 2013 at 02:29:24PM -0700, Lonni J Friedman wrote: >>

Re: [ADMIN] Opinions on SSDs

2013-08-12 Thread Lonni J Friedman
On Mon, Aug 12, 2013 at 1:05 PM, Bruce Momjian wrote: > On Mon, Aug 12, 2013 at 08:33:04AM -0700, Joshua D. Drake wrote: >> >1) Has anyone had experience with Intel 520 SSDs? Are they reliable? >> >When they fail, do they fail nicely (ie, failure detected and bad drive >> >removed from RAID array

Re: [ADMIN] WTF? 9.2.4 Logs have the wrong day of the week?

2013-08-13 Thread Lonni J Friedman
GMT offset? On Tue, Aug 13, 2013 at 5:27 PM, Scott Whitney wrote: > Everything you need to see is right here: > > [root@ pg_log]# ls -lrt > total 5924 > -rw--- 1 postgres postgres 708669 Aug 8 18:59 postgresql-Thu.log > -rw--- 1 postgres postgres 669505 Aug 9 18:59 postgresql-Fri.log

Re: [ADMIN] pd_dump server mismatch error

2013-09-25 Thread Lonni J Friedman
Looks like the real problem here is that you got a version of postgresql installed with the OS, and then you also installed the 9.2 RPMs. Uninstall the postgres that came with the OS and/or specify the full path to the 9.2 pg_dump. On Wed, Sep 25, 2013 at 12:47 PM, Alejandro Brust wrote: > Hello