Re: [GENERAL] Database corruption event, unlockable rows, possibly bogus virtual xids? Invalid backend server xid

2013-02-21 Thread Ned Wolpert
Tom and Kevin- There were two entries in pg_prepared_xacts. In the test-bed, executing the 'ROLLBACK PREPARED' on both allowed the system to continue processing. All locks I saw in 'pg_locks' where the virtualtransaction started with the '-1/' were also gone. That was indeed the issue. More impo

Re: [GENERAL] Database corruption event, unlockable rows, possibly bogus virtual xids? Invalid backend server xid

2013-02-21 Thread Tom Lane
Ned Wolpert writes: > Event: Running 9.1.6 with hot-standby, archiving 4 months of wal files, > and even a nightly pg_dump all. 50G database. Trying to update or delete a > row in a small (21 row, but heavily used table) would lock up completely. > Never finish. Removed all clients, restarted t

Re: [GENERAL] Database corruption event, unlockable rows, possibly bogus virtual xids? Invalid backend server xid

2013-02-21 Thread Kevin Grittner
Ned Wolpert wrote: > I'm doing a postmortem on a corruption event we had. I have an > idea on what happened, but not sure. I figure I'd share what > happened and see if I'm close to right here. > > Running 9.1.6 with hot-standby, archiving 4 months of wal files, > and even a nightly pg_dump all.

[GENERAL] Database corruption event, unlockable rows, possibly bogus virtual xids? Invalid backend server xid

2013-02-21 Thread Ned Wolpert
(I originally posted this to pgsql-admin and was pointed to here instead.) Folks- I'm doing a postmortem on a corruption event we had. I have an idea on what happened, but not sure. I figure I'd share what happened and see if I'm close to right here. Event: Running 9.1.6 with hot-standby, ar