[HACKERS] Proposal: ALTER EXTENSION SET OPTION

and foo--[version]--unset-parallel-safety.sql -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] proposal: schema variables

a more clunky syntax as: SET VARIABLE foo='bar'; Perhaps one can have a short form of: SET VAR foo = 'bar'; vs SET foo = 'bar'; -- GUC > > regards, tom lane > > > -- > Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) > To make ch

Re: [HACKERS] Oracle to PostGre

de the query which is actually causing the problem. My guess is that either you didn't declare the type properly or there is some other error in your function, but the information provided is not sufficient to answer it. Best or luck asking on -general. -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] WIP: Restricting pg_rewind to data/wal dirs

ferent use cases well and then build common infrastructure to support the different cases. I am not against building common infrastructure for pg_rewind and pg_basebackup. I am very much against having the core guarantees being the exact same. Best Wishes, Chris Travers On Sat, Oct 28, 2017 at 1:22

Re: [HACKERS] Patch: restrict pg_rewind to whitelisted directories

On Tue, Oct 31, 2017 at 1:38 PM, Robert Haas <robertmh...@gmail.com> wrote: > On Mon, Oct 30, 2017 at 6:44 PM, Chris Travers <chris.trav...@adjust.com> > wrote: > > The attached patch is cleaned up and filed for the commit fest this next > > month: > > It'

[HACKERS] Anyone have experience benchmarking very high effective_io_concurrency on NVME's?

of PostgreSQL to bump this setting up to ever higher values, I am wondering if anyone has done this yet and if so if you would be willing to share results. -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405

[HACKERS] Patch: restrict pg_rewind to whitelisted directories

: mine/pg_rewind_restrict_dirs parent: 60446:e638ba9c3c11 user:Chris Travers <chris.trav...@gmail.com> date:Mon Oct 30 12:25:18 2017 +0100 files: doc/src/sgml/ref/pg_rewind.sgml src/bin/pg_rewind/copy_fetch.c src/bin/pg_rewind/fetch.c src/bin/pg_rewind/fetch

Re: [HACKERS] WIP: Restricting pg_rewind to data/wal dirs

On Mon, Oct 30, 2017 at 11:36 AM, Michael Paquier <michael.paqu...@gmail.com > wrote: > On Mon, Oct 30, 2017 at 10:15 AM, Chris Travers > <chris.trav...@adjust.com> wrote: > > This also brings up a fairly major concern more generally about control > by > > the way

Re: [HACKERS] WIP: Restricting pg_rewind to data/wal dirs

On Mon, Oct 30, 2017 at 10:57 AM, Michael Paquier <michael.paqu...@gmail.com > wrote: > On Mon, Oct 30, 2017 at 9:43 AM, Chris Travers <chris.trav...@adjust.com> > wrote: > > Are there any cases right now where you have features added by > extensions that write to dir

Re: [HACKERS] WIP: Restricting pg_rewind to data/wal dirs

First, thanks for your thoughts on this, and I am interested in probing them more. On Mon, Oct 30, 2017 at 9:04 AM, Michael Paquier <michael.paqu...@gmail.com> wrote: > On Sat, Oct 28, 2017 at 4:22 AM, Chris Travers <chris.trav...@adjust.com> > wrote: > > The So

Re: [HACKERS] proposal: schema variables

the output. > > Regards > > Pavel > > > > >> >> >>> regards >>> >>> Pavel >>> >>> >>> >> >> >> -- >> Best Regards, >> Chris Travers >> Database Administrator >> >

Re: [HACKERS] proposal: schema variables

pecify allowed types in custom settings. 3. In a subsequent stage you might be able to SELECT INTO setting_name FROM ; allowing access to setting writes based on queries. > regards > > Pavel > > > -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

[HACKERS] WIP: Restricting pg_rewind to data/wal dirs

escriptive name but currently did not remove the old function yet. Feedback is very welcome. pg_rewind is a very nice piece of software. I am hoping that these sorts of changes will help ensure that it is easier to use and provides more predictable results. -- Best Regards, Chris Traver

Re: [HACKERS] Add Roman numeral conversion to to_number

kype: davidfetter XMPP: david(dot)fetter(at)gmail(dot)com > > Remember to vote! > Consider donating to Postgres: http://www.postgresql.org/about/donate > > > -- > Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-hackers > -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] pg_rewind proposed scope and interface changes

On Wed, Sep 13, 2017 at 6:28 AM, Michael Paquier <michael.paqu...@gmail.com> wrote: > On Tue, Sep 12, 2017 at 11:52 PM, Chris Travers > <chris.trav...@adjust.com> wrote: > > Additionally the wal, xact, timestamp and logical directories must be > > processed in some

[HACKERS] pg_rewind proposed scope and interface changes

. Problems that we will not try to solve: * Rewinding past table creation orphans table file. This is a complex topic on its own and probably needs a separate utility. Thoughts? -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com

Re: [HACKERS] Proposal: pg_rewind to skip config files

hat the missing pieces are, write all those patches > and see them through the usual (cumbersome, slow) procedure. Are you, > Chris, willing to take the lead on that? > Yeah. I think the first step would be list of the corner cases and a proposal for how I think it should work. Then maybe a roa

Re: [HACKERS] Proposal: pg_rewind to skip config files

subsystem would fix this. Is this a reason to rethink the idea that maybe a pg_fsck utility might be useful that could be run immediately after a rewind? -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Proposal: pg_rewind to skip config files

d is sometimes slower than new WALs are > written under heavy load. > How would this work when it comes to rewinding against a file directory? > > -- > May the force be with you… > https://simply.name > > -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Proposal: pg_rewind to skip config files

On Tue, Sep 5, 2017 at 1:04 PM, Michael Paquier <michael.paqu...@gmail.com> wrote: > On Tue, Sep 5, 2017 at 7:54 PM, Vladimir Borodin <r...@simply.name> wrote: > > 5 сент. 2017 г., в 12:31, Chris Travers <chris.trav...@adjust.com> > > написал(а): > > &g

Re: [HACKERS] Proposal: pg_rewind to skip config files

On Tue, Sep 5, 2017 at 12:54 PM, Vladimir Borodin <r...@simply.name> wrote: > > 5 сент. 2017 г., в 12:31, Chris Travers <chris.trav...@adjust.com> > написал(а): > > I think the simplest solution for now is to skip any files ending in > .conf, .log, and serverlog. >

Re: [HACKERS] Proposal: pg_rewind to skip config files

On Mon, Sep 4, 2017 at 3:38 PM, Alvaro Herrera <alvhe...@alvh.no-ip.org> wrote: > Chris Travers wrote: > > On Mon, Sep 4, 2017 at 12:23 PM, Michael Paquier < > michael.paqu...@gmail.com> > > wrote: > > > > > On Mon, Sep 4, 2017 at 7:21 PM, Michael Pa

Re: [HACKERS] Proposal: pg_rewind to skip config files

p to avoid these problems is not always a sane assumption. So consequently, I think it would be good to fix in the tool. The fundamental question is if there is any reason someone would actually want to copy config files over. -- > Michael > -- Best Regards, Chris Travers D

Re: [HACKERS] Proposal: pg_rewind to skip config files

ot think of any cases where anyone would actually want to do this but that doesn't mean they aren't out there. If people really want to, then they need to copy the configuration files they want separately. Next Steps: If people like this idea I will add test cases and edit documentation as appropriate.

[HACKERS] Proposal: pg_rewind to skip config files

the file tree traversal. Any feedback before I create.a proof of concept? -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Proposal: global index

On Fri, Aug 25, 2017 at 12:15 PM, Petr Jelinek <petr.jeli...@2ndquadrant.com > wrote: > On 25/08/17 10:28, Chris Travers wrote: > > > > > > On Thu, Aug 24, 2017 at 9:44 PM, Andres Freund <and...@anarazel.de > > <mailto:and...@anarazel.de>> wrote: >

Re: [HACKERS] Thoughts on unit testing?

ce, and it improves the safety of moving forward. But I still think the question of what to test ought to be geared around "what are we willing to try to guarantee as behaviour for some years, not just to ourselves but to third parties." > > Greetings, > Torsten > > > -- > Se

Re: [HACKERS] Proposal: global index

s mailing list (pgsql-hackers@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-hackers > -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Proposal: global index

On Aug 21, 2017 07:47, "Simon Riggs" wrote: On 18 August 2017 at 15:40, Alvaro Herrera wrote: > Ildar Musin wrote: > >> While we've been developing pg_pathman extension one of the most frequent >> questions we got from our users was about global

Re: [HACKERS] [RFC] What would be difficult to make data models pluggable for making PostgreSQL a multi-model database?

On Sun, Aug 20, 2017 at 4:10 AM, MauMau <maumau...@gmail.com> wrote: > From: Chris Travers > > Why cannot you do all this in a language handler and treat as a user > defined function? > > ... > > If you have a language handler for cypher, why do you need in_region &

Re: [HACKERS] [RFC] What would be difficult to make data models pluggable for making PostgreSQL a multi-model database?

ture is not enough. Maybe I am missing something? > > Regards > MauMau > > > > -- > Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-hackers > -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Proposal: global index

I’ll be glad to hear it. > > [1] https://www.postgresql.org/message-id/c8fe4f6b-ff46-aae0-89e > 3-e936a35f0cfd%40postgrespro.ru > > Thanks! > > -- > Ildar Musin > i.mu...@postgrespro.ru > > > -- > Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) >

Re: [HACKERS] Orphaned files in base/[oid]

ave external programs to do after-the-fact review and cleanup. > > Greetings, > > Andres Freund > -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Orphaned files in base/[oid]

to make sure everything is ok? -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Orphaned files in base/[oid]

On Tue, Aug 15, 2017 at 3:32 PM, Tom Lane <t...@sss.pgh.pa.us> wrote: > Chris Travers <chris.trav...@adjust.com> writes: > > I wonder about a different solution. Would it be possible to special > case > > vacuum to check for and remove (or just move to where they ca

Re: [HACKERS] Orphaned files in base/[oid]

to be able to know that a relfilenode shouldn't be used anymore, right? -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Orphaned files in base/[oid]

more advanced solutions but that I might be able to do. > > regards, tom lane > -- Best Regards, Chris Travers Database Administrator Tel: +49 162 9037 210 | Skype: einhverfr | www.adjust.com Saarbrücker Straße 37a, 10405 Berlin

Re: [HACKERS] Orphaned files in base/[oid]

On Mon, Aug 14, 2017 at 6:33 PM, Andres Freund <and...@anarazel.de> wrote: > Hi, > > On 2017-08-14 14:12:22 +0200, Chris Travers wrote: > > Problem: > > The system this came up on is PostgreSQL 9.6.3 and has had repeated > trouble > > with disk space. Quer

Re: [HACKERS] Orphaned files in base/[oid]

On Aug 14, 2017 14:12, "Chris Travers" <chris.trav...@adjust.com> wrote: Hi all; I am trying to track down a problem we are seeing that looks very similar to bug #12050, and would certainly consider trying to contribute a fix if we agree on one. (I am not sure we can, so absen

[HACKERS] Orphaned files in base/[oid]

in various operations including creating materialised views. So my question is if there is a way we can safely clean these up on server restart? If not does it make sense to try to create a utility that can connect to PostgreSQL, seek out valid files, and delete the rest? -- Best Regards, Chris Travers

Re: [HACKERS] Funny WAL corruption issue

On Fri, Aug 11, 2017 at 1:33 PM, Greg Stark <st...@mit.edu> wrote: > On 10 August 2017 at 15:26, Chris Travers <chris.trav...@gmail.com> wrote: > > > > > > The bitwise comparison is interesting. Remember the error was: > > > > pg_xlogdump:

Re: [HACKERS] Funny WAL corruption issue

On Fri, Aug 11, 2017 at 1:33 PM, Greg Stark <st...@mit.edu> wrote: > On 10 August 2017 at 15:26, Chris Travers <chris.trav...@gmail.com> wrote: > > > > > > The bitwise comparison is interesting. Remember the error was: > > > > pg_xlogdump:

Re: [HACKERS] Funny WAL corruption issue

uce on a db of this size. > > Likelihood of two different persons seeing similar error message just a > year apart is low. From our practice hardware corruption usually looks like > a random single bit flip (most common - bad cpu or memory), bunch of zeroes > (bad storage), or bunch

Re: [HACKERS] Funny WAL corruption issue

pg_xlogdump: FATAL: error in WAL record at 1E39C/E1117FB8: unexpected pageaddr 1E375/61118000 in log segment 0001E39C00E1, offset 1146880 > -- Best Wishes, Chris Travers Efficito: Hosted Accounting and ERP. Robust and Flexible. No vendor lock-in. http://www.efficito.com/learn_more

Re: [HACKERS] Funny WAL corruption issue

Sorry, meant to reply all. On Thu, Aug 10, 2017 at 2:19 PM, Vladimir Borodin <r...@simply.name> wrote: > Hi, Chris. > > 10 авг. 2017 г., в 15:09, Chris Travers <chris.trav...@gmail.com> > написал(а): > > Hi; > > I ran into a funny situation today regard

[HACKERS] Funny WAL corruption issue

hings from happening in the future if, for example, a replica dies in the middle of a wal fsync. -- Best Wishes, Chris Travers Efficito: Hosted Accounting and ERP. Robust and Flexible. No vendor lock-in. http://www.efficito.com/learn_more

Re: [HACKERS] GiST support for UUIDs

king well. -- Chris -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] GiST support for UUIDs

st leave it alone and add > btree_gist--1.2--1.3.sql. That way we don't have to worry about whether > the upgrade script matches the change in the base script. Done. -- Chris btree_gist_uuid_8.patch Description: Binary data -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgre

[HACKERS] extract text from XML

(I did search and no such function seems to exist currently, outside xml2.) Thanks, Chris -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] [GENERAL] OS X 10.11.3, psql, bus error 10, 9.5.1

flag and see if that fixes things. Thanks Tom for spending part of your weekend on this. Chris. > On Mar 12, 2016, at 17:58, Tom Lane <t...@sss.pgh.pa.us> wrote: > > I wrote: >> That's confusing because it implies that -fno-common is the default, >> which it eviden

[HACKERS] Removing max_connection requirement on hot_standby

something with this change? Cheers, Chris

Re: [HACKERS] CTE optimization fence on the todo list?

I need this feature a lot. Can anyone point me to a place in the code where I can hack together a quick-and-dirty, compatibility-breaking implementation? Thanks! On Sun, May 3, 2015 at 10:03 PM, Jim Nasby jim.na...@bluetreble.com wrote: On 5/3/15 11:59 AM, Andrew Dunstan wrote: On

Re: [HACKERS] CTE optimization fence on the todo list?

Has there been any movement on this in the last couple years? I could really use the ability to optimize across CTE boundaries, and it seems like a lot of other people could too.

[HACKERS] Re: [pgsql-pkg-debian] Updated libpq5 packages cause connection errors on postgresql 9.2

Hi Christoph, - Original Message - From: Christoph Berg c...@df7cb.de To: Chris Butler cbut...@zedcore.com Googling for digest too big for rsa key seems to indicate that this problem occurs when you are using (client?) certificates with short RSA keys. 512 bits is most often cited

[HACKERS] why does LIMIT 2 take orders of magnitude longer than LIMIT 1 in this query?

I'm on PostgreSQL 9.3. This should reproduce on any table with 100,000+ rows. The EXPLAIN ANALYZE shows many more rows getting scanned with LIMIT 2, but I can't figure out why. Limit 1: EXPLAIN ANALYZE WITH base AS ( SELECT *, ROW_NUMBER() OVER () AS rownum FROM a_big_table ), filter AS (

Re: [HACKERS] Proposal for better support of time-varying timezone abbreviations

? -- Chris

Re: [HACKERS] 9.3 Json Array's

@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers Best Wishes, Chris Travers http://www.2ndquadrant.com PostgreSQL Services, Training, and Support

Re: [HACKERS] 9.3 Json Array's

be turned into a patch. See my previous post on this topic. Again collaboration is welcome. Best Wishes, Chris Travers http://www.2ndquadrant.com PostgreSQL Services, Training, and Support

Re: [HACKERS] Minmax indexes

target and over years of billing, the subset would be quite small compared to the full system (imagine, say, 50k rows out of 20M). Best Wises, Chris Travers - Heikki -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http

Re: [HACKERS] Proposal: json_populate_record and nested json objects

, This will be an interesting way to get into PostgreSQL hacking. Best Wishes, Chris Travers merlin -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers Best Wishes, Chris Travers http://www

Re: [HACKERS] Proposal: json_populate_record and nested json objects

On 15 September 2013 at 18:42 Andrew Dunstan and...@dunslane.net wrote: On 09/14/2013 10:27 PM, chris travers wrote: Well, you could fairly easily build it as an extension as a POC. The main point of the API this is built on was to allow for extensions. The logic changes might be a bit

[HACKERS] Proposal: json_populate_record and nested json objects

this first as an extension (perhaps with different function names) or first as a patch? Best Wishes, Chris Travers http://www.2ndquadrant.com PostgreSQL Services, Training, and Support

Re: [HACKERS] Proposal: PL/PgSQL strict_mode

changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers Best Wishes, Chris Travers http://www.2ndquadrant.com PostgreSQL Services, Training, and Support

Re: [HACKERS] ASYNC Privileges proposal

to workaround this Possibly some kind of catch-all channel, that enables implicit channel names? GRANT LISTEN, NOTIFY ON CHANNEL * TO PUBLIC; -- enabled by default for backwards compat NOTIFY ; -- OK via * CHANNEL LISTEN ; -- OK via * CHANNEL Chris On 18 June

[HACKERS] ASYNC Privileges proposal

might be involved [attached], and would like to hear people thoughts; good idea, bad idea, not like that! etc Chris. async_privileges_r0.patch Description: Binary data -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http

[HACKERS] ASYNC Privileges proposal

might be involved [attached], and would like to hear people thoughts; good idea, bad idea, not like that! etc Chris. async_privileges_r0.patch Description: Binary data -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http

Re: [HACKERS] ASYNC Privileges proposal

. Chris On 20 May 2013 03:23, Tom Lane t...@sss.pgh.pa.us wrote: Chris Farmiloe chrisfa...@gmail.com writes: I find the current LISTEN / NOTIFY rather limited in the context of databases with multiple roles. As it stands it is not possible to restrict the use of LISTEN or NOTIFY to specific

Re: [HACKERS] Proposal for Allow postgresql.conf values to be changed via SQL

What's the use case of this? It sounds like it will just create a maintenance nightmare where some stuff you expect to lookup in in postgresql.conf is actually hiding in the .auto file. Assuming only super users/sysadmins would have the ability to change things in the config file, wouldn't they

Re: [HACKERS] Should select 'nan'::float = 'nan'::float; return false as per IEEE 754

Would this introduce problems finding rows where the stored value is NaN? You'd need to add a function or operator to avoid that. Il giorno 28/ott/2012, alle ore 20:43, Hannu Krosing ha scritto: This is how PostgreSQL currently works - test=# select 'NaN'::float = 'NaN'::float as

[HACKERS] Is PQexecParams() simply a wrapper function?

to the server, however. That said, I believe PQexecParams() is doing a similar thing, in that it internally prepares a statement, then executes it (2 round trips). Or am I needlessly concerning myself over microseconds here? Cheers, Chris -- Sent via pgsql-hackers mailing list (pgsql-hackers

Re: [HACKERS] SEGFAULT on SELECT * FROM view

, but if you want me to debug more on the error please let me know. Thanks for your help until now! Chris -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

[HACKERS] SEGFAULT on SELECT * FROM view

if that helps. The views actually differ, although the look identical with \d+ in the psql console, in that the newer view names more columns that were added to the referenced tables lately. So, you tell me, what's wrong with the old view? Thanks a lot, Chris -- Sent via pgsql-hackers mailing list

Re: [HACKERS] SEGFAULT on SELECT * FROM view

this, how should I proceed to create a test case? Any tutorial on this? (I'm not too familiar with all this yet.) Chris -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] 9.1.2 ?

On Wed, Nov 9, 2011 at 6:22 PM, Florian Pflug f...@phlo.org wrote: On Nov9, 2011, at 23:53 , Daniel Farina wrote: I think a novice user would be scared half to death: I know I was the first time. That's not a great impression for the project to leave for what is not, at its root, a vast

Re: [HACKERS] Hot Standby startup with overflowed snapshots

oopsreply-to-all -- Forwarded message -- From: Chris Redekop ch...@replicon.com Date: Wed, Nov 2, 2011 at 8:41 AM Subject: Re: [HACKERS] Hot Standby startup with overflowed snapshots To: Simon Riggs si...@2ndquadrant.com Sure, I've got quite a few logs lying around - I've

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

okay, sorry I'm a little confused then. Should I be able to apply both the v2 patch as well as the v3 patch? or is it expected that I'd have to manually do the merge? On Wed, Nov 2, 2011 at 1:34 AM, Simon Riggs si...@2ndquadrant.com wrote: On Wed, Nov 2, 2011 at 2:40 AM, Chris Redekop ch

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

looks like the v3 patch re-introduces the pg_subtrans issue... On Tue, Nov 1, 2011 at 9:33 AM, Simon Riggs si...@2ndquadrant.com wrote: On Thu, Oct 27, 2011 at 4:25 PM, Simon Riggs si...@2ndquadrant.com wrote: StartupMultiXact() didn't need changing, I thought, but I will review further.

Re: [HACKERS] Hot Standby startup with overflowed snapshots

:26 AM, Simon Riggs si...@2ndquadrant.com wrote: Chris Redekop's recent report of slow startup for Hot Standby has made me revisit the code there. Although there isn't a bug, there is a missed opportunity for starting up faster which could be the source of Chris' annoyance. The following

Re: [HACKERS] Hot Standby startup with overflowed snapshots

?or is it actually as designed that it could take 10-ish minutes to start up even after all clients have disconnected from the primary? On Thu, Oct 27, 2011 at 11:27 AM, Simon Riggs si...@2ndquadrant.com wrote: On Thu, Oct 27, 2011 at 5:26 PM, Chris Redekop ch...@replicon.com wrote: Thanks for the patch

Re: [HACKERS] Hot Standby startup with overflowed snapshots

it then neither am I :) On Thu, Oct 27, 2011 at 4:55 PM, Simon Riggs si...@2ndquadrant.com wrote: On Thu, Oct 27, 2011 at 10:09 PM, Chris Redekop ch...@replicon.com wrote: hrmz, still basically the same behaviour. I think it might be a *little* better with this patch. Before when under

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

And I think they also reported that if they didn't run hot standby, but just normal recovery into a new master, it didn't have the problem either, i.e. without hotstandby, recovery ran, properly extended the clog, and then ran as a new master fine. Yes this is correct...attempting to start as

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

FYI I have given this patch a good test and can now no longer reproduce either the subtrans nor the clog error. Thanks guys! On Wed, Oct 26, 2011 at 11:09 AM, Simon Riggs si...@2ndquadrant.com wrote: On Wed, Oct 26, 2011 at 5:16 PM, Simon Riggs si...@2ndquadrant.com wrote: On Wed, Oct 26,

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

Chris, can you rearrange the backup so you copy the pg_control file as the first act after the pg_start_backup? I tried this and it doesn't seem to make any difference. I also tried the patch and I can no longer reproduce the subtrans error, however instead it now it starts up, but never gets

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

That isn't a Hot Standby problem, a recovery problem nor is it certain its a PostgreSQL problem. Do you have any theories on this that I could help investigate? It happens even when using pg_basebackup and it persists until another sync is performed, so the files must be in some state that

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

at 7:33 PM, Chris Redekop ch...@replicon.com wrote: Linas, could you capture the output of pg_controldata *and* increase the log level to DEBUG1 on the standby? We should then see nextXid value of the checkpoint the recovery is starting from. I'll try to do that whenever I'm

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

shooting in the dark here Anyone have any suggestions/ideas/things to try? On Mon, Oct 17, 2011 at 2:13 PM, Chris Redekop ch...@replicon.com wrote: I can confirm that both the pg_clog and pg_subtrans errors do occur when using pg_basebackup instead of rsync. The data itself seems to be fine

Re: [HACKERS] Hot Backup with rsync fails at pg_clog if under load

Linas, could you capture the output of pg_controldata *and* increase the log level to DEBUG1 on the standby? We should then see nextXid value of the checkpoint the recovery is starting from. I'll try to do that whenever I'm in that territory again... Incidentally, recently there was a lot

Re: [HACKERS] pg_last_xact_insert_timestamp

Thanks for all the feedback guys. Just to throw another monkey wrench in here - I've been playing with Simon's proposed solution of returning 0 when the WAL positions match, and I've come to the realizatiion that even if using pg_last_xact_insert_timestamp, although it would help, we still

Re: [HACKERS] [GENERAL] Creating temp tables inside read only transactions

. Right now I am using a double underscore which is error-prone. Best Wishes, Chris Travers -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Testing extension upgrade scripts

da...@kineticode.com (David E. Wheeler) writes: You should blog this. He just did, using the SMTP protocol... -- select 'cbbrowne' || '@' || 'acm.org'; http://linuxdatabases.info/info/postgresql.html Where do you want to Tell Microsoft To Go Today? -- Sent via pgsql-hackers mailing list

Re: [HACKERS] Re: Why our counters need to be time-based WAS: WIP: cross column correlation ...

j...@agliodbs.com (Josh Berkus) writes: I don't understand what you're talking about at all here. I think there are a lot of unsolved problems in monitoring but the one thing I think everyone is pretty clear on is that the right way to export metrics like these is to export a counter and then

Re: [HACKERS] CommitFest 2011-01 as of 2011-02-04

robertmh...@gmail.com (Robert Haas) writes: It does, but frankly I don't see much reason to change it, since it's been working pretty well on the whole. Andrew was on point when he mentioned that it's not obvious what committers get out of working on other people's patches. Obviously, the

Re: [HACKERS] why two dashes in extension load files

t...@sss.pgh.pa.us (Tom Lane) writes: Peter Eisentraut pete...@gmx.net writes: On mån, 2011-02-14 at 10:13 -0500, Tom Lane wrote: Peter Eisentraut pete...@gmx.net writes: Why do the extension load files need two dashes, like xml2--1.0.sql? Why isn't one enough? Because we'd have to forbid

Re: [HACKERS] postponing some large patches to 9.2

pg...@j-davis.com (Jeff Davis) writes: On Tue, 2011-02-08 at 15:10 -0500, Chris Browne wrote: It's more than a bit sad... The RangeType change has the massive merit of enabling some substantial development changes, where we can get rid of whole classes of comparison clauses, and hopefully

[HACKERS] Range Types - efficiency

One of the things I'd particularly like to use range types for is to make it easier to construct range-related queries. Classic example is that of reports that work on date ranges. I create a table that will have transaction data: CREATE TABLE some_data ( id serial, whensit date --

Re: [HACKERS] Range Types - efficiency

pg...@j-davis.com (Jeff Davis) writes: On Wed, 2011-02-09 at 16:20 -0500, Chris Browne wrote: rangetest@localhost- explain analyze select * from some_data where '[2010-01-01,2010-02-01)'::daterange @ whensit; QUERY PLAN

Re: [HACKERS] postponing some large patches to 9.2

sfr...@snowman.net (Stephen Frost) writes: * Robert Haas (robertmh...@gmail.com) wrote: - Range Types. This is a large patch which was submitted for the first time to the last CommitFest of the cycle, and the first version that had no open TODO items was posted yesterday, three-quarters of

Re: [HACKERS] postponing some large patches to 9.2

pg...@j-davis.com (Jeff Davis) writes: On Tue, 2011-02-08 at 06:57 -0500, Stephen Frost wrote: * Robert Haas (robertmh...@gmail.com) wrote: - Range Types. This is a large patch which was submitted for the first time to the last CommitFest of the cycle, and the first version that had no

Re: [HACKERS] OpenVMS - an effort which needs guidance and support.

peder...@ccsscorp.com (Bill Pedersen) writes: I look forward to hearing from people in the PostgreSQL community as well as from others interested in this effort. To a number of us, it's academically interesting, though, as we don't have VMS systems, it's not likely to be super-easy to assist in

Re: [HACKERS] Sync Rep for 2011CF1

dp...@pgadmin.org (Dave Page) writes: On Mon, Feb 7, 2011 at 6:55 PM, Robert Haas robertmh...@gmail.com wrote: On Mon, Feb 7, 2011 at 12:43 PM, Tom Lane t...@sss.pgh.pa.us wrote: Robert Haas robertmh...@gmail.com writes: ... Well, the current CommitFest ends in one week, ... Really?  I

  1   2   3   4   5   >