Re: Added missing tab completion for alter subscription set option

2021-05-23 Thread vignesh C
On Thu, May 20, 2021 at 9:40 PM Tom Lane wrote: > > vignesh C writes: > > On Tue, May 18, 2021 at 9:20 PM Alvaro Herrera > > wrote: > >> I wish we didn't have to keep knowledge in the psql source on which > >> option names are to be used for each command.

Re: Added missing tab completion for alter subscription set option

2021-05-20 Thread vignesh C
On Tue, May 18, 2021 at 9:20 PM Alvaro Herrera wrote: > > On 2021-May-14, vignesh C wrote: > > > While I was reviewing one of the logical decoding features, I found > > Streaming and binary options were missing in tab completion for the > > alter subscription set opt

Re: Added missing tab completion for alter subscription set option

2021-05-19 Thread vignesh C
On Tue, May 18, 2021 at 9:20 PM Alvaro Herrera wrote: > > On 2021-May-14, vignesh C wrote: > > > While I was reviewing one of the logical decoding features, I found > > Streaming and binary options were missing in tab completion for the > > alter subscription set opt

Re: subscriptioncheck failure

2021-05-19 Thread vignesh C
On Wed, May 19, 2021 at 10:28 AM Amit Kapila wrote: > > On Tue, May 18, 2021 at 11:25 AM vignesh C wrote: > > > > Thanks for the comments, the attached patch has the changes for the same. > > > > Thanks, I have pushed your patch after making minor changes in the

Re: subscriptioncheck failure

2021-05-17 Thread vignesh C
On Tue, May 18, 2021 at 9:09 AM Amit Kapila wrote: > > On Mon, May 17, 2021 at 5:48 PM vignesh C wrote: > > > > On Mon, May 17, 2021 at 10:40 AM Amit Kapila > > wrote: > > > > > > One more point: > > > + $node_publisher->wait_for_catchu

Re: [HACKERS] logical decoding of two-phase transactions

2021-05-17 Thread vignesh C
On Mon, May 17, 2021 at 6:10 PM Ajin Cherian wrote: > > The above patch had some changes missing which resulted in some tap > tests failing. Sending an updated patchset. Keeping the patchset > version the same. Thanks for the updated patch, the updated patch fixes the tap test failures.

Re: Corrected documentation of data type for the logical replication message formats.

2021-05-17 Thread vignesh C
On Thu, May 13, 2021 at 5:57 AM Peter Smith wrote: > > On Wed, May 12, 2021 at 11:09 PM vignesh C wrote: > ... > > > > Thanks for the comments. Attached v4 patch has the fix for the same. > > > > I have not tried this patch so I cannot confirm whether it applie

Re: subscriptioncheck failure

2021-05-17 Thread vignesh C
On Mon, May 17, 2021 at 10:40 AM Amit Kapila wrote: > > On Mon, May 17, 2021 at 9:06 AM Amit Kapila wrote: > > > > On Thu, May 13, 2021 at 7:06 PM vignesh C wrote: > > > > > > On Thu, May 13, 2021 at 4:41 PM Michael Paquier > > > wrote

Re: alter subscription drop publication fixes

2021-05-15 Thread vignesh C
On Sat, May 15, 2021 at 2:58 PM Bharath Rupireddy < bharath.rupireddyforpostg...@gmail.com> wrote: > > On Fri, May 14, 2021 at 11:02 PM vignesh C wrote: > > > > On Fri, May 14, 2021 at 8:56 PM Tom Lane wrote: > > > > > > Bharath Rupireddy writes: >

Re: Added missing tab completion for alter subscription set option

2021-05-14 Thread vignesh C
On Fri, May 14, 2021 at 7:10 PM Bharath Rupireddy < bharath.rupireddyforpostg...@gmail.com> wrote: > > On Fri, May 14, 2021 at 6:51 PM vignesh C wrote: > > > > On Fri, May 14, 2021 at 12:25 PM Bharath Rupireddy > > wrote: > > > > > > O

Re: alter subscription drop publication fixes

2021-05-14 Thread vignesh C
On Fri, May 14, 2021 at 8:56 PM Tom Lane wrote: > > Bharath Rupireddy writes: > > On Fri, May 14, 2021 at 7:58 PM vignesh C wrote: > >> I have changed it to: > >> ADD adds additional publications, > >> - DROP removes publications from the list o

Re: alter subscription drop publication fixes

2021-05-14 Thread vignesh C
On Fri, May 14, 2021 at 7:41 AM Japin Li wrote: > > > On Thu, 13 May 2021 at 22:13, vignesh C wrote: > > On Wed, May 12, 2021 at 10:15 PM Bharath Rupireddy > > wrote: > >> > >> On Wed, May 12, 2021 at 9:55 PM vignesh C wrote: > >> > While I wa

Re: alter subscription drop publication fixes

2021-05-14 Thread vignesh C
On Thu, May 13, 2021 at 8:13 PM Bharath Rupireddy wrote: > > On Thu, May 13, 2021 at 7:43 PM vignesh C wrote: > > I have separated the Drop publication documentation contents. There > > are some duplicate contents but the readability is slightly better. > > Thoughts? >

Re: Added missing tab completion for alter subscription set option

2021-05-14 Thread vignesh C
On Fri, May 14, 2021 at 12:25 PM Bharath Rupireddy wrote: > > On Fri, May 14, 2021 at 12:00 PM vignesh C wrote: > > > > Hi, > > > > While I was reviewing one of the logical decoding features, I found > > Streaming and binary options were missing in tab compl

Added missing tab completion for alter subscription set option

2021-05-14 Thread vignesh C
Hi, While I was reviewing one of the logical decoding features, I found Streaming and binary options were missing in tab completion for the alter subscription set option, the attached patch has the changes for the same. Thoughts? Regards, Vignesh From 84a0c07760c913576ef38d74ab37ffd9ee3ad686 Mon

Re: Enhanced error message to include hint messages for redundant options error

2021-05-13 Thread vignesh C
On Thu, May 13, 2021 at 4:58 AM Alvaro Herrera wrote: > > You can avoid duplicating the ereport like this: > > + ereport(ERROR, > + (errcode(ERRCODE_SYNTAX_ERROR), > +errmsg("option \"%s\" specified more than > once",

Re: alter subscription drop publication fixes

2021-05-13 Thread vignesh C
On Wed, May 12, 2021 at 10:15 PM Bharath Rupireddy wrote: > > On Wed, May 12, 2021 at 9:55 PM vignesh C wrote: > > While I was reviewing one of the logical decoding features, I found a > > few issues in alter subscription drop publication. > > Thanks! > > > Al

Re: subscriptioncheck failure

2021-05-13 Thread vignesh C
On Thu, May 13, 2021 at 4:41 PM Michael Paquier wrote: > > On Thu, May 13, 2021 at 04:14:55PM +0530, vignesh C wrote: > > +$node_publisher->wait_for_catchup('tap_sub'); > > + > > # Ensure a transactional logical decoding message shows up on the slot > > $nod

Re: subscriptioncheck failure

2021-05-13 Thread vignesh C
On Thu, May 13, 2021 at 4:41 PM Michael Paquier wrote: > > On Thu, May 13, 2021 at 04:14:55PM +0530, vignesh C wrote: > > +$node_publisher->wait_for_catchup('tap_sub'); > > + > > # Ensure a transactional logical decoding message shows up on the slot > > $nod

Re: subscriptioncheck failure

2021-05-13 Thread vignesh C
On Thu, May 13, 2021 at 3:12 PM Amit Kapila wrote: > > I noticed $SUBJECT in curculio. > https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=curculio=2021-05-11%2018%3A30%3A23 > > The failure test report: > t/020_messages.pl(Wstat: 7424 Tests: 1 Failed: 0) > Non-zero exit

Re: Replication slot stats misgivings

2021-05-13 Thread vignesh C
On Thu, May 13, 2021 at 11:21 AM Amit Kapila wrote: > > On Wed, May 12, 2021 at 4:02 PM Masahiko Sawada wrote: > > > > On Wed, May 12, 2021 at 1:19 PM vignesh C wrote: > > > > > > > I think the part of the test that tests the stats after resetting

alter subscription drop publication fixes

2021-05-12 Thread vignesh C
Hi, While I was reviewing one of the logical decoding features, I found a few issues in alter subscription drop publication. Alter subscription drop publication does not support copy_data option, that needs to be removed from tab completion. Dropping all the publications present in the

Re: Corrected documentation of data type for the logical replication message formats.

2021-05-12 Thread vignesh C
On Wed, May 12, 2021 at 3:36 AM Peter Smith wrote: > > On Wed, May 12, 2021 at 1:02 AM vignesh C wrote: > > > > Thanks for the comments, Attached v3 patch has the changes as suggested. > > This v3 mostly looks good to me now except for some minor comments > about the f

Re: Replication slot stats misgivings

2021-05-11 Thread vignesh C
On Wed, May 12, 2021 at 9:59 AM Tom Lane wrote: > > vignesh C writes: > > I agree with your analysis to remove that test. Attached patch has the > > changes for the same. > > Is there any value in converting the test case into a TAP test that > could be more flexibl

Re: Replication slot stats misgivings

2021-05-11 Thread vignesh C
On Wed, May 12, 2021 at 9:08 AM Amit Kapila wrote: > > On Wed, May 12, 2021 at 7:53 AM Amit Kapila wrote: > > > > On Wed, May 12, 2021 at 4:00 AM Masahiko Sawada > > wrote: > > > > > > Ugh, since by commit 592f00f8de we send slot stats every after > > > spil/stream it’s possible that we report

Re: Corrected documentation of data type for the logical replication message formats.

2021-05-11 Thread vignesh C
On Tue, May 11, 2021 at 9:09 AM Euler Taveira wrote: > > On Mon, May 10, 2021, at 10:45 AM, vignesh C wrote: > > I agree to specifying the actual dataypes like XLogRecPtr for lsn, > TimestampTz for timestamp, TransactionId for xid and Oid for the > object id. Attached v2 patc

Re: Corrected documentation of data type for the logical replication message formats.

2021-05-11 Thread vignesh C
On Tue, May 11, 2021 at 8:06 AM Peter Smith wrote: > > On Mon, May 10, 2021 at 11:46 PM vignesh C wrote: > > > > On Sun, May 9, 2021 at 6:54 PM Euler Taveira wrote: > > > > > > On Sun, May 9, 2021, at 9:37 AM, vignesh C wrote: > > > > > >

Re: Enhanced error message to include hint messages for redundant options error

2021-05-11 Thread vignesh C
On Tue, May 11, 2021 at 2:47 AM Alvaro Herrera wrote: > > On 2021-May-10, vignesh C wrote: > > > That sounds fine to me, Attached v6 patch which has the changes for the > > same. > > What about defining a function (maybe a static inline function in > def

Re: Corrected documentation of data type for the logical replication message formats.

2021-05-10 Thread vignesh C
On Sun, May 9, 2021 at 6:44 PM Peter Smith wrote: > > On Sun, May 9, 2021 at 10:38 PM vignesh C wrote: > > > > Hi, > > > > For some of the logical replication messages the data type documented > > was not correct, especially for lsn and xid. For ls

Re: Corrected documentation of data type for the logical replication message formats.

2021-05-10 Thread vignesh C
On Sun, May 9, 2021 at 6:54 PM Euler Taveira wrote: > > On Sun, May 9, 2021, at 9:37 AM, vignesh C wrote: > > For some of the logical replication messages the data type documented > was not correct, especially for lsn and xid. For lsn actual datatype > used is uint64 but is d

Re: Enhanced error message to include hint messages for redundant options error

2021-05-10 Thread vignesh C
On Mon, May 10, 2021 at 6:00 AM houzj.f...@fujitsu.com wrote: > > > > > > > > > Thanks! The v5 patch looks good to me. Let's see if all > > > > > > > > agree on the goto duplicate_error approach which could reduce > > the LOC by ~80. > > > > > > > > > > > > > > I think the "goto duplicate_error"

Re: [HACKERS] logical decoding of two-phase transactions

2021-05-10 Thread vignesh C
On Mon, May 10, 2021 at 10:51 AM Peter Smith wrote: > > On Mon, May 10, 2021 at 1:31 PM vignesh C wrote: > > > > > 4) Should we change this to "The end LSN of the prepared transaction" > > just to avoid any confusion of it mean

Re: [HACKERS] logical decoding of two-phase transactions

2021-05-09 Thread vignesh C
On Thu, Apr 29, 2021 at 2:23 PM Peter Smith wrote: > > Please find attached the latest patch set v74* > > Differences from v73* are: > > * Rebased to HEAD @ 2 days ago. > > * v74 addresses most of the feedback comments from Vignesh posts [1][2][3]. > Thanks for the updated patch. Few comments:

Corrected documentation of data type for the logical replication message formats.

2021-05-09 Thread vignesh C
Hi, For some of the logical replication messages the data type documented was not correct, especially for lsn and xid. For lsn actual datatype used is uint64 but is documented as int64, similarly for xid, datatype used is uint32 but documented as int32. Attached is a patch which has the fix for

Re: Enhanced error message to include hint messages for redundant options error

2021-05-08 Thread vignesh C
On Sat, May 8, 2021 at 2:20 PM Bharath Rupireddy wrote: > > On Sat, May 8, 2021 at 12:01 PM houzj.f...@fujitsu.com > wrote: > > > > > > > Thanks! The v5 patch looks good to me. Let's see if all agree on the > > > > > goto duplicate_error approach which could reduce the LOC by ~80. > > > > > > >

Re: Identify missing publications from publisher while create/alter subscription.

2021-05-07 Thread vignesh C
On Fri, May 7, 2021 at 5:44 PM Dilip Kumar wrote: > > On Fri, May 7, 2021 at 5:38 PM Bharath Rupireddy > wrote: > > > > On Fri, May 7, 2021 at 11:50 AM Dilip Kumar wrote: > > > > > > On Thu, May 6, 2021 at 7:22 PM vignesh C wrote: > > > > &g

Re: Printing backtrace of postgres processes

2021-05-06 Thread vignesh C
On Thu, May 6, 2021 at 7:43 AM Justin Pryzby wrote: > > Here's a cleaned-up copy of the doc text. > > Send a request to the backend with the specified process ID to log its > backtrace. > The backtrace will be logged at message level LOG. > It will appear in the server log based on the log

Re: Identify missing publications from publisher while create/alter subscription.

2021-05-06 Thread vignesh C
On Thu, May 6, 2021 at 9:08 AM Japin Li wrote: > > > On Tue, 04 May 2021 at 21:20, vignesh C wrote: > > On Tue, May 4, 2021 at 2:37 PM Bharath Rupireddy > > wrote: > >> > >> On Mon, May 3, 2021 at 7:59 PM vignesh C wrote: > >> > Thanks fo

Re: Replication slot stats misgivings

2021-05-06 Thread vignesh C
On Thu, May 6, 2021 at 1:30 PM Masahiko Sawada wrote: > > On Thu, May 6, 2021 at 4:03 PM Amit Kapila wrote: > > > > On Thu, May 6, 2021 at 10:55 AM Masahiko Sawada > > wrote: > > > > > > On Thu, May 6, 2021 at 1:09 PM Amit Kapila > > > wrote: > > > > > > > > > > > In the attached, I have

Re: Replication slot stats misgivings

2021-05-05 Thread vignesh C
On Thu, May 6, 2021 at 9:39 AM Amit Kapila wrote: > > On Thu, May 6, 2021 at 6:15 AM Masahiko Sawada wrote: > > > > After more thought, I'm concerned that my patch's approach might be > > invasive for PG14. Given that Vignesh’s patch would cover most cases, > > > > I am not sure if your patch is

Re: Printing backtrace of postgres processes

2021-05-05 Thread vignesh C
On Wed, Feb 3, 2021 at 3:24 PM Bharath Rupireddy wrote: > > On Wed, Feb 3, 2021 at 1:49 PM vignesh C wrote: > > > > On Wed, Feb 3, 2021 at 1:00 PM Tom Lane wrote: > > > > > > vignesh C writes: > > > > On Mon, Feb 1, 2

Re: Identify missing publications from publisher while create/alter subscription.

2021-05-04 Thread vignesh C
On Tue, May 4, 2021 at 2:37 PM Bharath Rupireddy wrote: > > On Mon, May 3, 2021 at 7:59 PM vignesh C wrote: > > Thanks for the comments, these comments are handle in the v7 patch > > posted in my earlier mail. > > Thanks. Some comments on v7 patch: > > 1) How abo

Re: Replication slot stats misgivings

2021-05-03 Thread vignesh C
On Tue, May 4, 2021 at 9:48 AM Masahiko Sawada wrote: > > On Mon, May 3, 2021 at 10:21 PM Amit Kapila wrote: > > > > On Mon, May 3, 2021 at 5:48 PM Masahiko Sawada > > wrote: > > > > > > On Mon, May 3, 2021 at 2:27 PM Amit Kapila > > > wrote: > > > > > > > > On Thu, Apr 29, 2021 at 10:37 AM

Re: Identify missing publications from publisher while create/alter subscription.

2021-05-03 Thread vignesh C
On Mon, May 3, 2021 at 11:11 AM Bharath Rupireddy wrote: > > On Sun, May 2, 2021 at 10:04 PM vignesh C wrote: > > > 5) Instead of adding a new file 021_validate_publications.pl for > > > tests, spawning a new test database which would make the overall > > >

Re: Identify missing publications from publisher while create/alter subscription.

2021-05-03 Thread vignesh C
On Mon, May 3, 2021 at 1:46 PM Dilip Kumar wrote: > > On Mon, May 3, 2021 at 10:48 AM Dilip Kumar wrote: > > > > On Sun, May 2, 2021 at 10:04 PM vignesh C wrote: > > > > > > Thanks for the comments. > > > The Attached patch has the fixes for the sa

Re: Enhanced error message to include hint messages for redundant options error

2021-05-03 Thread vignesh C
On Mon, May 3, 2021 at 12:08 PM Bharath Rupireddy wrote: > > On Sun, May 2, 2021 at 8:44 PM vignesh C wrote: > > > > On Sat, May 1, 2021 at 9:02 PM Bharath Rupireddy > > wrote: > > > > > > On Sat, May 1, 2021 at 7:25 PM vignesh C wrote: > >

Re: Identify missing publications from publisher while create/alter subscription.

2021-05-02 Thread vignesh C
On Sat, May 1, 2021 at 7:58 PM Bharath Rupireddy wrote: > > On Sat, May 1, 2021 at 12:49 PM vignesh C wrote: > > Thanks for the comments, Attached patch has the fixes for the same. > > Thoughts? > > Few more comments on v5: > > 1) Deletion of be

Re: Enhanced error message to include hint messages for redundant options error

2021-05-02 Thread vignesh C
On Sat, May 1, 2021 at 9:02 PM Bharath Rupireddy wrote: > > On Sat, May 1, 2021 at 7:25 PM vignesh C wrote: > > > > I'm not attaching above one line change as a patch, maybe Vignesh can > > > > merge this into the main patch. > > > > Thanks

Re: Enhanced error message to include hint messages for redundant options error

2021-05-02 Thread vignesh C
On Sat, May 1, 2021 at 10:54 PM Alvaro Herrera wrote: > > On 2021-May-01, vignesh C wrote: > > > On Thu, Apr 29, 2021 at 10:44 PM Alvaro Herrera > > wrote: > > > > > > On 2021-Apr-29, vignesh C wrote: > > > > > > > Thanks f

Re: Enhanced error message to include hint messages for redundant options error

2021-05-02 Thread vignesh C
On Sun, May 2, 2021 at 4:27 AM Alvaro Herrera wrote: > > On 2021-May-01, Bharath Rupireddy wrote: > > > IMO, it's not good to change the function API just for showing up > > parse_position (which is there for cosmetic reasons I feel) in an error > > which actually has the option name clearly

Re: Enhanced error message to include hint messages for redundant options error

2021-05-01 Thread vignesh C
On Thu, Apr 29, 2021 at 10:44 PM Alvaro Herrera wrote: > > On 2021-Apr-29, vignesh C wrote: > > > Thanks for the comments, please find the attached v3 patch which has > > the change for the first part. > > Looks good to me. I would only add parser_errposition() to th

Re: Enhanced error message to include hint messages for redundant options error

2021-05-01 Thread vignesh C
On Sat, May 1, 2021 at 10:47 AM Dilip Kumar wrote: > > On Sat, May 1, 2021 at 10:43 AM Bharath Rupireddy > wrote: > > > > On Fri, Apr 30, 2021 at 2:49 PM Dilip Kumar wrote: > > > Looking into this again, why not as shown below? IMHO, this way the > > > code will be logically the same as it was

Re: Identify missing publications from publisher while create/alter subscription.

2021-05-01 Thread vignesh C
On Tue, Apr 13, 2021 at 8:01 PM Bharath Rupireddy wrote: > > On Tue, Apr 13, 2021 at 6:22 PM vignesh C wrote: > > > 2) How about > > > + Specifies whether the subscriber must verify the > > > publications that are > > > + being

Re: Replication slot stats misgivings

2021-04-30 Thread vignesh C
On Fri, Apr 30, 2021 at 5:55 AM Masahiko Sawada wrote: > > On Thu, Apr 29, 2021 at 9:44 PM vignesh C wrote: > > > > > > > > On Thu, Apr 29, 2021 at 3:06 PM Amit Kapila wrote: > > > > > > On Wed, Apr 28, 2021 at 5:01 PM Amit Kapila > > &g

Re: Enhanced error message to include hint messages for redundant options error

2021-04-29 Thread vignesh C
On Mon, Apr 26, 2021 at 9:24 PM Alvaro Herrera wrote: > > On 2021-Apr-26, Bharath Rupireddy wrote: > > > I agree that we can just be clear about the problem. Looks like the > > majority of the errors "conflicting or redundant options" are for > > redundant options. So, wherever "conflicting or

Included xid in restoring reorder buffer changes from disk log message

2021-04-29 Thread vignesh C
Hi, While debugging one of the logical decoding issues, I found that xid was not included in restoring reorder buffer changes from disk log messages. Attached a patch for it. I felt including the XID will be helpful in debugging. Thoughts? Regards, Vignesh From

Re: Replication slot stats misgivings

2021-04-29 Thread vignesh C
On Thu, Apr 29, 2021 at 3:06 PM Amit Kapila wrote: > > On Wed, Apr 28, 2021 at 5:01 PM Amit Kapila wrote: > > > > On Wed, Apr 28, 2021 at 4:51 PM Masahiko Sawada wrote: > > > > > > On Wed, Apr 28, 2021 at 6:39 PM Amit Kapila wrote: > > > > @@ -1369,7 +1369,7 @@

Re: Replication slot stats misgivings

2021-04-29 Thread vignesh C
On Thu, Apr 29, 2021 at 11:14 AM Masahiko Sawada wrote: > > On Thu, Apr 29, 2021 at 11:55 AM Amit Kapila wrote: > > > > On Thu, Apr 29, 2021 at 4:58 AM Masahiko Sawada > > wrote: > > > > > > On Thu, Apr 29, 2021 at 5:41 AM Tom Lane wrote: > > > > > > > > It seems that the test case added by

Re: Replication slot stats misgivings

2021-04-27 Thread vignesh C
On Wed, Apr 28, 2021 at 9:37 AM Masahiko Sawada wrote: > > On Wed, Apr 28, 2021 at 12:29 PM Amit Kapila wrote: > > > > On Tue, Apr 27, 2021 at 11:02 AM vignesh C wrote: > > > > > > On Tue, Apr 27, 2021 at 9:48 AM vignesh C wrote: > > > > >

Re: Replication slot stats misgivings

2021-04-27 Thread vignesh C
On Wed, Apr 28, 2021 at 8:59 AM Amit Kapila wrote: > > On Tue, Apr 27, 2021 at 11:02 AM vignesh C wrote: > > > > On Tue, Apr 27, 2021 at 9:48 AM vignesh C wrote: > > > > > > > Attached patch has the changes to update statistics during > > spill/st

Re: Replication slot stats misgivings

2021-04-27 Thread vignesh C
On Wed, Apr 28, 2021 at 8:28 AM Amit Kapila wrote: > > On Tue, Apr 27, 2021 at 8:28 PM Masahiko Sawada wrote: > > > > On Tue, Apr 27, 2021 at 11:29 PM Amit Kapila > > wrote: > > > > > > On Tue, Apr 27, 2021 at 5:40 PM Amit Kapila > > > wrote: > > > > > > > > > > I am not sure if the timeout

Re: [HACKERS] logical decoding of two-phase transactions

2021-04-27 Thread vignesh C
On Wed, Apr 21, 2021 at 12:13 PM Peter Smith wrote: > > On Tue, Apr 20, 2021 at 3:45 PM Peter Smith wrote: > > > > Please find attached the latest patch set v73`* > > > > Differences from v72* are: > > > > * Rebased to HEAD @ today (required because v72-0001 no longer applied > > cleanly) > > >

Re: Replication slot stats misgivings

2021-04-26 Thread vignesh C
On Tue, Apr 27, 2021 at 9:48 AM vignesh C wrote: > > On Tue, Apr 27, 2021 at 9:43 AM Amit Kapila wrote: > > > > On Tue, Apr 27, 2021 at 9:17 AM Masahiko Sawada > > wrote: > > > > > > On Tue, Apr 27, 2021 at 11:31 AM vignesh C wrote: > > >

Re: Replication slot stats misgivings

2021-04-26 Thread vignesh C
On Tue, Apr 27, 2021 at 9:43 AM Amit Kapila wrote: > > On Tue, Apr 27, 2021 at 9:17 AM Masahiko Sawada wrote: > > > > On Tue, Apr 27, 2021 at 11:31 AM vignesh C wrote: > > > > > > > > And I think there is > > > > > also a

Re: [HACKERS] logical decoding of two-phase transactions

2021-04-26 Thread vignesh C
On Wed, Apr 21, 2021 at 12:13 PM Peter Smith wrote: > > On Tue, Apr 20, 2021 at 3:45 PM Peter Smith wrote: > > > > Please find attached the latest patch set v73`* > > > > Differences from v72* are: > > > > * Rebased to HEAD @ today (required because v72-0001 no longer applied > > cleanly) > > >

Re: Replication slot stats misgivings

2021-04-26 Thread vignesh C
On Mon, Apr 26, 2021 at 8:42 AM Amit Kapila wrote: > > On Mon, Apr 26, 2021 at 8:01 AM Masahiko Sawada wrote: > > > > On Fri, Apr 23, 2021 at 6:15 PM Amit Kapila wrote: > > > > > > On Mon, Apr 19, 2021 at 4:28 PM vignesh C wrote: > > >

Re: Enhanced error message to include hint messages for redundant options error

2021-04-26 Thread vignesh C
On Mon, Apr 26, 2021 at 6:18 PM Dilip Kumar wrote: > > On Mon, Apr 26, 2021 at 5:49 PM Bharath Rupireddy > wrote: > > > > On Mon, Apr 26, 2021 at 5:29 PM vignesh C wrote: > > > > > > Hi, > > > > > > While reviewing one of the logical

Re: Enhanced error message to include hint messages for redundant options error

2021-04-26 Thread vignesh C
On Mon, Apr 26, 2021 at 5:49 PM Bharath Rupireddy wrote: > > On Mon, Apr 26, 2021 at 5:29 PM vignesh C wrote: > > > > Hi, > > > > While reviewing one of the logical replication patches, I found that > > we do not include hint messages to display the actual

Enhanced error message to include hint messages for redundant options error

2021-04-26 Thread vignesh C
Hi, While reviewing one of the logical replication patches, I found that we do not include hint messages to display the actual option which has been specified more than once in case of redundant option error. I felt including this will help in easily identifying the error, users will not have to

Re: [HACKERS] logical decoding of two-phase transactions

2021-04-26 Thread vignesh C
On Wed, Apr 21, 2021 at 12:13 PM Peter Smith wrote: > > On Tue, Apr 20, 2021 at 3:45 PM Peter Smith wrote: > > > > Please find attached the latest patch set v73`* > > > > Differences from v72* are: > > > > * Rebased to HEAD @ today (required because v72-0001 no longer applied > > cleanly) > > >

Re: Replication slot stats misgivings

2021-04-20 Thread vignesh C
On Wed, Apr 21, 2021 at 9:47 AM Amit Kapila wrote: > > On Wed, Apr 21, 2021 at 9:39 AM vignesh C wrote: > > > > I feel we can change CATALOG_VERSION_NO so that we will get this error > > "The database cluster was initialized with CATALOG_VERSION_NO > > 202

Re: Replication slot stats misgivings

2021-04-20 Thread vignesh C
On Tue, Apr 20, 2021 at 7:54 PM Masahiko Sawada wrote: > > On Tue, Apr 20, 2021 at 7:22 PM vignesh C wrote: > > > > On Tue, Apr 20, 2021 at 9:08 AM Masahiko Sawada > > wrote: > > > > > > On Mon, Apr 19, 2021 at 4:48 PM Masahiko Sawada > > >

Re: Replication slot stats misgivings

2021-04-20 Thread vignesh C
On Tue, Apr 20, 2021 at 9:08 AM Masahiko Sawada wrote: > > On Mon, Apr 19, 2021 at 4:48 PM Masahiko Sawada wrote: > > > > On Mon, Apr 19, 2021 at 2:14 PM Amit Kapila wrote: > > > > > > On Mon, Apr 19, 2021 at 9:00 AM Masahiko Sawada > > > wrote: > > > > > > > > On Fri, Apr 16, 2021 at 2:58 PM

Re: locking [user] catalog tables vs 2pc vs logical rep

2021-04-19 Thread vignesh C
On Wed, Mar 31, 2021 at 5:47 PM vignesh C wrote: > > On Wed, Mar 31, 2021 at 2:35 PM Ajin Cherian wrote: > > > > The patch applies fine on HEAD and "make check" passes fine. No major > > comments on the patch, just a minor comment: > > > > If you

Re: Replication slot stats misgivings

2021-04-19 Thread vignesh C
On Fri, Apr 16, 2021 at 3:16 PM Amit Kapila wrote: > > On Mon, Apr 12, 2021 at 2:57 PM vignesh C wrote: > > > > On Sat, Mar 20, 2021 at 9:26 AM Amit Kapila wrote: > > > > > > On Sat, Mar 20, 2021 at 12:22 AM Andres Freund wrote: > > > > &

Re: Replication slot stats misgivings

2021-04-18 Thread vignesh C
On Sun, Apr 18, 2021 at 9:02 AM vignesh C wrote: > > On Sun, Apr 18, 2021 at 8:43 AM Amit Kapila wrote: > > > > On Sun, Apr 18, 2021 at 7:36 AM vignesh C wrote: > > > > > > On Sun, Apr 18, 2021 at 3:51 AM Tom Lane wrote: > > > > > > > &g

Re: Replication slot stats misgivings

2021-04-17 Thread vignesh C
On Sun, Apr 18, 2021 at 8:43 AM Amit Kapila wrote: > > On Sun, Apr 18, 2021 at 7:36 AM vignesh C wrote: > > > > On Sun, Apr 18, 2021 at 3:51 AM Tom Lane wrote: > > > > > > I wrote: > > > > The buildfarm suggests that this isn't entirely stable:

Re: Replication slot stats misgivings

2021-04-17 Thread vignesh C
On Sun, Apr 18, 2021 at 3:51 AM Tom Lane wrote: > > I wrote: > > The buildfarm suggests that this isn't entirely stable: > > https://buildfarm.postgresql.org/cgi-bin/show_log.pl?nm=anole=2021-04-17%2011%3A14%3A49 > >

Re: Replication slot stats misgivings

2021-04-16 Thread vignesh C
On Fri, Apr 16, 2021 at 11:28 AM Amit Kapila wrote: > > On Thu, Apr 15, 2021 at 4:35 PM Masahiko Sawada wrote: > > > > Thank you for the update! The patch looks good to me. > > > > I have pushed the first patch. Comments on the next patch > v13-0001-Use-HTAB-for-replication-slot-statistics:

Re: Replication slot stats misgivings

2021-04-16 Thread vignesh C
On Fri, Apr 16, 2021 at 3:16 PM Amit Kapila wrote: > > On Mon, Apr 12, 2021 at 2:57 PM vignesh C wrote: > > > > On Sat, Mar 20, 2021 at 9:26 AM Amit Kapila wrote: > > > > > > On Sat, Mar 20, 2021 at 12:22 AM Andres Freund wrote: > > > > &

Re: Replication slot stats misgivings

2021-04-15 Thread vignesh C
On Thu, Apr 15, 2021 at 2:46 PM Amit Kapila wrote: > > On Thu, Apr 15, 2021 at 1:13 PM Masahiko Sawada wrote: > > > > On Thu, Apr 15, 2021 at 3:22 PM Amit Kapila wrote: > > > > > Thank you for updating the patch. > > > > I have one question on the doc change: > > > > +so the counter is

Re: Replication slot stats misgivings

2021-04-15 Thread vignesh C
On Thu, Apr 15, 2021 at 11:52 AM Amit Kapila wrote: > > On Wed, Apr 14, 2021 at 5:52 PM vignesh C wrote: > > > > I have made minor changes to the 0001 and 0002 patches. Attached is > the combined patch for them, I think we can push them as one patch. > Changes ma

Re: Replication slot stats misgivings

2021-04-14 Thread vignesh C
On Wed, Apr 14, 2021 at 12:09 PM Amit Kapila wrote: > > On Tue, Apr 13, 2021 at 1:37 PM vignesh C wrote: > > > > On Mon, Apr 12, 2021 at 7:03 PM Masahiko Sawada > > wrote: > > > > > > > > > The following test for the latest v8 patch seems t

Re: Replication slot stats misgivings

2021-04-13 Thread vignesh C
On Wed, Apr 14, 2021 at 7:52 AM Masahiko Sawada wrote: > > On Tue, Apr 13, 2021 at 5:07 PM vignesh C wrote: > > > > On Mon, Apr 12, 2021 at 7:03 PM Masahiko Sawada > > wrote: > > > > > > On Mon, Apr 12, 2021 at 9:36 PM Amit Kapila > > > wro

Re: Replication slot stats misgivings

2021-04-13 Thread vignesh C
On Tue, Apr 13, 2021 at 10:46 AM Masahiko Sawada wrote: > > On Mon, Apr 12, 2021 at 9:16 PM vignesh C wrote: > > > > On Mon, Apr 12, 2021 at 4:46 PM Amit Kapila wrote: > > > > > > On Sat, Apr 10, 2021 at 6:51 PM vignesh C wrote: > > > > > >

Re: Identify missing publications from publisher while create/alter subscription.

2021-04-13 Thread vignesh C
On Thu, Apr 8, 2021 at 12:13 PM Bharath Rupireddy wrote: > > On Wed, Apr 7, 2021 at 10:37 PM vignesh C wrote: > > > I think, we can also have validate_publication option allowed for > > > ALTER SUBSCRIPTION SET PUBLICATION and REFRESH PUBLICATION commands > > > w

Monitoring stats docs inconsistency

2021-04-13 Thread vignesh C
Hi, Few of the statistics description in monitoring_stats.sgml doc is not consistent. Made all the descriptions consistent by including punctuation marks at the end of each description. Thoughts? Regards, Vignesh From b74179aec11eb1f2439ef43e1830531c2cde78a2 Mon Sep 17 00:00:00 2001 From:

Re: Replication slot stats misgivings

2021-04-13 Thread vignesh C
On Mon, Apr 12, 2021 at 7:03 PM Masahiko Sawada wrote: > > On Mon, Apr 12, 2021 at 9:36 PM Amit Kapila wrote: > > > > On Mon, Apr 12, 2021 at 5:29 PM Masahiko Sawada > > wrote: > > > > > > On Mon, Apr 12, 2021 at 8:08 PM Amit Kapila > > > wrote: > > > > > > > > On Mon, Apr 12, 2021 at 4:34

Re: Replication slot stats misgivings

2021-04-12 Thread vignesh C
On Mon, Apr 12, 2021 at 7:03 PM Masahiko Sawada wrote: > > On Mon, Apr 12, 2021 at 9:36 PM Amit Kapila wrote: > > > > On Mon, Apr 12, 2021 at 5:29 PM Masahiko Sawada > > wrote: > > > > > > On Mon, Apr 12, 2021 at 8:08 PM Amit Kapila > > > wrote: > > > > > > > > On Mon, Apr 12, 2021 at 4:34

Re: Replication slot stats misgivings

2021-04-12 Thread vignesh C
On Mon, Apr 12, 2021 at 4:46 PM Amit Kapila wrote: > > On Sat, Apr 10, 2021 at 6:51 PM vignesh C wrote: > > > > Thanks, 0001 and 0002 look good to me. I have a minor comment for 0002. > > > +total_bytesbigint > + > + > +Amou

Re: Replication slot stats misgivings

2021-04-12 Thread vignesh C
On Mon, Apr 12, 2021 at 4:34 PM Masahiko Sawada wrote: > > On Mon, Apr 12, 2021 at 6:19 PM Amit Kapila wrote: > > > > On Mon, Apr 12, 2021 at 10:27 AM Masahiko Sawada > > wrote: > > > > > > On Sat, Apr 10, 2021 at 9:53 PM Amit Kapila > > > wrote: > > > > > > > > > > > > It seems Vignesh has

Re: Replication slot stats misgivings

2021-04-12 Thread vignesh C
On Sat, Mar 20, 2021 at 9:26 AM Amit Kapila wrote: > > On Sat, Mar 20, 2021 at 12:22 AM Andres Freund wrote: > > > > And then more generally about the feature: > > - If a slot was used to stream out a large amount of changes (say an > > initial data load), but then replication is interrupted

Re: Replication slot stats misgivings

2021-04-11 Thread vignesh C
Thanks for the comments. On Fri, Apr 9, 2021 at 4:13 PM Amit Kapila wrote: > > On Wed, Apr 7, 2021 at 2:51 PM vignesh C wrote: > > > > That is not required, I have modified it. > > Attached v4 patch has the fixes for the same. > > > > Few comments: &g

Re: Replication slot stats misgivings

2021-04-10 Thread vignesh C
On Sat, Apr 10, 2021 at 6:24 PM Amit Kapila wrote: > > On Sat, Apr 10, 2021 at 1:06 PM vignesh C wrote: > > > > Thanks Amit for your Patch. I have merged your changes into my > > patchset. I did not find any issues in my testing. > > Thoughts? > >

Re: Replication slot stats misgivings

2021-04-10 Thread vignesh C
On Sat, Apr 10, 2021 at 9:50 AM Amit Kapila wrote: > > On Fri, Apr 9, 2021 at 4:13 PM Amit Kapila wrote: > > > > 2. > > @@ -2051,6 +2054,17 @@ ReorderBufferProcessTXN(ReorderBuffer *rb, > > ReorderBufferTXN *txn, > > rb->begin(rb, txn); > > } > > > > + /* > > + * Update total transaction

Re: Replication slot stats misgivings

2021-04-08 Thread vignesh C
On Thu, Apr 8, 2021 at 4:00 PM Amit Kapila wrote: > > On Wed, Apr 7, 2021 at 2:51 PM vignesh C wrote: > > > > @@ -4069,6 +4069,24 @@ pgstat_read_statsfiles(Oid onlydb, bool > permanent, bool deep) > * slot follows. > */ > case 'R': > + /* > + *

Re: Identify missing publications from publisher while create/alter subscription.

2021-04-07 Thread vignesh C
On Thu, Mar 4, 2021 at 1:04 PM Bharath Rupireddy wrote: > > On Wed, Mar 3, 2021 at 8:59 AM Euler Taveira wrote: > > > > On Wed, Feb 3, 2021, at 2:13 AM, Bharath Rupireddy wrote: > > > > On Mon, Jan 25, 2021 at 10:32 PM vignesh C wrote: > > > &g

Re: [PATCH] PREPARE TRANSACTION unexpected behavior with TEMP TABLE

2021-04-07 Thread vignesh C
On Tue, Apr 6, 2021 at 8:18 PM Himanshu Upadhyaya wrote: > > Hi, > > While working on one of the issue, I have noticed below unexpected behavior > with "PREPARE TRANSACTION". > > We are getting this unexpected behavior with PREPARE TRANSACTION when it is > mixed with Temporary Objects. Please

Re: Replication slot stats misgivings

2021-04-07 Thread vignesh C
On Tue, Apr 6, 2021 at 12:19 PM Amit Kapila wrote: > > On Mon, Apr 5, 2021 at 8:51 PM vignesh C wrote: > > > > Few comments on the latest patches: > Comments on 0001 > > 1. > @@ -659,6 +661,8 @@ ReorderBufferTXNByXid(ReorderBuffer

Re: Replication slot stats misgivings

2021-04-06 Thread vignesh C
On Tue, Apr 6, 2021 at 12:19 PM Amit Kapila wrote: > > On Mon, Apr 5, 2021 at 8:51 PM vignesh C wrote: > > > > Few comments on the latest patches: > Comments on 0001 > > 1. > @@ -659,6 +661,8 @@ ReorderBufferTXNByXid(ReorderBuffer

<    7   8   9   10   11   12   13   14   15   16   >