Re: Intermittent Issue with WAL Segment Removal in Logical Replication

2024-01-01 Thread Kaushik Iska
I am unfortunately not really familiar with Google Cloud SQL internals as well. But we have seen this happen on Amazon RDS as well. Could it be possible that we are requesting a future WAL segment, say WAL upto X is written and we are asking for X + 1? It could be that the error message is mislead

Re: Intermittent Issue with WAL Segment Removal in Logical Replication

2023-12-29 Thread Tomas Vondra
On 12/29/23 22:28, Kaushik Iska wrote: > I am unfortunately not really familiar with Google Cloud SQL internals > as well. But we have seen this happen on Amazon RDS as well. > Do you have a reproducer for regular Postgres? > Could it be possible that we are requesting a future WAL segment, say

Re: Intermittent Issue with WAL Segment Removal in Logical Replication

2023-12-29 Thread Tomas Vondra
On 12/27/23 16:31, Kaushik Iska wrote: > Hi all, > > I'm including additional details, as I am able to reproduce this issue a > little more reliably. > > Postgres Version: POSTGRES_14_9.R20230830.01_07 > Vendor: Google Cloud SQL > Logical Replication Protocol version 1 > I don't know much about

Re: Intermittent Issue with WAL Segment Removal in Logical Replication

2023-12-28 Thread Ron Johnson
On Thu, Dec 28, 2023 at 4:54 PM Kaushik Iska wrote: > Hi all, > > I'm including additional details, as I am able to reproduce this issue a > little more reliably. > > Postgres Version: POSTGRES_14_9.R20230830.01_07 > Vendor: Google Cloud SQL > Logical Replication Protocol version 1 > > Here are t

Re: Intermittent Issue with WAL Segment Removal in Logical Replication

2023-12-28 Thread Kaushik Iska
Hi all, I'm including additional details, as I am able to reproduce this issue a little more reliably. Postgres Version: POSTGRES_14_9.R20230830.01_07 Vendor: Google Cloud SQL Logical Replication Protocol version 1 Here are the logs of attempt succeeding right after it fails: 2023-12-27 01:12:4

Intermittent Issue with WAL Segment Removal in Logical Replication

2023-12-26 Thread Kaushik Iska
Dear PostgreSQL Community, I am seeking guidance regarding a recurring issue we've encountered with WAL segment removal during logical replication using pgoutput plugin. We sporadically encounter an error indicating that a requested WAL segment has already been removed. This issue arises intermitt