Can postgres replication slot using pgoutput release multiple CDC records for a single update to a particular row

2025-07-29 Thread Akashkiran Shivakumar
Hello, I have a postgres database (major version 13) and am doing CDC by using a replication slot with pgoutput. In our data lake, we see that there are multiple updates (3 in this case) happening to the same row as part of the same transaction. This doesn't make sense if we look at them as separat

Re: Regarding logical replication issues with PostgreSQL versions 16and above

2025-07-29 Thread Laurenz Albe
On Tue, 2025-07-29 at 15:00 +0800, yexiu-glory wrote: > The approach of adding unique indexes is not suitable for our business. Well, then I guess that logical replication is not suitable for your business. Yours, Laurenz Albe

Re: Regarding logical replication issues with PostgreSQL versions 16and above

2025-07-29 Thread yexiu-glory
>>>On Fri, 2025-07-18 at 19:08 +0800, yexiu-glory wrote: > >>>I'm facing a problem here: our business requires logical data replication to other departments, >>>but at the same time, sensitive fields need to be filtered out. Therefore, >>>we used the column filtering function when creating logica

Re: Get info about the index

2025-07-29 Thread Igor Korot
On Tue, Jul 29, 2025, 9:24 AM Laurenz Albe wrote: > On Tue, 2025-07-29 at 07:18 -0500, Igor Korot wrote: > > If I have a database for some financial data for the year 2024 in the > > mydb_2024 and I have current year financial data in the mydb_2025 how > > can I compare the data? > > You connect

Re: Get info about the index

2025-07-29 Thread Laurenz Albe
On Tue, 2025-07-29 at 07:18 -0500, Igor Korot wrote: > If I have a database for some financial data for the year 2024 in the > mydb_2024 and I have current year financial data in the mydb_2025 how > can I compare the data? You connect to both and query them both. Alternatively, you use postgres_f

Re: Get info about the index

2025-07-29 Thread Igor Korot
On Tue, Jul 29, 2025 at 7:07 AM Laurenz Albe wrote: > > On Tue, 2025-07-29 at 06:46 -0500, Igor Korot wrote: > > SELECT > > t.relname AS table_name, > > i.relname AS index_name, > > a.attname AS column_name > > FROM > > pg_class t, > > pg_class i, > > pg_index ix, > > p

Re: Get info about the index

2025-07-29 Thread Laurenz Albe
On Tue, 2025-07-29 at 06:46 -0500, Igor Korot wrote: > SELECT >     t.relname AS table_name, >     i.relname AS index_name, >     a.attname AS column_name > FROM >     pg_class t, >     pg_class i, >     pg_index ix, >     pg_attribute a > WHERE >     t.oid = ix.indrelid AND >     i.oid = ix.indexr

Re: Get info about the index

2025-07-29 Thread Igor Korot
Hi, guys, On Mon, Jul 28, 2025 at 10:13 AM Laurenz Albe wrote: > > On Mon, 2025-07-28 at 08:19 -0500, David Barbour wrote: > > Couple of suggestions. You might try ChatGPT. > > Please don't be insulting. He asked for real information. I finally formulate my google request and got this: https: