[GENERAL] ways of monitoring logical decoding performance

2017-11-12 Thread Weiping Qu
Dear all, I'd like to monitor the resource utilization of logical decoding (e.g. in version 9.5). For example, I'd like to see the wal buffer hit ratio, i.e. how much reading for logical decoding is from in-memory pages. This can be set by blks_hit/(blks_read+blks_hit) from pg_stat_database.

[GENERAL] wal configuration setting for fast streaming replication with logical decoding

2017-11-08 Thread Weiping Qu
Hi, I intend to increase the speed of streaming replication with logical decoding using following configuration: wal_level = logical fsync = on synchronous_commit = off wal_sync_method = fdatasync wal_buffers = 256MB wal_writer_delay = 2seconds checkpoint_timeout = 15min max_wal_size=10GB

Re: [GENERAL] Question regarding logical replication

2017-10-27 Thread Weiping Qu
based change data capture. Weiping On 27.10.2017 14:03, Francisco Olarte wrote: On Fri, Oct 27, 2017 at 12:04 PM, Weiping Qu <q...@informatik.uni-kl.de> wrote: That's a good point and we haven't accounted for disk caching. Is there any way to confirm this fact in PostgreSQL? I doubt, as it

Re: [GENERAL] Question regarding logical replication

2017-10-27 Thread Weiping Qu
That's a good point and we haven't accounted for disk caching. Is there any way to confirm this fact in PostgreSQL? Weiping On 27.10.2017 11:53, Francisco Olarte wrote: On Thu, Oct 26, 2017 at 10:20 PM, Weiping Qu <q...@informatik.uni-kl.de> wrote: However, the plots showed different

Re: [GENERAL] Question regarding logical replication

2017-10-26 Thread Weiping Qu
could get your partition full of xlog. Regards, Alvaro Aguayo Operations Manager Open Comb Systems E.I.R.L. Office: (+51-1) 3377813 | Mobile: (+51) 995540103 | (+51) 954183248 Web: www.ocs.pe - Original Message - From: "Weiping Qu" <q...@informatik.uni-kl.de> To: "

[GENERAL] Question regarding logical replication

2017-10-26 Thread Weiping Qu
Dear postgresql community, I have a question regarding understanding the implementation logic behind logical replication. Assume a replication slot created on the master node, will more and more data get piled up in the slot and the size of replication slot continuously increase if there is

Re: [GENERAL] commit time in logical decoding

2016-03-01 Thread Weiping Qu
that it is a bug. Thank you for report. I guess it will be fixed soon. On 01.03.2016 17:36, Weiping Qu wrote: Dear postgresql general mailing list, I am currently using the logical decoding feature (version 9.6 I think as far as I found in the source, wal_level: logical, max_replication_slot: >

[GENERAL] commit time in logical decoding

2016-03-01 Thread Weiping Qu
Dear postgresql general mailing list, I am currently using the logical decoding feature (version 9.6 I think as far as I found in the source, wal_level: logical, max_replication_slot: > 1, track_commit_timestamp: on, I am not sure whether this will help or not). Following the online

[GENERAL] Confusing with commit time usage in logical decoding

2016-02-29 Thread Weiping Qu
Dear postgresql general mailing list, I am currently using the logical decoding feature (version 9.6 I think as far as I found in the source, wal_level: logical, max_replication_slot: > 1, track_commit_timestamp: on, I am not sure whether this will help or not). Following the online

[GENERAL] Confusing with commit time usage in logical decoding

2016-02-29 Thread Weiping Qu
If you received this message twice, sorry for annoying since I did not subscribe successfully previously due to conflicting email domain. Dear postgresql general mailing list, I am currently using the logical decoding feature (version 9.6 I think as far as I found in the source, wal_level: