Re: kafka per topic metrics

2020-07-14 Thread rohit garg
You can try using kafka manager and check it will fullfill most of requirement of yours. Thanks and Regards, Rohit On Wed, Jul 15, 2020, 10:33 Pushkar Deole wrote: > Hi All, > > Any inputs as to how the kafka consumer and producer metrics can be hooked > up to a monitoring system such as promet

Re: kafka per topic metrics

2020-07-14 Thread Pushkar Deole
Hi All, Any inputs as to how the kafka consumer and producer metrics can be hooked up to a monitoring system such as prometheus ? On Tue, Jul 14, 2020 at 4:22 PM Pushkar Deole wrote: > i did find these metrics from confluent docs: however how can i get this > metric ? is it available at kafka b

Namespace problem in schema registry

2020-07-14 Thread vishnu murali
Hi all, I am having questions on namespace in schema registry If schema is automatically generate from JDBC source connector Means then the schema doesn't have namespace field and value But if we created schema manually with namespace and register into schema registry and if I try to run connect

Re: Kafka SFTP connector

2020-07-14 Thread vishnu murali
Hi Ricardo Thanks for the response But the tls.private.key type was a password and I am giving request through postman In this place how can we give that public key value in postman as a string That public key having so many characters which not included within that string double quotes.. More

[VOTE] 2.6.0 RC0

2020-07-14 Thread Randall Hauch
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 2.6.0. This is a major release that includes many new features, including: * TLSv1.3 has been enabled by default for Java 11 or newer. * Smooth scaling out of Kafka Streams applications *

Re: Kafka SFTP connector

2020-07-14 Thread Ricardo Ferreira
Vishnu, A public key file can be specified via the property `tls.public.key`. Thanks, -- Ricardo On 7/14/20 6:09 AM, vishnu murali wrote: Hi all, I am using SFTP connector which that SFTP connection can be accessed by using public key file. How can I give this configuration in postman to st

is ktable-ktable join stil having the risk of non determinism?

2020-07-14 Thread Dumitru-Nicolae Marasoui
In https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Streams+Join+Semantics#KafkaStreamsJoinSemantics-KTable-KTableJoin.1 it is mentioned that "Pay attention, that the KTable lookup is done on the *current* KTable state, and thus, out-of-order records can yield non-deterministic result. Furth

ktable join & data loss / indeterminism risk prevention

2020-07-14 Thread Dumitru-Nicolae Marasoui
Hello kafka community, As I understand it, a kafka-streams join that involves a kTable: “the KTable lookup is done on the current KTable state, and thus, out-of-order records can yield non-deterministic result” [1] Does the solution below involving an intermediate topic sound right to you? 1. kafk

Re: kafka per topic metrics

2020-07-14 Thread Pushkar Deole
i did find these metrics from confluent docs: however how can i get this metric ? is it available at kafka broker? Per-Topic Metrics MBean: kafka.producer:type=producer-topic-metrics,client-id=([-.w]+),topic=([-.w]+) record-send-rateThe average number of records sent per second for a topic. On T

Kafka SFTP connector

2020-07-14 Thread vishnu murali
Hi all, I am using SFTP connector which that SFTP connection can be accessed by using public key file. How can I give this configuration in postman to start sftp connector? Anyone have any suggestions?

kafka per topic metrics

2020-07-14 Thread Pushkar Deole
Hi All, Need some help on kafka metrics, i am interested in certain metrics e.g. i need to know the number of records published on a particular topic and number of records consumed from that topic by a specific consumer group, i would need a total of these 2 and also average per second for them.

Re: help needed, kafka-streams 2.5.0 does not support Named on reduce?

2020-07-14 Thread Dumitru-Nicolae Marasoui
I think it does help thank you very much On Fri, 10 Jul 2020 at 17:29, Matthias J. Sax wrote: > It should be possible to name all processors/stores/topics. > > However, it's not always clear how the API works -- in fact, some > `Named` parameters "overlap". It's a know issue and not well documen