Kafka 2.3 - SASL_SSL

2019-08-29 Thread Antony A
Hi, I have configured the brokers and zookeepers as below to enable SSL and authentication with SASL/Kerberos. I have tried with and without advertised.listeners, advertised.host.name, host.name, port. *server.properties* listeners=SASL_SSL://:9092 advertised.listeners=SASL_SSL://:9092 advertis

Re: Multiple bootstrap clusters in kafka producer config

2019-08-29 Thread Ryanne Dolan
Will, the idea is to have a DNS name or VIP which resolves to IP addresses from one cluster or the other depending on health checks. You can have your producers load-balanced 50/50 between two clusters, or could have a backup cluster that is only used when the primary cluster is unreachable, etc.

Reverting log.message.format.version

2019-08-29 Thread Sebastian Schmitz
Hello, is it possible to revert the log.message.format.version when we find out that a consumer doesn't work with the new version? I read in the documentation that setting this in the config would tell Kafka that all messages in the logs are not higher than that number, so I think we would h

Re: Kafka - Possible messages order

2019-08-29 Thread Anatoliy Soldatov
What exactly is the problem? Kafka states it in documentation and it is not new. Quote from docs: max.in.flight.requests.per.connection – The maximum number of unacknowledged requests the client will send on a single connection before blocking. Note that if this setting is set to be greater tha

Re: Kafka - Possible messages order

2019-08-29 Thread Lisheng Wang
Hi the description of that blog is correct. as the default value of retries has been change to max_int from 0, then the order is not guaranteed in single partition any more by default even if records was send from same producer. the following description come from "Kafka: The Definitive Guide" A

librdkafka : seek() to offset out of range

2019-08-29 Thread Aurelien DROISSART
Hello all, we have a question about librdkafka - Kafka version : 2.0.1 - librdkafka version : 0.11.4 We have an application connecting to kafka using librdkafka. It needs to consume a topic starting at a specific offset value stored in the application. It does so by calling rd_kafka_seek(). In

Kafka - Possible messages order

2019-08-29 Thread Jose Manuel Vega Monroy
Hi there, Recently we found this blog entry about a possible problem with messages order: https://blog.softwaremill.com/does-kafka-really-guarantee-the-order-of-messages-3ca849fd19d2 Please could you confirm about? And if so, how to fix? Blog entry suggesting how to. Thanks [https://www.willi

Re: Multiple bootstrap clusters in kafka producer config

2019-08-29 Thread Will Weber
Hey Ryanne, thanks for the feedback. Would you mind going into more detail with how that would work? My understanding is that the Kafka wire protocol isn’t really intended to be loadbalanced. Or is it more that the load balancer acts as more of a service discovery point for clients? I’ve seen in

Re: Kafka Group coordinator discovery failing for subsequent restarts

2019-08-29 Thread Lisheng Wang
Did you see the warning "Error connecting to node" on consumer log? Best, Lisheng Hrishikesh Mishra 于2019年8月29日周四 下午2:45写道: > Please find my reply in blue colour: > > > > On Thu, Aug 29, 2019 at 11:32 AM Lisheng Wang > wrote: > > > Hi > > > > about question 1, it's dosen't matter that how man

Re: please care and vote for Chinese people under cruel autocracy of CCP, great thanks!

2019-08-29 Thread James Kwan
Why is this group being targeted by the false political propaganda? The sender did not even use a valid email account. On Thu, Aug 29, 2019 at 7:05 AM ant_fighter wrote: > Hi all, > Sorry for disturbing you guys. Though I don't think here as a proper place > to do this, I need your help, your vo