Re: Turning on compaction - can I rolling restart?

Hey Sean, You can do rolling restart, then can do a describe of the topic, to check if the broker is back. Then continue with the next one. Best, Xin On 13.04.18, 21:09, "McNealy, Sean" wrote: I have a cluster of 3 kafka brokers running 0.10.2 that have been

Re: Kafka/zookeeper logs in every command

Looking for log4j.properties, in the config directoires. Best, Xin On 23.01.18, 16:58, "José Ribeiro" wrote: Good morning. I have a problem about kafka logs showing in my outputs. When i started to work with kafka, the outputs were

Re: How to always consume from latest offset in kafka-streams

This? consumer.auto.offset.reset = latest Best, Xin On 19.01.18, 19:34, "Saloni Vithalani" wrote: Our requirement is such that if a kafka-stream app is consuming a partition, it should start it's consumption from latest offset of that partition.

Re: Best practice for publishing byte messages to Kafka

Protobuf? On 11.01.18, 01:33, "Ali Nazemian" wrote: Oops, I was mistaken. I meant serialization of an object as a byte array from the first place! On Wed, Jan 10, 2018 at 3:20 PM, Thunder Stumpges < thunder.stump...@gmail.com> wrote: > Byte

Re: Need feedbacks to consumer if hangs due to some __consumer_offsets partitions failed

Hey, I think you can do it in two ways: 1. Manually increase the replication factor 2. In the server.config file, change the default.replication.factor Best, Xin On 09.01.18, 07:46, "1095193...@qq.com" <1095193...@qq.com> wrote: hi My kafka cluster has two brokers( 0 and 1) and

Re: Consumer Offsets Being Deleted by Broker

Hey, I think what you looking for is offsets.retention.minutes from server side configuration. Best, Xin On 10.12.17, 07:13, "M. Musheer" wrote: Hi, We are using "kafka_2.11-1.0.0" kafka version with default "offset" related configurations. Issue:

Re: Log Compaction Not Picking up Topic

Hey Elmar, The only thing you need to do is upgrade, Kafka track cleaned offset using cleaner-offset-checkpoint file. Best, Xin Xin Li Data EngineeringXin.Li@ <mailto:xin...@xin.li>trivago.com <mailto:y...@trivago.com>www.triva

Re: Log Compaction Not Picking up Topic

Hey, Because of the overflow the calculation for dirty ratios is minus, and I guess upgrade is the one time for good fix. And we running that for quite a while, so far so good. Best, Xin Xin Li Data EngineeringXin.Li@ <mailto:xin...@xin.li>triva

Re: Log Compaction Not Picking up Topic

Hey, I think that is a bug, and should be fixed in this task https://issues.apache.org/jira/browse/KAFKA-6030. We experience that in our kafka cluster, we just check out the 11.0.2 version, build it ourselves. Best, Xin Xin Li Data EngineeringXin.Li