Hi, I have two questions about Kafka consumer api:
1. I read the section "Storing Offsets Outside Kafka" in jdoc of KafkaConsumer. Is it safer or more efficient to manage offset with external storage compared to manage with Kafka(Zookeeper or topic _consumer_offset)? Or is there any benefit for system safety or robustness, when network issue occur or consumer crash? 2. I read the section "Detecting Consumer Failures" in jdoc of KafkaConsumder, and got bellow points: - If consumer not call another poll() after max.poll.interval.ms, it will be remove from consumer group. - And the only active approach for consumer to detect failures, is to call consumer.commit() and try catch CommitFailedException . Sometimes I found that consumer hanging at method poll() when network issue occur or rebalance failure, and no exception throw from poll(). How do we detect that failure from consumer side? I refer the old mail "[Kafka-users] How are rebalance failures raised to consumers?" and it seems no approach. Thanks, Ruiping Li
