Re: kafka 0.10 offset storage on zookeeper

2016-11-16 Thread Guozhang Wang
I think Onur has once mentioned similar issues that currently we do not have a fully automated smooth upgrade path from old consumer (offsets stored in ZK) to new consumer (offsets stored in Kafka), maybe he can provide more context here and how it can be resolved. Currently the following procedur

kafka 0.10 offset storage on zookeeper

2016-11-13 Thread Wei Li
Hi All, We recently upgraded kafka from 0.8 to 0.10 with security features enabled (ssl/sasl/acls). One thing noticed is the offset is not longer kept on zookeeper any more in 0.10 release. Though this is new feature for new version, we like to still keep the offsets stored on zookeeper in short