Why not re-use same cluster? You can assign topics to be live only within a specific set of brokers. Thus you have one "bus" for messages, simplifying your applications code and configurations
On Mon, Dec 5, 2016 at 9:43 PM Yifan Ying <nafan...@gmail.com> wrote: > Hi, > > Initially, we have only one Kafka cluster shared across all teams. But now > this cluster is very close to out of resources (disk space, # of > partitions, etc.). So we are considering adding another Kafka cluster. But > what's the best practice of topic discovery, so that applications know > which cluster their topics live? We have been using Zookeeper for service > discovery, maybe it's also good for this purpose? > > Thanks > > -- > Yifan >
