What configurations allow you to assign topics to specific brokers? I can see https://kafka.apache.org/documentation#basic_ops_automigrate. This should allow you to move things around but does that keep anything from being re-assigned to the old ones?
On Tue, Dec 6, 2016 at 5:25 PM, Asaf Mesika <asaf.mes...@gmail.com> wrote: > Why not re-use same cluster? You can assign topics to be live only within a > specific set of brokers. Thus you have one "bus" for messages, simplifying > your applications code and configurations > > On Mon, Dec 5, 2016 at 9:43 PM Yifan Ying <nafan...@gmail.com> wrote: > > > Hi, > > > > Initially, we have only one Kafka cluster shared across all teams. But > now > > this cluster is very close to out of resources (disk space, # of > > partitions, etc.). So we are considering adding another Kafka cluster. > But > > what's the best practice of topic discovery, so that applications know > > which cluster their topics live? We have been using Zookeeper for service > > discovery, maybe it's also good for this purpose? > > > > Thanks > > > > -- > > Yifan > > >
