Hi, I have a use case where my kafka cluster will have 1000 brokers and I am writing kafka client. In order to write client, i need to provide brokers list.
Question is, what are the recommended guidelines to provide brokers list in client? *Is there any proxy like service available in kafka which we can give to client?* - that proxy will know all the brokers in cluster and connect client to appropriate broker. - like in redis world, we have twemproxy (nutcracker) *Is it recommended to provide any specific number of brokers in client, for example provide list of 3 brokers even though cluster has 1000 nodes?* - what if provided brokers gets crashed? - what if provided brokers restarts and there location/ip changes? Thanks, Pritam.