Re: Dynamic bootstrap.servers with multiple data centers

2016-06-08 Thread Danny Bahir
Thanks Ismael, Don't have permissions, my username is dbahir. On Fri, Jun 3, 2016 at 4:49 AM, Ismael Juma wrote: > There are instructions here: > > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals > > Let me know your user id in the wiki if you don't have the requ

Re: Dynamic bootstrap.servers with multiple data centers

2016-06-03 Thread Ismael Juma
There are instructions here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals Let me know your user id in the wiki if you don't have the required permissions to create pages. Ismael On Fri, Jun 3, 2016 at 3:33 AM, Danny Bahir wrote: > Yes, I'm in. > > Sent from my

Re: Dynamic bootstrap.servers with multiple data centers

2016-06-02 Thread Danny Bahir
Yes, I'm in. Sent from my iPhone > On Jun 2, 2016, at 8:32 AM, Ismael Juma wrote: > > Hi Danny, > > A KIP has not been drafted for that yet. Would you be interested in working > on it? > > Ismael > >> On Thu, Jun 2, 2016 at 1:15 PM, Danny Bahir wrote: >> >> Thanks Ben. >> >> The comments

Re: Dynamic bootstrap.servers with multiple data centers

2016-06-02 Thread Enrico Olivelli
I am on the same situation. I use zookeeper to publish kafka broker endpoints for dynamic discovery. Il Gio 2 Giu 2016 14:33 Ismael Juma ha scritto: > Hi Danny, > > A KIP has not been drafted for that yet. Would you be interested in working > on it? > > Ismael > > On Thu, Jun 2, 2016 at 1:15 PM,

Re: Dynamic bootstrap.servers with multiple data centers

2016-06-02 Thread Ismael Juma
Hi Danny, A KIP has not been drafted for that yet. Would you be interested in working on it? Ismael On Thu, Jun 2, 2016 at 1:15 PM, Danny Bahir wrote: > Thanks Ben. > > The comments on the Jira mention a pluggable component that will manage > the bootstrap list from a discovery service. > > Th

Re: Dynamic bootstrap.servers with multiple data centers

2016-06-02 Thread Danny Bahir
Thanks Ben. The comments on the Jira mention a pluggable component that will manage the bootstrap list from a discovery service. That's exactly what I need. Was a Kip drafted for this enhancement? -Danny > On Jun 1, 2016, at 7:05 AM, Ben Stopford wrote: > > Hey Danny > > Currently the boo

Re: Dynamic bootstrap.servers with multiple data centers

2016-06-01 Thread Ben Stopford
Hey Danny Currently the bootstrap servers are only used when the client initialises (there’s a bit of discussion around the issue in the jira below if you’re interested). To implement failover you’d need to catch a timeout exception in your client code, consulting your service discovery mechani

Dynamic bootstrap.servers with multiple data centers

2016-05-31 Thread Danny Bahir
Hello, Working on a multi data center Kafka installation in which all clusters have the same topics, the producers will be able to connect to any of the clusters. Would like the ability to dynamically control the set of clusters a producer will be able to connect to, that will allow to graceful