Re: Datacenter to datacenter over the open internet

2015-10-06 Thread Pradeep Gollakota
At Lithium, we have multiple datacenters and we distcp our data across our Hadoop clusters. We have 2 DCs in NA and 1 in EU. We have a non-redundant direct connect from our EU cluster to one of our NA DCs. If and when this fails, we have automatic failover to a VPN that goes over the internet. The

Datacenter to datacenter over the open internet

2015-10-06 Thread Tom Brown
Hello, How do you consume a kafka topic from a remote location without a dedicated connection? How do you protect the server? The setup: data streams into our datacenter. We process it, and publish it to a kafka cluster. The consumer is located in a different datacenter with no direct

Re: Datacenter to datacenter over the open internet

2015-10-06 Thread Gwen Shapira
You can configure "advertised.host.name" for each broker, which is the name external consumers and producers will use to refer to the brokers. On Tue, Oct 6, 2015 at 3:31 PM, Tom Brown wrote: > Hello, > > How do you consume a kafka topic from a remote location without a