Hi Dan,
For Kafka:
* Make sure that your listeners and advertised listener configuration is
set up correctly for external connectivity, incl. your Kafka protocols
For Kubernetes:
* How are you exposing the Kafka port? Your port number seems low for
Kubernetes, typically external ports will be above 30000
* There are several different ways of exposing a port externally, e.g.
through a load balancer
* Do you have a DNS entry for the kafka service to be resolvable externally?
Kind regards
Pirow Engelbrecht | Senior Design Engineer
Tel +27 12 678 9740 (ext. 9879) | Cell +27 63 148 3376
76 Regency Drive | Irene | Centurion | 0157<https://goo.gl/maps/v9ZbwjqpPyL2>
[cid:[email protected]]<https://etion.co.za>
Facebook<https://www.facebook.com/Etion-Limited-2194612947433812?_rdc=1&_rdr> |
YouTube<https://www.youtube.com/channel/UCUY-5oeACtLk2uTsEjZCU6A> |
LinkedIn<https://www.linkedin.com/company/etionltd> |
Twitter<https://twitter.com/Etionlimited> |
Instagram<https://www.instagram.com/Etionlimited/>
From: Dan Hill <[email protected]>
Sent: Thursday, 19 March 2020 3:49 AM
To: [email protected]
Subject: I'm trying to connect to a kafka broker running in AWS EKS (from
outside the EKS cluster).
Problem: I'm hitting an error: "no such host" for "
kafka-0.cluster.local:19092".
Has anyone done this before? Any help would be appreciated. Thanks! - Dan
My long-term goal is to get an AWS Lambda to send events to a Kafka running
in AWS EKS.
I used the following instructions
<https://github.com/helm/charts/tree/master/incubator/kafka#connecting-to-kafka-from-outside-kubernetes<https://github.com/helm/charts/tree/master/incubator/kafka#connecting-to-kafka-from-outside-kubernetes>>
(linked to the "outside kubernetes" part) to setup up Kafka using the helm
config. The only modifications are for the "outside kubernetes" part.
<https://github.com/helm/charts/tree/master/incubator/kafka#connecting-to-kafka-from-outside-kubernetes<https://github.com/helm/charts/tree/master/incubator/kafka#connecting-to-kafka-from-outside-kubernetes>>
I've tried a few variations. None of them worked. I still can't connect
to it.
- on an Lambda in the same subnet, on an EC2 machine in the same subnet, on
a
- with a couple different "outside kubernetes" options.
E.g. if I setup external using LoadBalancer, I'll get something an External
IP like (fake)
http://afdsafsafsafdas-13412341.us-east-1.elb.amazon.com:19092<http://afdsafsafsafdas-13412341.us-east-1.elb.amazon.com:19092>.
If I try to run a basic command against this domain, it fails saying there
is no such host for kafka-0.cluster.local:19092.
