We have spark kafka sreaming job running on standalone spark cluster. We have below kafka architecture
1. Two cluster running on two data centers. 2. There is LTM on top on each data center (load balance) 3. There is GSLB on top of LTM. I observed when ever any of the node in kafka cluster is down our spark stream job stopped. We are using GLSB url in our code to connect to Kafka not the IP address. Please let me know is it expected behavior if not then what config we need to change. Thanks Amit