Hi
I am trying to read the message with KafkaInput in heka. The config is as
follow: But I can't read all of the message I have sent to kafka cluster.
[NginxNaxsiInput]
type = "KafkaInput"
topic = "op_sec_nginx_ids_test"
group = "op-sec-naxsi-heka"
addrs =
['10.1.24.100:9092','10.1.24.101:9092','10.1.24.102:9092','10.1.24.103:9092','10.1.24.104:9092']
max_open_reqests = 20
When I see the network connect with kafka servers, there is only two
connections.
tcp 0 0 10.8.96.17:26572 10.1.24.104:9092
ESTABLISHED 4778/hekad
tcp 0 0 10.8.96.17:38670 10.1.24.100:9092
ESTABLISHED 4778/hekad
I try with the python kafka client to do the same thing. I can see the five
connections between client and kafka service.
TCP 10.8.97.9:63091 10.1.24.112:9092 ESTABLISHED
TCP 10.8.97.9:63092 10.1.24.113:9092 ESTABLISHED
TCP 10.8.97.9:63093 10.1.24.104:9092 ESTABLISHED
TCP 10.8.97.9:63094 10.1.24.110:9092 ESTABLISHED
TCP 10.8.97.9:63095 10.1.24.111:9092 ESTABLISHED
TCP 10.8.97.9:63096 10.1.24.100:9092 ESTABLISHED
TCP 10.8.97.9:63097 10.1.24.101:9092 ESTABLISHED
TCP 10.8.97.9:63098 10.1.24.102:9092 ESTABLISHED
TCP 10.8.97.9:63099 10.1.24.103:9092 ESTABLISHED
What is wrong in my config? How to read all of the message from kafka with
Kafkainput? Thanks in advance.
_______________________________________________
Heka mailing list
Heka@mozilla.org
https://mail.mozilla.org/listinfo/heka
