Problem is i am not able to Push data into Kafka.. I have 1 Name Node, 2 Data Node (All have Kafka Broker + Zookeeper).
Even with Tools following test fails /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper namenodetest:2181 --replication-factor 1 --partitions 1 --topic t1 /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list namenodetest:9092,datanode1:9092,datanode2:9092 --topic t1 /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper namenodetest:2181 --topic t1 I am unable to see the any message transmission between consumer / producer. It keep saying [2019-12-06 09:23:23,030] WARN [Producer clientId=console-producer] Connection to node -2 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2019-12-06 09:23:23,182] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2019-12-06 09:23:23,434] WARN [Producer clientId=console-producer] Connection to node -3 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) Any suggesion what can I do ? On Thu, Dec 5, 2019 at 10:40 PM Otto Fowler <[email protected]> wrote: > I don’t think we support newer versions of bro yet i.e. zeek. > > > > > On December 5, 2019 at 10:31:12, Farrukh Naveed Anjum ( > [email protected]) wrote: > > Hi, > I am trying to use upgraded version of Bro that is Zeek. I am unable to > receive data into Kafka > > @load packages/metron-bro-plugin-kafka/Apache/Kafka > redef Kafka::logs_to_send = set(SSH::LOG, RDP::LOG, KRB::LOG, SSL::LOG, > DHCP::LOG, Cluster::LOG, Syslog::LOG, SNMP::LOG, Reporter::LOG, DNP3::LOG, > RADIUS::LOG, Tunnel::LOG, Conn::LOG, HTTP::LOG, DNS::LOG, Software::LOG, > Intel::LOG, Notice::LOG, Signatures::LOG); > redef Kafka::send_all_active_logs = T; > redef Kafka::topic_name = "bro"; > redef Kafka::tag_json = T; > redef Kafka::kafka_conf = table( > ["metadata.broker.list"] = "localhost:6667", > ["client.id"] = "bro" > ); > > I have 1 name node, 2 data nodes. Kafa does not seems to be recieving data > from either Zeek or Snort. > It keep sayings broker may not be avalable stuff. Any suggestion ? > > -- > *Best Regards* > Farrukh Naveed Anjum > *M:* +92 321 5083954 (WhatsApp Enabled) > *W:* https://www.farrukh.cc/ > > -- *Best Regards* Farrukh Naveed Anjum *M:* +92 321 5083954 (WhatsApp Enabled) *W:* https://www.farrukh.cc/
