Hi, Can you please suggest what port I should use. Metron Documentation says 6667 (For Kafka) I tried both 6667 and 9092 but did not receive data in kafka.
On Fri, Dec 6, 2019 at 9:48 AM Hema malini <[email protected]> wrote: > Hi, > > This issue is basically due to Kafka configuration. Check your listener > port in Kafka configuration .Hope this helps. > > Thanks and Regards, > Hema > > On Fri, 6 Dec, 2019, 10:17 AM Hema malini, <[email protected]> > wrote: > >> Hi, >> >> Please check the listener property.Use the same port while consuming. >> >> Thanks and Regards, >> Hema >> >> On Fri, 6 Dec, 2019, 9:54 AM Farrukh Naveed Anjum, < >> [email protected]> wrote: >> >>> Problem is i am not able to Push data into Kafka.. >>> >>> I have 1 Name Node, 2 Data Node (All have Kafka Broker + Zookeeper). >>> >>> Even with Tools following test fails >>> >>> /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper >>> namenodetest:2181 --replication-factor 1 --partitions 1 --topic t1 >>> >>> /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh >>> --broker-list namenodetest:9092,datanode1:9092,datanode2:9092 --topic t1 >>> >>> /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper >>> namenodetest:2181 --topic t1 >>> >>> >>> >>> I am unable to see the any message transmission between consumer / >>> producer. >>> It keep saying >>> [2019-12-06 09:23:23,030] WARN [Producer clientId=console-producer] >>> Connection to node -2 could not be established. Broker may not be >>> available. (org.apache.kafka.clients.NetworkClient) >>> [2019-12-06 09:23:23,182] WARN [Producer clientId=console-producer] >>> Connection to node -1 could not be established. Broker may not be >>> available. (org.apache.kafka.clients.NetworkClient) >>> [2019-12-06 09:23:23,434] WARN [Producer clientId=console-producer] >>> Connection to node -3 could not be established. Broker may not be >>> available. (org.apache.kafka.clients.NetworkClient) >>> >>> >>> Any suggesion what can I do ? >>> >>> >>> >>> >>> >>> On Thu, Dec 5, 2019 at 10:40 PM Otto Fowler <[email protected]> >>> wrote: >>> >>>> I don’t think we support newer versions of bro yet i.e. zeek. >>>> >>>> >>>> >>>> >>>> On December 5, 2019 at 10:31:12, Farrukh Naveed Anjum ( >>>> [email protected]) wrote: >>>> >>>> Hi, >>>> I am trying to use upgraded version of Bro that is Zeek. I am unable to >>>> receive data into Kafka >>>> >>>> @load packages/metron-bro-plugin-kafka/Apache/Kafka >>>> redef Kafka::logs_to_send = set(SSH::LOG, RDP::LOG, KRB::LOG, SSL::LOG, >>>> DHCP::LOG, Cluster::LOG, Syslog::LOG, SNMP::LOG, Reporter::LOG, DNP3::LOG, >>>> RADIUS::LOG, Tunnel::LOG, Conn::LOG, HTTP::LOG, DNS::LOG, Software::LOG, >>>> Intel::LOG, Notice::LOG, Signatures::LOG); >>>> redef Kafka::send_all_active_logs = T; >>>> redef Kafka::topic_name = "bro"; >>>> redef Kafka::tag_json = T; >>>> redef Kafka::kafka_conf = table( >>>> ["metadata.broker.list"] = "localhost:6667", >>>> ["client.id"] = "bro" >>>> ); >>>> >>>> I have 1 name node, 2 data nodes. Kafa does not seems to be recieving >>>> data from either Zeek or Snort. >>>> It keep sayings broker may not be avalable stuff. Any suggestion ? >>>> >>>> -- >>>> *Best Regards* >>>> Farrukh Naveed Anjum >>>> *M:* +92 321 5083954 (WhatsApp Enabled) >>>> *W:* https://www.farrukh.cc/ >>>> >>>> >>> >>> -- >>> *Best Regards* >>> Farrukh Naveed Anjum >>> *M:* +92 321 5083954 (WhatsApp Enabled) >>> *W:* https://www.farrukh.cc/ >>> >> -- *Best Regards* Farrukh Naveed Anjum *M:* +92 321 5083954 (WhatsApp Enabled) *W:* https://www.farrukh.cc/
