Hi All,
I am using filebeat 6.1 and kafka 0.11.0.1 to push logs. From filebeat logs I could see that communication is getting established but then logs are not getting pushed. Also when I updated filebeat's output.kafka.version to 0.11.0.1 I get error message : 2018/02/08 09:41:15.417691 beat.go:635: CRIT Exiting: error initializing publisher: unknown/unsupported kafka version '0.11.0.1' accessing 'output.kafka' (source:'/etc/filebeat/filebeat.yml') Exiting: error initializing publisher: unknown/unsupported kafka version '0.11.0.1' accessing 'output.kafka' (source:'/etc/filebeat/filebeat.yml') So I used kafka 0.10.2.0 and updated filebeat's output.kafka.version to 0.10.2.0 and the error message is gone but I do not get any logs in kafka. Filebeate throws Kafka publish failed with: circuit breaker is open And after some time it throws below message in a loop: 2018/02/09 15:08:13.075932 client.go:234: DBG [kafka] Kafka publish failed with: circuit breaker is open 2018/02/09 15:08:13.110793 client.go:220: DBG [kafka] finished kafka batch 2018/02/09 15:08:13.110814 client.go:234: DBG [kafka] Kafka publish failed with: circuit breaker is open 2018/02/09 15:08:13.149482 metrics.go:39: INFO Non-zero metrics in the last 30s: beat.info.uptime.ms=30000 beat.memstats.gc_next=18583840 beat.memstats.memory_alloc=17667464 beat.memstats.memory_total=3883962925856 filebeat.harvester.open_files=11 filebeat.harvester.running=10 libbeat.config.module.running=0 libbeat.output.events.batches=832 libbeat.output.events.failed=1703936 libbeat.output.events.total=1703936 libbeat.pipeline.clients=2 libbeat.pipeline.events.active=4118 libbeat.pipeline.events.retry=1703936 registrar.states.current=21 Please tell me how to debug this. I am using logstash 6.1 as consumer. -- Thanks http://www.oracle.com/ Sandeep Sarkar | Member of Technical Staff Phone: HYPERLINK "tel:+918067445685"+918067445685 Oracle CGBU PM&C Oracle India Bangalore http://www.oracle.com/commitment Oracle is committed to developing practices and products that help protect the environment
