I have 2 suggestions: 1. After looking at log-pusher, I would suggest a alternative, http://www.rsyslog.com/. It can be configured in the jenkins-slaves. 2. Logstash is good, and I think this video [1] is useful to understand how others are designing log aggregation on top of openstack.
[1]. https://youtu.be/1ye0-sityBw ----- Original Message ----- From: "Tristan Cacqueray" <[email protected]> To: [email protected] Sent: Tuesday, 9 February, 2016 8:23:17 PM Subject: [Softwarefactory-dev] ELK Stack discussion Hello folks, so I've started the process to integrate elasticsearch, logstash and kibana (ELK) in software-factory[0]. Mostly following this cool documentation[1]. Is there a reason why we sticked to java-1.7.0 ? Because it seems like gerrit and jenkins are working fine with 1.8.0 so that doesn't seems a blocker. Beside that, the recommended webserver is nginx... Would it be a problem to run both webserver so that the elk stack is isolated ? Now the interesting part... Logs collection from jenkins seems doable using the logstash plugin, however openstack-infra is using a custom gearman client to plug into zuul server and do the log processing in python after job completion[2]. The plugin looks straightforward and already supported by jjb, but the gearman approach looks much better and may worth the time investment. Kibana looks pretty neat, should we look into that for ci monitoring or is grafana still trendy ? And finally, how should this be deployed... * all services on managesf ? * elasticsearch side by side with mysql ? * completely distributed ? Regards, Tristan [0]: http://softwarefactory-project.io/r/#/c/2814/ [1]: https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-elk-stack-on-centos-7 [2]: http://docs.openstack.org/infra/system-config/logstash.html#log-pusher _______________________________________________ Softwarefactory-dev mailing list [email protected] https://www.redhat.com/mailman/listinfo/softwarefactory-dev _______________________________________________ Softwarefactory-dev mailing list [email protected] https://www.redhat.com/mailman/listinfo/softwarefactory-dev
