Re: [rsyslog] Imkafka/omkafka tuning

2018-01-03 Thread singh.janmejay via rsyslog
The omkafka action worker doesn't perform deliveries. Its responsibility is limited to enqueue and ack-processing. Actual deliveries are done by broker-bound threads and although the design delivers sufficient throughput with small kafka clusters, it chokes on lock contention as broker count goes u

Re: [rsyslog] Imkafka/omkafka tuning

2018-01-03 Thread Andrew Griffin via rsyslog
I use omkafka heavily - the confParam setting is what you’re looking for, basically all of the standard Kafka producer / consumer related parameters are available there. (see https://kafka.apache.org/documentation/#producerconfigs ). Wh

Re: [rsyslog] Imkafka/omkafka tuning

2017-12-23 Thread deoren
On 12/22/2017 9:52 AM, Luigi Tagliamonte via rsyslog wrote: > Hi there! > What are the tunable parameters for this module, like: > - an option to increase the number of threads for kafka processing > - number of messages to process per req. > - etc.. > Regards > L. Module docs: * http://www.rs

[rsyslog] Imkafka/omkafka tuning

2017-12-22 Thread Luigi Tagliamonte via rsyslog
Hi there! What are the tunable parameters for this module, like: - an option to increase the number of threads for kafka processing - number of messages to process per req. - etc.. Regards L. ___ rsyslog mailing list http://lists.adiscon.net/mailman/listi