Re: implementing kafka transactions : performance issue

2017-09-19 Thread Hugues . Deslandes
> A : "Users" > Date : 18/09/2017 19:59 > Objet : Re: implementing kafka transactions : performance issue > > Hi Hugues. > > How 'big' are your transactions? In particular, how many produce records > are in a single transaction? Can you share your ac

Re: implementing kafka transactions : performance issue

2017-09-18 Thread Apurva Mehta
Hi Hugues. How 'big' are your transactions? In particular, how many produce records are in a single transaction? Can you share your actual producer code? Also, did you try the `kafka-producer-perf-test.sh` tool with a transactional id and see what the latency is for transactions with that tool?

implementing kafka transactions : performance issue

2017-09-18 Thread Hugues . Deslandes
Hi, I am testing an app with transactions on the producer side of kafka (0.11.0.1) . I defined the producer config (see below) and added the necessary lines in the app (#initTransaction, #begintransaction and #commitTransaction) around the existing #send The problem I am facing is that each t