Hi everyone, I ran several performance test below and the overall throughput looks good, but I don't understand why it shows huge latency (about 2 seconds). Could you please explain what that latency means ? It can't be the latency between records or batches. What it is then ?
kafka-producer-perf-test.sh --producer-props bootstrap.servers=server1:9095 --producer.config kafka/client/consumer.properties --topic TopicC3part --throughput -1 --record-size 1000 --num-records 1000000 --print-metrics 53137 records sent, 10625.3 records/sec (10.13 MB/sec), 1501.9 ms avg latency, 2384.0 ms max latency. 87152 records sent, 17430.4 records/sec (16.62 MB/sec), 1908.7 ms avg latency, 2365.0 ms max latency. 75728 records sent, 15142.6 records/sec (14.44 MB/sec), 2120.1 ms avg latency, 2878.0 ms max latency. 78736 records sent, 15747.2 records/sec (15.02 MB/sec), 2064.6 ms avg latency, 2826.0 ms max latency. 94688 records sent, 18933.8 records/sec (18.06 MB/sec), 1717.0 ms avg latency, 2792.0 ms max latency. 84757 records sent, 16951.4 records/sec (16.17 MB/sec), 1887.1 ms avg latency, 2941.0 ms max latency. 70871 records sent, 14174.2 records/sec (13.52 MB/sec), 2334.6 ms avg latency, 2783.0 ms max latency. 67582 records sent, 13513.7 records/sec (12.89 MB/sec), 2365.0 ms avg latency, 2807.0 ms max latency. 68025 records sent, 13605.0 records/sec (12.97 MB/sec), 2465.0 ms avg latency, 3028.0 ms max latency. 72987 records sent, 14594.5 records/sec (13.92 MB/sec), 2282.5 ms avg latency, 2657.0 ms max latency. 73492 records sent, 14695.5 records/sec (14.01 MB/sec), 2234.3 ms avg latency, 2521.0 ms max latency. 73798 records sent, 14759.6 records/sec (14.08 MB/sec), 2213.1 ms avg latency, 2695.0 ms max latency. 74474 records sent, 14894.8 records/sec (14.20 MB/sec), 2213.8 ms avg latency, 2446.0 ms max latency. 1000000 records sent, 15003.976054 records/sec (14.31 MB/sec), 2098.53 ms avg latency, 3028.00 ms max latency, 2371 ms 50th, 2788 ms 95th, 2949 ms 99th, 3014 ms 99.9th. Best regards, Evgeny ________________________________ This email message (and any attachments) is confidential and may be privileged or otherwise protected from disclosure by applicable law. If you are not the intended recipient or have received this in error please notify the system manager, postmas...@vtbcapital.ru and remove this message and any attachments from your system. Any unauthorized dissemination, copying or other use of this message and/or any attachments is strictly prohibited and may constitute a breach of civil or criminal law. JSC VTB Capital may monitor email traffic data and also the content of email.
