Forest0923 commented on PR #19961: URL: https://github.com/apache/kafka/pull/19961#issuecomment-3046755922
Here is the result of the perf test: | Metric | Trunk (`a3ed705092`) | PR (`0657c7ae40`) | | ---------------------------------------------- | -------------------- | ----------------- | | **Producer throughput**<br>(records/sec) | 143,641.8 | 144,843.6 | | **Producer throughput**<br>(MB/sec) | 140.28 | 141.45 | | **Producer average latency**<br>(ms) | 172.89 | 162.61 | | **Producer max latency**<br>(ms) | 1,677.00 | 1,556.00 | | **Producer 50th percentile latency**<br>(ms) | 183 | 171 | | **Producer 95th percentile latency**<br>(ms) | 232 | 230 | | **Producer 99th percentile latency**<br>(ms) | 340 | 345 | | **Producer 99.9th percentile latency**<br>(ms) | 1,300 | 1,215 | | **Consumer throughput**<br>(messages/sec) | 140,731.7 | 142,076.9 | | **Consumer throughput**<br>(MB/sec) | 137.43 | 138.75 | <details> <summary>Trunk (a3ed705092)</summary> ``` $ bin/kafka-producer-perf-test.sh --topic sandbox --num-records 25000000 --record-size 1024 --throughput -1 --producer-props bootstrap.servers=localhost:9092 116191 records sent, 23224.3 records/sec (22.68 MB/sec), 1054.3 ms avg latency, 1677.0 ms max latency. 521820 records sent, 104364.0 records/sec (101.92 MB/sec), 308.6 ms avg latency, 861.0 ms max latency. 714510 records sent, 142902.0 records/sec (139.55 MB/sec), 187.4 ms avg latency, 264.0 ms max latency. 681195 records sent, 136239.0 records/sec (133.05 MB/sec), 196.0 ms avg latency, 254.0 ms max latency. 688440 records sent, 137688.0 records/sec (134.46 MB/sec), 212.5 ms avg latency, 257.0 ms max latency. 773280 records sent, 154656.0 records/sec (151.03 MB/sec), 113.5 ms avg latency, 246.0 ms max latency. 735525 records sent, 147105.0 records/sec (143.66 MB/sec), 130.4 ms avg latency, 234.0 ms max latency. 749115 records sent, 149823.0 records/sec (146.31 MB/sec), 186.0 ms avg latency, 219.0 ms max latency. 758745 records sent, 151749.0 records/sec (148.19 MB/sec), 166.6 ms avg latency, 230.0 ms max latency. 753510 records sent, 150702.0 records/sec (147.17 MB/sec), 94.6 ms avg latency, 210.0 ms max latency. 719400 records sent, 143880.0 records/sec (140.51 MB/sec), 209.1 ms avg latency, 252.0 ms max latency. 748860 records sent, 149772.0 records/sec (146.26 MB/sec), 171.2 ms avg latency, 249.0 ms max latency. 705780 records sent, 141156.0 records/sec (137.85 MB/sec), 192.1 ms avg latency, 249.0 ms max latency. 776445 records sent, 155289.0 records/sec (151.65 MB/sec), 167.2 ms avg latency, 230.0 ms max latency. 789105 records sent, 157821.0 records/sec (154.12 MB/sec), 107.0 ms avg latency, 173.0 ms max latency. 737700 records sent, 147540.0 records/sec (144.08 MB/sec), 183.8 ms avg latency, 252.0 ms max latency. 729885 records sent, 145977.0 records/sec (142.56 MB/sec), 187.1 ms avg latency, 247.0 ms max latency. 730365 records sent, 146073.0 records/sec (142.65 MB/sec), 201.8 ms avg latency, 238.0 ms max latency. 728310 records sent, 145662.0 records/sec (142.25 MB/sec), 191.7 ms avg latency, 233.0 ms max latency. 752880 records sent, 150576.0 records/sec (147.05 MB/sec), 169.9 ms avg latency, 269.0 ms max latency. 766515 records sent, 153303.0 records/sec (149.71 MB/sec), 177.9 ms avg latency, 223.0 ms max latency. 746940 records sent, 149388.0 records/sec (145.89 MB/sec), 145.4 ms avg latency, 225.0 ms max latency. 754905 records sent, 150981.0 records/sec (147.44 MB/sec), 166.0 ms avg latency, 241.0 ms max latency. 740400 records sent, 148080.0 records/sec (144.61 MB/sec), 187.5 ms avg latency, 245.0 ms max latency. 757800 records sent, 151560.0 records/sec (148.01 MB/sec), 172.3 ms avg latency, 246.0 ms max latency. 758145 records sent, 151629.0 records/sec (148.08 MB/sec), 165.8 ms avg latency, 255.0 ms max latency. 738630 records sent, 147726.0 records/sec (144.26 MB/sec), 77.3 ms avg latency, 189.0 ms max latency. 762570 records sent, 152514.0 records/sec (148.94 MB/sec), 168.8 ms avg latency, 261.0 ms max latency. 773985 records sent, 154797.0 records/sec (151.17 MB/sec), 139.5 ms avg latency, 227.0 ms max latency. 713175 records sent, 142635.0 records/sec (139.29 MB/sec), 177.4 ms avg latency, 261.0 ms max latency. 750780 records sent, 150156.0 records/sec (146.64 MB/sec), 162.7 ms avg latency, 241.0 ms max latency. 751770 records sent, 150354.0 records/sec (146.83 MB/sec), 106.9 ms avg latency, 242.0 ms max latency. 745020 records sent, 149004.0 records/sec (145.51 MB/sec), 196.9 ms avg latency, 250.0 ms max latency. 723870 records sent, 144774.0 records/sec (141.38 MB/sec), 208.1 ms avg latency, 249.0 ms max latency. 25000000 records sent, 143641.8 records/sec (140.28 MB/sec), 172.89 ms avg latency, 1677.00 ms max latency, 183 ms 50th, 232 ms 95th, 340 ms 99th, 1300 ms 99.9th. $ bin/kafka-consumer-perf-test.sh --topic sandbox --messages 25000000 --bootstrap-server localhost:9092 --timeout 500000000 start.time, end.time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec, rebalance.time.ms, fetch.time.ms, fetch.MB.sec, fetch.nMsg.sec 2025-07-08 07:19:04:323, 2025-07-08 07:22:01:966, 24414.0625, 137.4333, 25000000, 140731.6922, 3427, 174216, 140.1367, 143500.0230 ``` </details> <details> <summary>PR (0657c7ae40)</summary> ``` $ bin/kafka-producer-perf-test.sh --topic sandbox --num-records 25000000 --record-size 1024 --throughput -1 --producer-props bootstrap.servers=localhost:9092 116866 records sent, 23373.2 records/sec (22.83 MB/sec), 1072.6 ms avg latency, 1556.0 ms max latency. 488235 records sent, 97647.0 records/sec (95.36 MB/sec), 328.8 ms avg latency, 791.0 ms max latency. 688785 records sent, 137757.0 records/sec (134.53 MB/sec), 219.5 ms avg latency, 302.0 ms max latency. 743235 records sent, 148647.0 records/sec (145.16 MB/sec), 179.4 ms avg latency, 263.0 ms max latency. 743430 records sent, 148686.0 records/sec (145.20 MB/sec), 204.0 ms avg latency, 228.0 ms max latency. 768465 records sent, 153693.0 records/sec (150.09 MB/sec), 157.6 ms avg latency, 213.0 ms max latency. 722580 records sent, 144516.0 records/sec (141.13 MB/sec), 192.8 ms avg latency, 284.0 ms max latency. 741660 records sent, 148332.0 records/sec (144.86 MB/sec), 178.0 ms avg latency, 248.0 ms max latency. 725550 records sent, 145110.0 records/sec (141.71 MB/sec), 188.2 ms avg latency, 243.0 ms max latency. 744300 records sent, 148860.0 records/sec (145.37 MB/sec), 134.0 ms avg latency, 224.0 ms max latency. 803625 records sent, 160725.0 records/sec (156.96 MB/sec), 22.9 ms avg latency, 164.0 ms max latency. 771810 records sent, 154362.0 records/sec (150.74 MB/sec), 61.7 ms avg latency, 168.0 ms max latency. 743160 records sent, 148632.0 records/sec (145.15 MB/sec), 160.6 ms avg latency, 235.0 ms max latency. 760860 records sent, 152172.0 records/sec (148.61 MB/sec), 174.4 ms avg latency, 254.0 ms max latency. 756060 records sent, 151212.0 records/sec (147.67 MB/sec), 101.9 ms avg latency, 212.0 ms max latency. 731730 records sent, 146346.0 records/sec (142.92 MB/sec), 178.6 ms avg latency, 225.0 ms max latency. 748035 records sent, 149607.0 records/sec (146.10 MB/sec), 174.3 ms avg latency, 246.0 ms max latency. 775995 records sent, 155199.0 records/sec (151.56 MB/sec), 126.1 ms avg latency, 211.0 ms max latency. 744525 records sent, 148905.0 records/sec (145.42 MB/sec), 172.6 ms avg latency, 214.0 ms max latency. 736050 records sent, 147210.0 records/sec (143.76 MB/sec), 110.8 ms avg latency, 223.0 ms max latency. 780660 records sent, 156132.0 records/sec (152.47 MB/sec), 148.7 ms avg latency, 202.0 ms max latency. 739290 records sent, 147858.0 records/sec (144.39 MB/sec), 159.6 ms avg latency, 242.0 ms max latency. 766755 records sent, 153351.0 records/sec (149.76 MB/sec), 181.4 ms avg latency, 226.0 ms max latency. 757380 records sent, 151476.0 records/sec (147.93 MB/sec), 177.5 ms avg latency, 227.0 ms max latency. 735285 records sent, 147057.0 records/sec (143.61 MB/sec), 194.1 ms avg latency, 248.0 ms max latency. 751005 records sent, 150201.0 records/sec (146.68 MB/sec), 120.3 ms avg latency, 227.0 ms max latency. 734895 records sent, 146979.0 records/sec (143.53 MB/sec), 199.7 ms avg latency, 266.0 ms max latency. 744480 records sent, 148896.0 records/sec (145.41 MB/sec), 152.3 ms avg latency, 237.0 ms max latency. 760110 records sent, 152022.0 records/sec (148.46 MB/sec), 76.6 ms avg latency, 211.0 ms max latency. 768435 records sent, 153687.0 records/sec (150.08 MB/sec), 177.6 ms avg latency, 238.0 ms max latency. 757635 records sent, 151527.0 records/sec (147.98 MB/sec), 162.1 ms avg latency, 223.0 ms max latency. 750330 records sent, 150066.0 records/sec (146.55 MB/sec), 140.7 ms avg latency, 217.0 ms max latency. 783540 records sent, 156708.0 records/sec (153.04 MB/sec), 139.9 ms avg latency, 215.0 ms max latency. 732015 records sent, 146403.0 records/sec (142.97 MB/sec), 194.6 ms avg latency, 271.0 ms max latency. 25000000 records sent, 144843.6 records/sec (141.45 MB/sec), 162.61 ms avg latency, 1556.00 ms max latency, 171 ms 50th, 230 ms 95th, 345 ms 99th, 1215 ms 99.9th. $ bin/kafka-consumer-perf-test.sh --topic sandbox --messages 25000000 --bootstrap-server localhost:9092 --timeout 500000000 start.time, end.time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec, rebalance.time.ms, fetch.time.ms, fetch.MB.sec, fetch.nMsg.sec 2025-07-08 07:00:20:093, 2025-07-08 07:03:16:054, 24414.0625, 138.7470, 25000000, 142076.9375, 3423, 172538, 141.4996, 144895.6172 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
