Hi Kafka Experts I recently worked on kafka perf test, my kafka active/standby clusters and mirrormake2 are all built with sasl-ssl, kafka-producer-perf-test.sh setup with sasl-ssl too. I use kafka default settings, say, message.max.size, batch size...no changes...
Test result shows active kafka cluster(5 brokers(cpu 16GHZ memory 32GB) located in Santa Clara) throughout is ~65MB/s for 1million records each on 10KB size, is it looks normal? However, the mirror-make2 is slow for mirroring message from active cluster to standby one(standby cluster located in another city named Wenatchee), it took 10minutes for mirror-maker2 to finish all records mirroring...so this looks not normal, so my questions are: do we have docs to tune kafka performance with sasl-ssl enabled, also do we have docs to tune kafka mirror-maker2 with sasl-ssl enabled? thanks. orker@devks-ca-dev:~/kafka$ ./kafka_2.13-3.2.0/bin/kafka-producer-perf-test.sh --topic vks-perf-tst-10240-mirror --throughput -1 --num-records 1000000 --record-size 10240 --producer-props acks=all --producer.config ./perf-test.properties 31480 records sent, 6296.0 records/sec (61.48 MB/sec), 217.0 ms avg latency, 666.0 ms max latency. 34315 records sent, 6863.0 records/sec (67.02 MB/sec), 285.4 ms avg latency, 909.0 ms max latency. 33878 records sent, 6775.6 records/sec (66.17 MB/sec), 300.8 ms avg latency, 1238.0 ms max latency. 34549 records sent, 6909.8 records/sec (67.48 MB/sec), 294.6 ms avg latency, 1119.0 ms max latency. 34386 records sent, 6877.2 records/sec (67.16 MB/sec), 298.0 ms avg latency, 1084.0 ms max latency. 33708 records sent, 6741.6 records/sec (65.84 MB/sec), 310.8 ms avg latency, 1039.0 ms max latency. 35489 records sent, 7097.8 records/sec (69.31 MB/sec), 284.0 ms avg latency, 834.0 ms max latency. 22823 records sent, 4564.6 records/sec (44.58 MB/sec), 386.2 ms avg latency, 2061.0 ms max latency. 14733 records sent, 2946.6 records/sec (28.78 MB/sec), 788.3 ms avg latency, 4592.0 ms max latency. 36586 records sent, 7317.2 records/sec (71.46 MB/sec), 276.0 ms avg latency, 1095.0 ms max latency. 36567 records sent, 7313.4 records/sec (71.42 MB/sec), 277.3 ms avg latency, 1131.0 ms max latency. 35723 records sent, 7144.6 records/sec (69.77 MB/sec), 291.7 ms avg latency, 1103.0 ms max latency. 35567 records sent, 7113.4 records/sec (69.47 MB/sec), 286.6 ms avg latency, 863.0 ms max latency. 34606 records sent, 6921.2 records/sec (67.59 MB/sec), 296.0 ms avg latency, 1014.0 ms max latency. 31265 records sent, 6253.0 records/sec (61.06 MB/sec), 325.6 ms avg latency, 1254.0 ms max latency. 32985 records sent, 6585.1 records/sec (64.31 MB/sec), 312.3 ms avg latency, 1198.0 ms max latency. 33024 records sent, 6604.8 records/sec (64.50 MB/sec), 310.9 ms avg latency, 1106.0 ms max latency. 36564 records sent, 7312.8 records/sec (71.41 MB/sec), 274.9 ms avg latency, 854.0 ms max latency. 34587 records sent, 6917.4 records/sec (67.55 MB/sec), 289.8 ms avg latency, 1351.0 ms max latency. 35665 records sent, 7133.0 records/sec (69.66 MB/sec), 283.9 ms avg latency, 1124.0 ms max latency. 35486 records sent, 7097.2 records/sec (69.31 MB/sec), 293.5 ms avg latency, 1157.0 ms max latency. 34965 records sent, 6993.0 records/sec (68.29 MB/sec), 291.4 ms avg latency, 1152.0 ms max latency. 30519 records sent, 6103.8 records/sec (59.61 MB/sec), 326.1 ms avg latency, 1318.0 ms max latency. 34269 records sent, 6853.8 records/sec (66.93 MB/sec), 312.0 ms avg latency, 1346.0 ms max latency. 37176 records sent, 7435.2 records/sec (72.61 MB/sec), 270.6 ms avg latency, 986.0 ms max latency. 35495 records sent, 7099.0 records/sec (69.33 MB/sec), 287.2 ms avg latency, 1084.0 ms max latency. 36220 records sent, 7244.0 records/sec (70.74 MB/sec), 281.1 ms avg latency, 1057.0 ms max latency. 35634 records sent, 7126.8 records/sec (69.60 MB/sec), 286.0 ms avg latency, 1005.0 ms max latency. 35453 records sent, 7090.6 records/sec (69.24 MB/sec), 290.0 ms avg latency, 985.0 ms max latency. 1000000 records sent, 6710.913959 records/sec (65.54 MB/sec), 300.38 ms avg latency, 4592.00 ms max latency, 134 ms 50th, 966 ms 95th, 1112 ms 99th, 3323 ms 99.9th. worker@devks-ca-dev:~/kafka$
