I'm using 3 node cluster into AWS MSK. There are two issues, probably related: cluster is very slow, and only one broker is actually processing messages. MSK doesn't provides applevel metrics, just "network packages by broker" per second, which is 350/1/1 per node. Standalone Kafka installation on Linux provides ~ 5 times better performance than MSK cluster... Any ideas how to debug and fix that issue?
Thanks, Vitaly Configuration is default MSK, just increased num.partitions: auto.create.topics.enable=true default.replication.factor=3 min.insync.replicas=2 num.io.threads=8 num.network.threads=5 num.partitions=6 num.replica.fetchers=2 socket.request.max.bytes=104857600 unclean.leader.election.enable=true