Consume data-skewed partitions using Kafka-streams causes consumer load balancing issue.

2022-07-07 Thread ankit Soni
Hello kafka-users, I have 50 topics, each with 32 partitions where data is being ingested continuously. Data is being published in these 50 partitions externally (no control) which causes data skew amount the partitions of each topic. For example: For topic-1, partition-1 contains 100 events, wh

Inquiry about using SSL encryption and SASL authentication for Kafka without specifying IP address in SAN in the CA certificate

2022-07-07 Thread Deepak Jain
Hi Luke, We are using Kafka 2.8.1 Broker/Client system in our prod environment with SASL_SSL communication between Kafka Clients and Broker. We are using the IP for the property “bootstrap.servers” while initiating the KafkaConsumer. Due to some reason, one of our Customer is unable to use the

Clarification Kafka - MySQL

2022-07-07 Thread Alalasundaram Saravanan
Dear Team, We wanted to use kafka and therefore installed on ubuntu ( Ubuntu 20.04.4 LTS ) kafka ( 3.2.0  & zoopkeeper 3.6.3--6401e4ad2087061bc6b9f80dec2d69f2e3c8660a) . With this installation, we wanted to connect to mysql server installed on the same  server. Is it possible? If so what