Confluent replicator keeps restarting consumers

2021-04-09 Thread Alessandro Tagliapietra
Hi everyone, I'm trying to migrate from a cluster to another hosted on confluent cloud, I'm using the trial version or confluent replicator and it seems that it keeps restarting its consumers. I know that the replicator isn't within kafka but I think that the error might just be related to any

Re: Deletion a specific consumer of a consumer group through the Kafka admin client API.

2021-04-09 Thread Sophie Blee-Goldman
Hey Mazen, There is technically an AdminClient API which allows you to remove a single member from the group: Admin.removeMembersFromConsumerGroup(String groupId, RemoveMembersFromConsumerGroupOptions options); but I don't think this will help you. For one thing, this API only works for

Re: Subject: [VOTE] 2.8.0 RC1

2021-04-09 Thread Bill Bejeck
Hi John, Thanks for running the 2.8.0 release! I've started to validate it and noticed the site-docs haven't been installed to https://kafka.apache.org/28/documentation.html yet. Thanks again! -Bill On Tue, Apr 6, 2021 at 5:37 PM John Roesler wrote: > Hello Kafka users, developers and

Re: MirrorMaker 2 with SSL

2021-04-09 Thread Men Lim
Hi Ning, thanks for the response. This self sign cert stays on the ec2 instance, specifically for the curl command and I don't have to share it with the brokers correct? thanks, On Fri, Apr 9, 2021 at 7:55 AM Ning Zhang wrote: > Hi Men, > > I used to deploy MM2 on EC2 with SSL and IIRC,

Re: MirrorMaker 2 with SSL

2021-04-09 Thread Ning Zhang
Hi Men, I used to deploy MM2 on EC2 with SSL and IIRC, probably give a try of self-signing certs and key for testing purpose: https://linuxize.com/post/creating-a-self-signed-ssl-certificate/ On 2021/04/09 03:14:30, Men Lim wrote: > Hi Ryanne, > > thanks for the reply. My kafka clusters

Deletion a specific consumer of a consumer group through the Kafka admin client API.

2021-04-09 Thread Mazen Ezzeddine
Dear all, The kafka admin client API enables the deletion of a consumer group through a logic like the one shown below DeleteConsumerGroupsResult deleteConsumerGroupsResult = adminClient.deleteConsumerGroups(Arrays.asList(consumerGroupToBeDeleted)); However, is there any way/API through

Logic for selection of advertised listener

2021-04-09 Thread Dimos Raptis
Hello, I’ve been trying to understand the logic used to select one of the multiple advertised listeners (advertised.listeners) when connecting to a broker, but I couldn’t find a resource that explains exactly how it works. In terms of inter broker communication, I believe this is done based on

Kafka-connect to Google BigQuery benchmarks

2021-04-09 Thread Mich Talebzadeh
Hi, Has anyone got latency benchmarks using vendors' kafka-connect to Google BigQuery by any chance? I believe there are currently few vendors that provide this connection as a Service in Google Cloud. If not benchmarks, then comments on the degree of performance and recovery would be very

Re: [VOTE] 2.7.1 RC2

2021-04-09 Thread Mickael Maison
Hi, Here is a successful build of 2.7.1 RC2: https://ci-builds.apache.org/job/Kafka/job/kafka-2.7-jdk8/144/ Thanks On Thu, Apr 8, 2021 at 6:27 PM Mickael Maison wrote: > > Hello Kafka users, developers and client-developers, > > This is the third candidate for release of Apache Kafka 2.7.1. >