Re: Issue with kafka connect custom name strategy

2020-01-06 Thread Alessandro Tagliapietra
I was able to make some progress, setting CONNECT_VALUE_CONVERTER_KEY_SUBJECT_NAME_STRATEGY and CONNECT_VALUE_CONVERTER_VALUE_SUBJECT_NAME_STRATEGY env variables fixed the issue. However this makes it impossible to have a custom name strategy per connector, just to sum up: - setting the value con

Issue with kafka connect custom name strategy

2020-01-06 Thread Alessandro Tagliapietra
Hello everyone, I'm trying to run kafka connect to dump avro messages to S3, I'm having issues with the value converter. Our topics have a string key and an avro value. I'm running the docker image confluentinc/cp-kafka-connect:5.3.2 with the following env variables regarding value converter: CO

Re: High CPU Usage on Brokers

2020-01-06 Thread Navneeth Krishnan
Hi, Thanks for the response. We were using version 0.11 previously and all our producers/consumers have been upgraded to either 1.0 or to the latest 2.3. Is it normal for the network thread to consume more cpu? If you look at it, the network thread consumes 50% of the overall cpu. Regards On Mo

Re: High CPU Usage on Brokers

2020-01-06 Thread Thunder Stumpges
Not sure what version your producers/consumers are, or if you upgraded from a previous version that used to work, or what, but maybe you're hitting this? https://kafka.apache.org/23/documentation.html#upgrade_10_performance_impact On Mon, Jan 6, 2020 at 12:48 PM Navneeth Krishnan wrote: > Hi

Running any kafka acl commands fails

2020-01-06 Thread khoi dinh
I am trying to run any kafka acl commands from adding, deleting, and list. An example command is: ../bin/kafka-acls.sh --authorizer-properties zookeeper.connect=localhost:2181 --add --allow-principal User:demouser --operation Create --operation Describe --topic demo-topic But I always get the

Re: High CPU Usage on Brokers

2020-01-06 Thread Navneeth Krishnan
Hi All, Any idea on what can be done? Not sure if we are running into this below bug. https://issues.apache.org/jira/browse/KAFKA-7925 Thanks On Thu, Jan 2, 2020 at 4:18 PM Navneeth Krishnan wrote: > Hi All, > > We have a kafka cluster with 12 nodes and we are pretty much seeing 90% > cpu usa

Re: Kafka 2.4.0 & Mirror Maker 2.0 Error

2020-01-06 Thread Ryanne Dolan
I just downloaded the 2.4.0 release tarball and didn't run into any issues. Peter, Jamie, can one of you file a jira ticket if you are still seeing this? Thanks! Ryanne On Fri, Dec 27, 2019 at 12:04 PM Ryanne Dolan wrote: > Thanks Peter, I'll take a look. > > Ryanne > > On Fri, Dec 27, 2019, 7:

Re: Kafka trunk vs master branch

2020-01-06 Thread Matthias J. Sax
Thanks for the feedback. I just deleted the `master` branch on GitHub. -Matthias On 12/30/19 3:47 PM, Colin McCabe wrote: > +1. > > Colin > > On Fri, Dec 27, 2019 at 12:29 PM Guozhang Wang > wrote: > > Hmm, I think that's pushed by someone by mistake, we ca

Re: StateStore extends UnicastRemoteObject

2020-01-06 Thread Bruno Cadonna
Hi Michelle, Are you sure you do not pass a null instead of your custom store to your topology by mistake? How does the implementation of the `build()` method of your `MyCustomStoreBuilder` look like? Best, Bruno On Mon, Dec 30, 2019 at 12:06 AM Michelle Francois wrote: > > Hello, > I want to h