Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

Though there was no LockException in your log, there is still enough similarity between your log and the one posted by johnchou: https://issues.apache.org/jira/browse/KAFKA-5397?focusedCommentId=16162689=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16162689 Even the

Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

Hi All , @Bill, I will reduce the MAX_POLL_RECORDS to 500/1000 and I will share the results shortly. @Ted, Yes I reduced MAX_POLL_RECORDS_CONFIG from 5 to 5000 . It was not a typo . Do you think 5 is way too high for an kafkaStreams Application ? My Spark application which I was

Re: Classloading Error with Kotlin and Streams

Hi Avi, Were you able to resolve above? On Tue, Sep 12, 2017 at 12:45 AM, Avi Flax wrote: > > > On Sep 11, 2017, at 14:31, Bill Bejeck wrote: > > > > I've done a little digging. Unfortunately, I don't have any answers at > this point. > > > > ... >

Re: performance test using real data - comparing throughput & latency

When building these kinds of tests I always just orchestrated my producers and consumers to spit metrics out somewhere easy to collect. Never looked for a ui/tool to do it before. Assuming good NTP configs (sub ms accuracy), I would typically put timing data into the key portion of the messages

Start up All Consumers at Once

Hello! I am running into an issue when I start up Kafka. I am using Kafka 0.9.0.1. The problem I am seeing is exactly as described in KIP-134 ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-134%3A+Delay+initial+consumer+group+rebalance), but unfortunately I am stuck on 0.9.0.1. Is there a

Re: performance test using real data - comparing throughput & latency

Look,. I'm a huge fan of sending identical data and using plane old 'wall time' and averaging a couple runs to make sure you remove any whoops. You can use fancy tools for reporting but in the real world wall time still is the most critical factor. And let's face it it's also simple to measure.

Re: Reliably producing records to remote cluster: what are my options?

I tried to write down the pros and cons of each approach to the best of my current knowledge. Feel free to correct me or comment on the various approaches. So far I still have no clear winner for my use case. Basic challenges: a) network outage A network outage between the application

Re: Kafka InvalidStateStoreException

Hi, in case of a rebalance, partitions are reassigned and thus (shards) of a store might move from one instance/thread to another. This could potentially happen anytime, and you need to rediscover the shard/store afterwards. Thus, your code must catch this exception and you can retry the query

Kafka 0.11 broker running out of file descriptors

Hello, I'm dealing with a strange issue in production and I'm running out of options what to do about it. It's a 3 node cluster running Kafka 0.11.0.1 with most topics having replication factor of 2. At some point, the broker that is about do die shrinks ISR for a few partitions just to itself:

Kafka 0.11 broker running out of file descriptors

Hello, I'm dealing with a strange issue in production and I'm running out of options what to do about it. It's a 3 node cluster running Kafka 0.11.0.1 with most topics having replication factor of 2. At some point, the broker that is about do die shrinks ISR for a few partitions just to itself:

Kafka Producer Metrics strange values

Hi guys, We have a 3 producers producing for a kafka topic with 3 partitions. We have a scheme were each producer, produces for one partition. All producers connect to all partitions but we ensure that each producer only sends messages for one partition. The odd thing is that when looking to

Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

Hi Damian, I haven't explicitly configured any configuration related to threads. All the instances are running with the same configuration. I will share the logs you asked for from both running instance and the other instance shortly. Thanks Dev On Fri, Sep 15, 2017 at 3:42 PM, Damian Guy

Re: Kafka InvalidStateStoreException

Hello, Here is the code snipplet. 145 146public ReadOnlyKeyValueStore getQuotaStore() { 147return this.runner.streams.store("quota-table", QueryableStoreTypes.keyValueStore()); 148} 149 Thanks, Jari On 15.09.2017 12:30, Ted Yu wrote: bq. at

Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

Grepping for StreamThread would be useful, though some logs will be over multiple lines. We need to see which partitions have been assigned to the other instances/threads, it will look something like: 2017-09-14 10:04:22 INFO StreamThread:160 - stream-thread

Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

Dear Kafka Users, I have updated the question in stackoverlflow . Please let me know about any possible solution. https://stackoverflow.com/questions/46233138/kafka-streams-application-unable-to-horizontally-scale-and-the-application-on-ot On Fri, Sep 15, 2017 at 2:57 PM, dev loper

Re: Kafka InvalidStateStoreException

bq. at com.mytest.csd.kafka.KafkaDeduplicator.getQuotaStore(KafkaDe duplicator.java:147) Can you show us relevant code snippet for the above method ? On Fri, Sep 15, 2017 at 2:20 AM, Jari Väimölä wrote: > Hello all, > I have an apache kafka stream application running

Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

Hi Damian, I do have the logs for the other application. But its kind of huge since it is continuously processing . Do you want me to grep anything specific and share it with you ? Thanks Dev On Fri, Sep 15, 2017 at 2:31 PM, Damian Guy wrote: > Hi, > > Do you have the

Kafka InvalidStateStoreException

Hello all, I have an apache kafka stream application running in docker container. It writes to three output topics. In my environment there are two brokers and one zookeeper, all running on different hosts. After starting my stream application following error logs are printed: INFO

Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

Hi, Do you have the logs for the other instance? Thanks, Damian On Fri, 15 Sep 2017 at 07:19 dev loper wrote: > Dear Kafka Users, > > I am fairly new to Kafka Streams . I have deployed two instances of Kafka > 0.11 brokers on AWS M3.Xlarge insatnces. I have created a topic