Which record is processed when topology restart ?

2018-02-05 Thread Saïd Bouras
cers in kafka streams (consumers retry to read the last offset of the internal topic when the topology restart). Is the actual behavior not correct or I am missing something here ? Thanks, regards -- *Saïd Bouras*

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

2018-01-17 Thread Saïd Bouras
>> > >> An initial WIP PR can be found here: > >> https://github.com/apache/kafka/pull/4402 > >> > >> I also included the user-list (please hit "reply-all" to include both > >> lists in this KIP discussion). > >> > >> Thanks a lot. > >> > >> > >> -Matthias > >> > >> > >> Email had 1 attachment: > >> + signature.asc > >> 1k (application/pgp-signature) > > -- *Saïd Bouras*

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

2018-01-15 Thread Saïd Bouras
tart > the discussion early on. > > An initial WIP PR can be found here: > https://github.com/apache/kafka/pull/4402 > > I also included the user-list (please hit "reply-all" to include both > lists in this KIP discussion). > > Thanks a lot. > > > -Ma

Re: Consumer Offsets Being Deleted by Broker

2017-12-10 Thread Saïd Bouras
" related > configurations. > Issue: > Consumer offsets are being deleted and we are not using auto commits at > consumer side. > Is there any configuration we need to add for consumer offset retention ?? > > Please help us. > > > > Thanks, > Musheer > --

Re: Kafka Consumer Committing Offset Even After Re-Assignment

2017-12-08 Thread Saïd Bouras
- After the tasks finish executing, even tho it > longer owns the partition, it is still able to commit the offset > > t4 - Box 2, Consumer 1 - Commits offsets as well, overwriting offset > committed by Box 1, Consumer 1. > > Is this expected? Should I be using the ConsumerRebalance

Re: Kafka Streams app error while rebalancing

2017-12-06 Thread Saïd Bouras
> at > > > org.apache.kafka.clients.consumer.KafkaConsumer.poll( > > KafkaConsumer.java:995) > > > at > > > org.apache.kafka.streams.processor.internals.StreamThread.runLoop( > > StreamThread.java:592) > > > at > > > org.apache.kafka.streams.p

Re: Kafka Performance testing

2017-11-30 Thread Saïd Bouras
t; Could you explain or point me to document it would be great. > Also which performance loading tool would be best to test kafka, I prefer > Jmeter though. > > regards, > -- Saïd BOURAS Consultant Big Data Mobile: 0662988731 Zenika Paris 10 rue de Milan 75009 Paris Standard : +33