Re: Consumer reconsuming all kafka messages

I have question , if my service went down and i want to consume back whichever was not consumed from a given consumer group , how to handle that ? its either earliest or latest message , how about consuming all un-commited messages ? Keep learning keep moving . On Wed, Aug 23, 2017 at

exception in multi threaded env for manual topic assignment

Hi , I am getting below exception while reading topic partitions individual. Exception: Subscription to topics, partitions and pattern are mutually exclusivejava.lang.IllegalStateException I am passing new KafkaConsumer for each thread and topic's partition number and same consumer group for

kafka zookeeper integration with storm

Hey guys , I am unable to use kafka zookeeper with strom integration. I am passing kafka bin dir location in zookeeper root for storm but its throwing error. Keep learning keep moving .

Re: how to listen each partition with separate threads ?

tth...@confluent.io> wrote: > You need to create a KafkaConsumer per thread. > > -Matthias > > On 3/30/17 10:51 PM, Laxmi Narayan wrote: > > Hi , > > > > I was thinking to listen each partition with separate thre

how to listen each partition with separate threads ?

Hi , I was thinking to listen each partition with separate thread in Kafka. But i get error saying : *org.apache.kafka.clients.consumer.KafkaConsumer@383ad023KafkaConsumer is not safe for multi-threaded accessSubscription to topics, partitions and pattern are mutually exclusive.*​ Is there

kafka not throwing any exception not any response in call back

Hi , I am using kafka 10.2 and sometime my producer does not sends me any ACK and in that case data is also not pushed. Whenever I get ACK I am able to consume data. But this is happening quiet often with me and i have no clue why data is not being pushed inside and my request ends gracefully

kafka is not accepting number of partitions from configuration

​Hi , Kafka not accepting number of partitions from config , while from CLI it is accepting. What am I missing here ? props.put("bootstrap.servers", kafkaConstants.Bootstrap_Servers); props.put("enable.auto.commit", kafkaConstants.Enable_Auto_Commit);

how to get parallel processing with kafka and akka

Hi, Kafka has partitions and akka can do parallel processing. I have one perfect use-case where I have to read data in parallel. But seems like partitions does not give me any extra info other than partition number and how do i make sure that data_x should always go to x-partition next time and

even if i pass key no change in partition

org.apache.kafka.common.serialization.StringSerializer"); props.put("value.serializer", "org.apache.kafka.common.serialization.StringSerializer"); props.put("partitioner.class", "org.apache.kafka.clients.producer.internals.DefaultPartitioner"); *This is my output : * ConsumerRecord(topic

special characters in kafka log

Hi , Have anybody tested spcl char inside kafka ? I am little worried about serialization and de-serialization of special characters. *​* *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473*

min hardware requirement

. *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473*

Re: Error while fetching metadata only for one specific topic

,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473* On Mon, Jan 16, 2017 at 12:31 PM, Laxmi Narayan NIT DGP < nit.dgp...@gmail.com> wrote: > Hi , > > I am getting below error . > > WARN Error while fetching metadata with correlation

Error while fetching metadata only for one specific topic

Hi , I am getting below error . WARN Error while fetching metadata with correlation id 1 : {DeviceData=LEADER_NOT_AVAILABLE} (org.apache.kafka.clients.NetworkClient) *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473*

how to manage if zookeeper goes down

Hi, I have understood that zookeeper is responsible for runing kafka in cluster mode. But how do we ensure that zookeeper never goes down? *​​* *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473*

Re: can i delete topic like this ?

Hi , If my topic is not enabled for deletion any other way to purge message from topic ? *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473* On Fri, Jan 13, 2017 at 12:16 AM, Kaufman Ng <kauf...@confluent.io> wrote: > Your zookeeper ur

can i delete topic like this ?

mand$.main(TopicCommand.scala:53) at kafka.admin.TopicCommand.main(TopicCommand.scala) ** *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473*

Re: adding more partition

where does kafka runs RAM or SSD ? My question how to delete message frm Kafka topics. Is message expire is only way ? *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473* On Tue, Jan 3, 2017 at 12:46 PM, Kunal Gupta <kunal.gu...@cube26.

Re: adding more partition

? Que2: If I have 2 consumer group reading from 1-Topic If I enable auto commit true in consumer , will same message will be read twice ? and If I set auto-commit true will message will be deleted ? *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473

adding more partition

Hi, Does adding more partitions to kafka will help in scaling ? *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473*