Re: Unable to reset kafka offset in a consumer group

forward by an increment of 1 just for this topic? kafka-consumer-groups.sh script has an option `--shift-by` to shift current offset by 'n'. I think this is what you are looking for. Thank you Luke On Thu, Aug 25, 2022 at 4:25 PM Chris Peart wrote: Hi All, I'm trying to reset

Re: Unable to reset kafka offset in a consumer group

ement of 1 just for > > this topic? > > kafka-consumer-groups.sh script has an option `--shift-by` to shift > current > > offset by 'n'. > > I think this is what you are looking for. > > > > Thank you > > Luke > > > > On Thu, Aug 25, 202

Re: Unable to reset kafka offset in a consumer group

t wrote: > >> >> >> Hi All, >> >> I'm trying to reset a kafka offset for a topic in a consumer group, i >> have stopped all the consumers using the consumer group but i'm still >> receiving the message that the current state is stable. >

Re: Unable to reset kafka offset in a consumer group

Peart wrote: > > > Hi All, > > I'm trying to reset a kafka offset for a topic in a consumer group, i > have stopped all the consumers using the consumer group but i'm still > receiving the message that the current state is stable. > > Is there a way to

Unable to reset kafka offset in a consumer group

Hi All, I'm trying to reset a kafka offset for a topic in a consumer group, i have stopped all the consumers using the consumer group but i'm still receiving the message that the current state is stable. Is there a way to put the consumer group to an inactive state after stoppi

kafka offset disappear

Hi guys, Version: Kafka_2.11-1.10 my Kafka consumer offset was disappeared, in ‘__consumer_offset’, that topic’s message is empty. the consumer hasn’t commit at least 15 days, i think the configuration ‘offsets.retention.minutes’ effects i want to test this, i set offsets.retention.minut

Kafka offset is discontinuous

Hello, Is there congiurations to make kafka offset continuous? Help us !!! Spark cannot skip the gap offset. | | 13729560619 | | 邮箱：13729560...@163.com | 签名由 网易邮箱大师 定制

Re : R: Kafka offset problem when using Spark Streaming...

Envoyé depuis Gmail - Reply message - De : "Pena Quijada Alexander" Pour : "users@kafka.apache.org" Objet : R: Kafka offset problem when using Spark Streaming... Date : dim., mai 13, 2018 19:54 Hi all, sorry for delay answer, I was a bit busy in the last few d

R: Kafka offset problem when using Spark Streaming...

u Inviato: mercoledì 9 maggio 2018 17:58 A: users@kafka.apache.org Oggetto: Re: Kafka offset problem when using Spark Streaming... Can you give us more information: release of Spark and Kafka you're using anything interesting from broker / client logs - feel free to use pastebin to pass sn

Re: Kafka offset problem when using Spark Streaming...

Can you give us more information: release of Spark and Kafka you're using anything interesting from broker / client logs - feel free to use pastebin to pass snippet if needed Thanks On Wed, May 9, 2018 at 3:42 AM, Pena Quijada Alexander < a.penaquij...@reply.it> wrote: > Hi all, > > We're faci

Re: Kafka offset problem when using Spark Streaming...

Hard to say. Might be a Spark issue though... On 5/9/18 3:42 AM, Pena Quijada Alexander wrote: > Hi all, > > We're facing some problems with ours Spark Streaming jobs, from yesterday we > have got the following error into our logs when the jobs fail: > > java.lang.AssertionError: assertion fail

Kafka offset problem when using Spark Streaming...

Hi all, We're facing some problems with ours Spark Streaming jobs, from yesterday we have got the following error into our logs when the jobs fail: java.lang.AssertionError: assertion failed: Beginning offset 562747 is after the ending offset 562743 for topic elk-topic partition 0. Any help ab

Re: kafka offset replication factor - Any suggestion will be appreciated.

Sent: Thursday, March 22, 2018 11:53 AM To: users@kafka.apache.org Subject: RE: kafka offset replication factor - Any suggestion will be appreciated. Are you sure on which kafka cluster & zookeeper cluster you have launched "describe" command ? Because you first log trace is &

RE: kafka offset replication factor - Any suggestion will be appreciated.

di 22 mars 2018 16:39:51 À : users@kafka.apache.org Objet : RE: kafka offset replication factor - Any suggestion will be appreciated. I checked already. Topic is having replication factor as 1 only. [kfk01]$ bin/kafka-topics.sh --describe --zookeeper localhost:2181 --topic test Topic:test Partition

RE: kafka offset replication factor - Any suggestion will be appreciated.

...@hotmail.fr] Sent: Thursday, March 22, 2018 2:28 AM To: users@kafka.apache.org Subject: RE: kafka offset replication factor - Any suggestion will be appreciated. EXTERNAL EMAIL Hi, have you check if you have already not created a old topic with this replication factor '3' ? You can check it

RE: kafka offset replication factor - Any suggestion will be appreciated.

ercredi 21 mars 2018 22:25:16 À : users@kafka.apache.org Objet : kafka offset replication factor - Any suggestion will be appreciated. Hi , I am getting an issue while producing and consuming messages. I have just one kafka broker and one zookeeper. So I have given replication factor of all topi

kafka offset replication factor - Any suggestion will be appreciated.

Hi , I am getting an issue while producing and consuming messages. I have just one kafka broker and one zookeeper. So I have given replication factor of all topics as 1. I don't know from where is it trying to get replication factor as 3. In my server.properties file I have already defined -:

Re: Kafka offset being reset

Hi Vishnu, I'd suggest you take a look at the broker configuration value "offsets.retention.minutes". The consumer offsets are stored in the __consumer_offsets topic. __consumer_offsets is a compacted topic (cleanup.policy=compact), where the key is the combination of the consumer group, the top

Re: Kafka offset being reset

What version of Kafka are you running? From: Vishnu Gopal Sent: Monday, February 27, 2017 5:50:06 PM To: users@kafka.apache.org Subject: Kafka offset being reset Team, I came across an issue where the offset positing is being reset and the consumer app is

Kafka offset being reset

Team, I came across an issue where the offset positing is being reset and the consumer app is receiving the same message in the same offset repeatedly. this is happing every 3 or 4 days apart. I have purged the topic for now and re-started the app. but can any body give me a direction on how t

Kafka offset monitoring sounds not support `kafka 0.10.1.0`.

Hi, I am trying to use KafkaOffsetMonitor to monitor kakfa consumer Lag, but I can not see any consumer offset information. so I doubt there may be `KafkaOffsetMonitor` not support `kafka 0.10.1.0`, is anyone running into the issue I am encounter

Re: Kafka offset

Thank  you  for  clear  explanation. Sent from Samsung Mobile. Original message From: "Matthias J. Sax" Date:24/08/2016 01:40 (GMT+05:30) To: users@kafka.apache.org Cc: Subject: Re: Kafka offset auto.offset.reset does only trigger if there is no (valid) commit

Re: Kafka offset

auto.offset.reset does only trigger if there is no (valid) committed offset found. Ie, on Consumer startup, the following happens: * look for committed offset - if offset is found and offset is valid, resume from there - if not offset is found (or offset in invalid) reset offset accor

Kafka offset

Hi   Does  fromOffset reset to zero when  auto.offset.reset is smallest? Or Is it depends  on auto commit  interval  when  not  explicitly  committing via application? Sent from Samsung Mobile.

Re: Kafka offset out of range using SimpleConsumer Example

#1 turned out to be invalid, my logging was simply bad (I was logging the number of messages I'd read so far for that partition, not the requested read offset) #2 is still valid, though. I'm thinking that a possible explanation might be that the part of the log I was processing was deleted, but I

Kafka offset out of range using SimpleConsumer Example

Hello, I've implemented something quite similar to the SimpleConsumer example on https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example I'm using it to traverse a specific range of offsets. I find that sometimes, in the middle of this traversal, I end up hitting an "Offse

Re: Kafka - offset preservation

Which version is this? I am a new user myself, are you using the same consumer group name? In V0.9, once connected, broker stores consumer offsets per consumer group, and continues from where it left off, the earliest/latest are for the first time only. On Wed, Jul 6, 2016 at 6:19 AM, Pawel Huszcz

Kafka - offset preservation

Hello, I tried every different property I can think of - I have set ConsumerConfig.ENABLE_AUTO_COMMIT_CONFIG = true; ConsumerConfig.AUTO_COMMIT_INTERVAL_MS_CONFIG = 1000, but I have also tried with many different values And still every time I start my consumer - I am receiving all the messages

Kafka offset moved back on rebalance

Hi, I have the 3 consumers subscribing from a single topic with the following settings. auto.commit.interval.ms = 1000 enable.auto.commit = true request.timeout.ms = 6 session.timeout.ms = 59000 heartbeat.interval.ms = 4000 Version 0.9.0. The consumers looks like this: whi

Kafka offset moved back on rebalance

Hi, I have the 3 consumers subscribing from a single topic with the following settings. auto.commit.interval.ms = 1000 enable.auto.commit = true request.timeout.ms = 6 session.timeout.ms = 59000 heartbeat.interval.ms = 4000 Version 0.9.0. The consumers looks like this: whi

Re: Kafka offset moved back on rebalance

Hi, The offsets could belong to different partitions of the same topic. Each partition has its own offset. Try logging *record.partition()*. Regards, Daniel. On Thu, Mar 17, 2016 at 1:58 PM, Erik Pettersson wrote: > Hi, > > I have the 3 consumers subscribing from a single topic with the foll

Re: Can't save Kafka offset in Zookeeper

ana > > > > On Tue, Jan 19, 2016 at 12:03 AM, Krzysztof Zarzycki < > k.zarzy...@gmail.com > > > > > wrote: > > > > > Hi Kafka users, > > > I have an issue with saving Kafka offsets to Zookeeper through > > > OffsetCommitRequest. It

Re: Can't save Kafka offset in Zookeeper

wrote: > > > Hi Kafka users, > > I have an issue with saving Kafka offsets to Zookeeper through > > OffsetCommitRequest. It's the same issue I found unanswered on SO, so I > > kindly borrow the description: > > > > > http://stackoverflow.com/questi

Re: Can't save Kafka offset in Zookeeper

keeper through > OffsetCommitRequest. It's the same issue I found unanswered on SO, so I > kindly borrow the description: > > http://stackoverflow.com/questions/33897683/cant-save-kafka-offset-in-zookeeper > > "I've installed Zookeeper and Kafka from Ambari, o

Can't save Kafka offset in Zookeeper

Hi Kafka users, I have an issue with saving Kafka offsets to Zookeeper through OffsetCommitRequest. It's the same issue I found unanswered on SO, so I kindly borrow the description: http://stackoverflow.com/questions/33897683/cant-save-kafka-offset-in-zookeeper "I've installed Zook

Re: how to reset kafka offset in zookeeper

t; wrote: >>>>>>> >>>>>>>> You can also do this: >>>>>>>> 1. stop consumers >>>>>>>> 2. export offsets from ZK >>>>>>>> 3. make changes to the exported file >>>>>&g

Re: how to reset kafka offset in zookeeper

nsumers > > > > > > > > > > > > > > e.g. > > > > > > > bin/kafka-run-class.sh kafka.tools.ExportZkOffsets --group > > > group-name > > > > > > > --output-file /tmp/zk-offsets --zkconnect localhost:2181 > > > > &g

Re: how to reset kafka offset in zookeeper

ols.ImportZkOffsets --input-file > > > > > > /tmp/zk-offsets --zkconnect localhost:2181 > > > > > > > > > > > > Marko Bonaći > > > > > > Monitoring | Alerting | Anomaly Detection | Centralized Log > > > Managemen

Re: how to reset kafka offset in zookeeper

> > > > Marko Bonaći > > > > > Monitoring | Alerting | Anomaly Detection | Centralized Log > > Management > > > > > Solr & Elasticsearch Support > > > > > Sematext <http://sematext.com/> | Contact > > > > > <http:

Re: how to reset kafka offset in zookeeper

upport > > > > Sematext <http://sematext.com/> | Contact > > > > <http://sematext.com/about/contact.html> > > > > > > > > On Fri, Dec 18, 2015 at 4:06 PM, Jens Rantil > > > wrote: > > > > > > > > > Hi,

Re: how to reset kafka offset in zookeeper

ote: > > > > > > > Hi, > > > > > > > > I noticed that a consumer in the new consumer API supports setting > the > > > > offset for a partition to beginning. I assume doing so also would > > update > > > > the offset

Re: how to reset kafka offset in zookeeper

t; wrote: > > > > > > > Hi, > > > > > > > > I noticed that a consumer in the new consumer API supports setting > the > > > > offset for a partition to beginning. I assume doing so also would > > update > > > > the of

Re: how to reset kafka offset in zookeeper

consumer in the new consumer API supports setting the > > > offset for a partition to beginning. I assume doing so also would > update > > > the offset in Zookeeper eventually. > > > > > > Cheers, > > > Jens > > > > > > On Friday,

Re: how to reset kafka offset in zookeeper

so also would update > > the offset in Zookeeper eventually. > > > > Cheers, > > Jens > > > > On Friday, December 18, 2015, Akhilesh Pathodia < > > pathodia.akhil...@gmail.com> > > wrote: > > > > > Hi, > > > > > > I w

Re: how to reset kafka offset in zookeeper

t; > On Friday, December 18, 2015, Akhilesh Pathodia < > pathodia.akhil...@gmail.com> > wrote: > > > Hi, > > > > I want to reset the kafka offset in zookeeper so that the consumer will > > start reading messages from first offset. I am using flume as a consumer

Re: how to reset kafka offset in zookeeper

ume will not > read messages from first offset. > > Is there any way to reset kafka offset in zookeeper? > > Thanks, > Akhilesh > -- Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook <https://www.facebook.

Re: how to reset kafka offset in zookeeper

preference). -Todd On Friday, December 18, 2015, Akhilesh Pathodia wrote: > Hi, > > I want to reset the kafka offset in zookeeper so that the consumer will > start reading messages from first offset. I am using flume as a consumer to > kafka. I have set the kafka property kafka.auto.

how to reset kafka offset in zookeeper

Hi, I want to reset the kafka offset in zookeeper so that the consumer will start reading messages from first offset. I am using flume as a consumer to kafka. I have set the kafka property kafka.auto.offset.reset to "smallest", but it does not reset the offset in zookeeper and that&#

RE: Regarding The Kafka Offset Management Issue In Direct Stream Approach.

Subject: Re: Regarding The Kafka Offset Management Issue In Direct Stream Approach. Questions about Spark-kafka integration are better directed to the Spark user mailing list. I'm not 100% sure what you're asking. The spark createDirectStream api will not store any offsets internally,

Re: Regarding The Kafka Offset Management Issue In Direct Stream Approach.

Questions about Spark-kafka integration are better directed to the Spark user mailing list. I'm not 100% sure what you're asking. The spark createDirectStream api will not store any offsets internally, unless you enable checkpointing. On Sun, Nov 1, 2015 at 10:26 PM, Charan Ganga Phani Adabala

Regarding The Kafka Offset Management Issue In Direct Stream Approach.

Hi All, We are working in Apache spark with Kafka integration, in this use case we are using DirectStream approach. we want to avoid the data loss in this approach for actually we take offsets and saving that offset into MongoDB. We want some clarification is Spark stores any offsets internally,

Re: Regarding the Kafka offset management issue in Direct Stream Approach.

Questions about spark's kafka integration should probably be directed to the spark user mailing list, not this one. I don't monitor kafka mailing lists as closely, for instance. For the direct stream, Spark doesn't keep any state regarding offsets, unless you enable checkpointing. Have you read

Regarding the Kafka offset management issue in Direct Stream Approach.

Hi All, We are working in Apache spark with Kafka integration, in this use case we are using DirectStream approach. we want to avoid the data loss in this approach for actually we take offsets and saving that offset into MongoDB. We want some clarification is Spark stores any offsets internally,

Re: Kafka Offset remains at -1

Are you sure your producer and consumer are pointed to the same topic? I see RECUR_TRANS in your logs but you mentioned creating RECURRING_TRANS. If thats not the issue. I have a few questions to get more informations. - Can you list & describe the relevant topics using the kafka-topics scr

Kafka Offset remains at -1

Dear Experts, I have a producer that pushes the Messages to kafka and a producer which is a spark algorithm to pick up the messages using a zookeeper instance. Below is the Spark log: Can anyone tell me what am I doing wrong? Kafka Topic details: *The command I used to create the Topic:* ./kaf

removing consumer groups that use kafka offset storage

I'm running kafka version 0.8.2.1. In testing I've created a bunch of consumer groups that use kafka based offsets and not zookeeper offsets, they are no longer needed. Is there a way to remove unneeded consumer groups that use kafka offset storage? Thank you!

Re: How to monitor Kafka offset

fork. Otherwise you will need to wait for Quantifind to merge & release new version. This is repository of Graphite integration plugin: https://github.com/allegro/kafka-offset-monitor-graphite We are already using it on production, works great and gives us tons of data to monitor. Having dat

Re: How to monitor Kafka offset

We are using kafka offset monitor ( > http://quantifind.com/KafkaOffsetMonitor/), > which we recently integrated with Graphite to add alerting and better > graphing - it should be accessible in newest version, not yet released. It > works only with ZK offsets though. > > 2015-07

Re: How to monitor Kafka offset

We are using kafka offset monitor (http://quantifind.com/KafkaOffsetMonitor/), which we recently integrated with Graphite to add alerting and better graphing - it should be accessible in newest version, not yet released. It works only with ZK offsets though. 2015-07-10 9:24 GMT+02:00 Anandh Kumar

Re: How to monitor Kafka offset

l 2015 09:34, "Jiangjie Qin" wrote: > > > You can take a look at Burrow. We use it in LinkedIn. > > > > Thanks, > > > > Jiangjie (Becket) Qin > > > > On 7/9/15, 8:53 PM, "Anandh Kumar" wrote: > > > > >Hi > > > >

Re: How to monitor Kafka offset

n. > > Thanks, > > Jiangjie (Becket) Qin > > On 7/9/15, 8:53 PM, "Anandh Kumar" wrote: > > >Hi > > > >We have any monitor tool which monitor kafka offset? > > > >I need some opensource admin tool for kafka. > > > >Please guide me. > > > >Regards, > >-Anandh Kumar > >

Re: How to monitor Kafka offset

You can take a look at Burrow. We use it in LinkedIn. Thanks, Jiangjie (Becket) Qin On 7/9/15, 8:53 PM, "Anandh Kumar" wrote: >Hi > >We have any monitor tool which monitor kafka offset? > >I need some opensource admin tool for kafka. > >Please guide me. > >Regards, >-Anandh Kumar

How to monitor Kafka offset

Hi We have any monitor tool which monitor kafka offset? I need some opensource admin tool for kafka. Please guide me. Regards, -Anandh Kumar

Re: Kafka offset using kafka topic - not consuming messages

Thank you, I am using the same groupId all the time. I printed OffsetsMessageFormatter output for the consumer, and the output is showing as [async_force_consumers,force_msgs,9]::OffsetAndMetadata[2,associated metadata,1430277791077] But If I restart the consumer, it starts consuming messages fr

Re: Kafka offset using kafka topic - not consuming messages

OK, so you turned off auto.offset.commit, and set the auto.offset.reset to largest. That means when you consume, 1. If you did not commit offsets manually, no offsets will be committed to Kafka. 2. If you do not have an offset stored in Kafka, you will start from the log end and ignore the existin

Kafka offset using kafka topic - not consuming messages

I am using Kafka 0.8.2 and I am using Kafka based storage for offset. Whenever I restart a consumer (high level consumer api) it is not consuming messages whichever were posted when the consumer was down. I am using the following consumer properties Properties props = new Properties();

Re: How to fetch consumer group names of a Topic from Kafka offset manager in Kafka 0.8.2.1

> 2. How to get consumer group names for a topic? Is there any document or > API to get all consumer group from Kafka offset storage manager like > zookeeper we have /consumer which lists all consumers. > > > Thanks in advance. > > Regards, > Madhukar > -- -Regards, Mayuresh R. Gharat (862) 250-7125

How to fetch consumer group names of a Topic from Kafka offset manager in Kafka 0.8.2.1

ocument or API to get all consumer group from Kafka offset storage manager like zookeeper we have /consumer which lists all consumers. Thanks in advance. Regards, Madhukar

Kafka Offset Request for particular zookeeper chroot.

Hi, For sending Offset Request with Kafka 0.8.2, I used this example :Finding Starting Offset for Reads It works great on my test environment where a kafka broker uses the default zookeeper chroot (/). On another K

Re: Anouncing Kafka Offset Monitor 0.1

Interesting. We were able to get this from JMX for Kafka 0.7.2 - here's a snapshot for one of our Kafka clusters: https://apps.sematext.com/spm-reports/s/93EtvhnOz0 Is getting this from ZK instead of JMX better? Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsear

Re: Anouncing Kafka Offset Monitor 0.1

It's been developed with 0.8 in mind. Giving a quick look at how 0.7 stores data in ZK, it looks like it's slightly different and might not work straight away. If you are intersted, have a look at: https://github.com/quantifind/KafkaOffsetMonitor/blob/master/src/main/scala/com/quantifind/kafka/Off

Re: Anouncing Kafka Offset Monitor 0.1

Hi Patricio, thank you! I don't know how kafka-spout works. Right now, the monitor uses the value defined in kafka.utils.ZkUtils.ConsumersPath to grab the list of consumers in ZK. Again, that could be a parameter to the app somewhere to be more flexible and deal with separate zk path. P On Sat

Re: Anouncing Kafka Offset Monitor 0.1

On Sat, Mar 8, 2014 at 12:17 AM, Dan Hoffman wrote: > Hi - am I right in that for this tool to be effective, consumers must be > using the high level consumer or otherwise keeping their offsets in > zookeeper? yes indeed, this will look into zookeeper for the consumers and their offsets. > I

Re: Anouncing Kafka Offset Monitor 0.1

Hi, Does this work with Kafka 0.7.x or does Kafka 0.7.x not expose the info needed for computing the lag? Thanks, Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Fri, Mar 7, 2014 at 1:49 PM, Pierre Andrews wrote: > Hello

Re: Anouncing Kafka Offset Monitor 0.1

hi, Kafka web console will be included in the next release. On Mar 8, 2014 2:49 AM, "Pierre Andrews" wrote: > Hello everyone, > > at Quantifind, we are big users of Kafka and we like it a lot! > In a few use cases, we had to figure out if a queue was growing and how its > consumers were behavin

Re: Anouncing Kafka Offset Monitor 0.1

Great work! In addition to Dan's question, does it work with storm kafka-spout which uses a separate zk path? Sent from my Nexus 4. On Mar 7, 2014 7:18 PM, "Dan Hoffman" wrote: > Hi - am I right in that for this tool to be effective, consumers must be > using the high level consumer or otherwis

Re: Anouncing Kafka Offset Monitor 0.1

Hi - am I right in that for this tool to be effective, consumers must be using the high level consumer or otherwise keeping their offsets in zookeeper? Is there any way to track performance without that? On Fri, Mar 7, 2014 at 3:08 PM, Steve Morin wrote: > Very nice > > > On Mar 7, 2014, at 11

Re: Anouncing Kafka Offset Monitor 0.1

Very nice > On Mar 7, 2014, at 11:55, Pierre Andrews wrote: > > Claude, we should join forces ;) > > >> On Fri, Mar 7, 2014 at 4:45 PM, Claude Mamo wrote: >> >> Awesome!!! ;-) >> >> Claude >> >> >> On Fri, Mar 7, 2014 at 4:03 PM, Pierre Andrews >> wrote: >> >>> Great! Thanks! >>> >>> >

Re: Anouncing Kafka Offset Monitor 0.1

Agreed, sent you an email. Caude On Fri, Mar 7, 2014 at 4:55 PM, Pierre Andrews wrote: > Claude, we should join forces ;) > > > On Fri, Mar 7, 2014 at 4:45 PM, Claude Mamo wrote: > > > Awesome!!! ;-) > > > > Claude > > > > > > On Fri, Mar 7, 2014 at 4:03 PM, Pierre Andrews > >wrote: > > > > >

Re: Anouncing Kafka Offset Monitor 0.1

Claude, we should join forces ;) On Fri, Mar 7, 2014 at 4:45 PM, Claude Mamo wrote: > Awesome!!! ;-) > > Claude > > > On Fri, Mar 7, 2014 at 4:03 PM, Pierre Andrews >wrote: > > > Great! Thanks! > > > > > > On Fri, Mar 7, 2014 at 3:59 PM, Jay Kreps wrote: > > > > > This is really useful! I add

Re: Anouncing Kafka Offset Monitor 0.1

Awesome!!! ;-) Claude On Fri, Mar 7, 2014 at 4:03 PM, Pierre Andrews wrote: > Great! Thanks! > > > On Fri, Mar 7, 2014 at 3:59 PM, Jay Kreps wrote: > > > This is really useful! I added it to the ecosystem page: > > https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem > > > > -Jay > > >

Re: Anouncing Kafka Offset Monitor 0.1

Great! Thanks! On Fri, Mar 7, 2014 at 3:59 PM, Jay Kreps wrote: > This is really useful! I added it to the ecosystem page: > https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem > > -Jay > > > On Fri, Mar 7, 2014 at 10:49 AM, Pierre Andrews >wrote: > > > Hello everyone, > > > > at Quant

Re: Anouncing Kafka Offset Monitor 0.1

This is really useful! I added it to the ecosystem page: https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem -Jay On Fri, Mar 7, 2014 at 10:49 AM, Pierre Andrews wrote: > Hello everyone, > > at Quantifind, we are big users of Kafka and we like it a lot! > In a few use cases, we had to f

Anouncing Kafka Offset Monitor 0.1

Hello everyone, at Quantifind, we are big users of Kafka and we like it a lot! In a few use cases, we had to figure out if a queue was growing and how its consumers were behaving. There are a few command-line tools to try to figure out what's going on, but it's not always easy to debug and to see

Re: Kafka Offset timestamp

Currently, a message doesn't have a timestamp header. So you have to encode the timestamp in the message payload. Thanks, Jun On Mon, Apr 1, 2013 at 7:10 PM, Suyog Rao wrote: > Is there a way to get the timestamp for a Kafka message entry on the > server by the consumer? What I would like to d

Kafka Offset timestamp

Is there a way to get the timestamp for a Kafka message entry on the server by the consumer? What I would like to do is to is check if an offset is of a particular age before pulling offset + bytes to my consumer. Otherwise I would like the messages to be continued to be queued in Kafka until th