[jira] [Created] (KAFKA-6552) “entity_type” not exactly in description of kafka-configs.sh
Xin created KAFKA-6552: -- Summary: “entity_type” not exactly in description of kafka-configs.sh Key: KAFKA-6552 URL: https://issues.apache.org/jira/browse/KAFKA-6552 Project: Kafka Issue Type: Bug Components: admin Affects Versions: 0.11.0.2 Reporter: Xin There are some “entity_type” in the description of the command option “--add-config”, but the “--entity-type ” is the command option of kafka-configs.sh -- This message was sent by Atlassian JIRA (v7.6.3#76005)
Re: [VOTE] KIP-251: Allow timestamp manipulation in Processor API
+1 On Fri, Feb 9, 2018 at 5:31 AM, Bill Bejeck wrote: > Thanks for the KIP, +1 for me. > > -Bill > > On Fri, Feb 9, 2018 at 6:45 AM, Damian Guy wrote: > > > Thanks Matthias, +1 > > > > On Fri, 9 Feb 2018 at 02:42 Ted Yu wrote: > > > > > +1 > > > Original message From: "Matthias J. Sax" < > > > matth...@confluent.io> Date: 2/8/18 6:05 PM (GMT-08:00) To: > > > dev@kafka.apache.org Subject: [VOTE] KIP-251: Allow timestamp > > > manipulation in Processor API > > > Hi, > > > > > > I want to start the vote for KIP-251: > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > 251%3A+Allow+timestamp+manipulation+in+Processor+API > > > > > > > > > -Matthias > > > > > > > > > -- -- Guozhang
Re: [VOTE] KIP-251: Allow timestamp manipulation in Processor API
Hi Matthias, Just clarifying a meta question along side with my vote: we still need to understand the overhead of the `To` objects during run time to determine whether we would use it in the final proposal or using overloading functions. Right? Guozhang On Sun, Feb 11, 2018 at 9:33 PM, Guozhang Wang wrote: > +1 > > On Fri, Feb 9, 2018 at 5:31 AM, Bill Bejeck wrote: > >> Thanks for the KIP, +1 for me. >> >> -Bill >> >> On Fri, Feb 9, 2018 at 6:45 AM, Damian Guy wrote: >> >> > Thanks Matthias, +1 >> > >> > On Fri, 9 Feb 2018 at 02:42 Ted Yu wrote: >> > >> > > +1 >> > > Original message From: "Matthias J. Sax" < >> > > matth...@confluent.io> Date: 2/8/18 6:05 PM (GMT-08:00) To: >> > > dev@kafka.apache.org Subject: [VOTE] KIP-251: Allow timestamp >> > > manipulation in Processor API >> > > Hi, >> > > >> > > I want to start the vote for KIP-251: >> > > >> > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >> > 251%3A+Allow+timestamp+manipulation+in+Processor+API >> > > >> > > >> > > -Matthias >> > > >> > > >> > >> > > > > -- > -- Guozhang > -- -- Guozhang
How can I get the first valid record's offset in a partition?
I'm trying to get the record count in a partition/topic.My solution is consuming all record in partition/topic and counting them with java api. I meet a problem that my topic is set retention.ms to 1 hour. When I consume the partition from offset whose record is already deleted, it seems that the offset is never added.I check group offset and find that the current-offset is always same as log-end-offset. Then I try to commit offset manually. If I get 0 records in a poll(), I will commit offset = old + 1 until I get some records. But it is too slow to reach the target. Is there any way that I can get the first valid record's offset in a partition? Then I can consume from that offset. I'm using kafka 0.9.
