How can I get the first valid record's offset in a partition?

2018-02-11 Thread York Zhang
I'm trying to get the record count in a partition/topic.My solution is consuming all record in partition/topic and counting them with java api. I meet a problem that my topic is set retention.ms to 1 hour. When I consume the partition from offset whose record is already deleted, it seems that

Re: [VOTE] KIP-251: Allow timestamp manipulation in Processor API

2018-02-11 Thread Guozhang Wang
Hi Matthias, Just clarifying a meta question along side with my vote: we still need to understand the overhead of the `To` objects during run time to determine whether we would use it in the final proposal or using overloading functions. Right? Guozhang On Sun, Feb 11, 2018 at 9:33 PM,

Re: [VOTE] KIP-251: Allow timestamp manipulation in Processor API

2018-02-11 Thread Guozhang Wang
+1 On Fri, Feb 9, 2018 at 5:31 AM, Bill Bejeck wrote: > Thanks for the KIP, +1 for me. > > -Bill > > On Fri, Feb 9, 2018 at 6:45 AM, Damian Guy wrote: > > > Thanks Matthias, +1 > > > > On Fri, 9 Feb 2018 at 02:42 Ted Yu wrote: > >

[jira] [Created] (KAFKA-6552) “entity_type” not exactly in description of kafka-configs.sh

2018-02-11 Thread Xin (JIRA)
Xin created KAFKA-6552: -- Summary: “entity_type” not exactly in description of kafka-configs.sh Key: KAFKA-6552 URL: https://issues.apache.org/jira/browse/KAFKA-6552 Project: Kafka Issue Type: Bug