Re: [ANNOUNCE] New committer: Mickael Maison

Congratulations Mickael! On Fri, Nov 8, 2019 at 6:41 AM Vahid Hashemian wrote: > Congrats Mickael, > > Well deserved! > > --Vahid > > On Thu, Nov 7, 2019 at 9:10 PM Maulin Vasavada > wrote: > > > Congratulations Mickael! > > > > On Thu, Nov 7, 2019 at 8:27 PM Manikumar > > wrote: > > > > >

[jira] [Created] (KAFKA-9163) Re-assignment of Partition gets infinitely stuck "Still in progress" state

vikash kumar created KAFKA-9163: --- Summary: Re-assignment of Partition gets infinitely stuck "Still in progress" state Key: KAFKA-9163 URL: https://issues.apache.org/jira/browse/KAFKA-9163 Project:

[jira] [Created] (KAFKA-9162) Re-assignment of Partition gets infinitely stuck "Still in progress" state

vikash kumar created KAFKA-9162: --- Summary: Re-assignment of Partition gets infinitely stuck "Still in progress" state Key: KAFKA-9162 URL: https://issues.apache.org/jira/browse/KAFKA-9162 Project:

Re: [ANNOUNCE] New committer: Mickael Maison

Congrats Mickael, Well deserved! --Vahid On Thu, Nov 7, 2019 at 9:10 PM Maulin Vasavada wrote: > Congratulations Mickael! > > On Thu, Nov 7, 2019 at 8:27 PM Manikumar > wrote: > > > Congrats Mickeal! > > > > On Fri, Nov 8, 2019 at 9:05 AM Dong Lin wrote: > > > > > Congratulations Mickael! >

Re: [VOTE] KIP-543: Expand ConfigCommand's non-ZK functionality

+1 Looking forward to this. I love the quality-of-life changes. On Thu, Nov 7, 2019 at 7:00 PM Manikumar wrote: > +1 (binding), Thanks for the KIP. > > > > On Fri, Nov 8, 2019 at 8:14 AM Gwen Shapira wrote: > > > +1 (binding) > > > > Thank you. > > > > On Thu, Nov 7, 2019, 8:41 AM Brian Byrne

Re: [ANNOUNCE] New committer: Mickael Maison

Congratulations Mickael! On Thu, Nov 7, 2019 at 8:27 PM Manikumar wrote: > Congrats Mickeal! > > On Fri, Nov 8, 2019 at 9:05 AM Dong Lin wrote: > > > Congratulations Mickael! > > > > On Thu, Nov 7, 2019 at 1:38 PM Jun Rao wrote: > > > > > Hi, Everyone, > > > > > > The PMC of Apache Kafka is

Jenkins build is back to normal : kafka-trunk-jdk11 #940

See

Re: [ANNOUNCE] New committer: Mickael Maison

Congrats Mickeal! On Fri, Nov 8, 2019 at 9:05 AM Dong Lin wrote: > Congratulations Mickael! > > On Thu, Nov 7, 2019 at 1:38 PM Jun Rao wrote: > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > > Mickael > > Maison. > > > > Mickael has been

[jira] [Created] (KAFKA-9161) Close gaps in Streams configs documentation

Sophie Blee-Goldman created KAFKA-9161: -- Summary: Close gaps in Streams configs documentation Key: KAFKA-9161 URL: https://issues.apache.org/jira/browse/KAFKA-9161 Project: Kafka Issue

[jira] [Created] (KAFKA-9160) Use a common stateMachine to make the state transfer more simple and clear。

maobaolong created KAFKA-9160: - Summary: Use a common stateMachine to make the state transfer more simple and clear。 Key: KAFKA-9160 URL: https://issues.apache.org/jira/browse/KAFKA-9160 Project: Kafka

Re: [ANNOUNCE] New committer: Mickael Maison

Congratulations Mickael! On Thu, Nov 7, 2019 at 1:38 PM Jun Rao wrote: > Hi, Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > Mickael > Maison. > > Mickael has been contributing to Kafka since 2016. He proposed and > implemented multiple KIPs. He has also

Re: [VOTE] KIP-543: Expand ConfigCommand's non-ZK functionality

+1 (binding), Thanks for the KIP. On Fri, Nov 8, 2019 at 8:14 AM Gwen Shapira wrote: > +1 (binding) > > Thank you. > > On Thu, Nov 7, 2019, 8:41 AM Brian Byrne wrote: > > > Hello all, > > > > Ping. Any further votes or opinions? > > > > Thanks, > > Brian > > > > On Tue, Oct 29, 2019 at 9:39

Re: [VOTE] KIP-543: Expand ConfigCommand's non-ZK functionality

+1 (binding) Thank you. On Thu, Nov 7, 2019, 8:41 AM Brian Byrne wrote: > Hello all, > > Ping. Any further votes or opinions? > > Thanks, > Brian > > On Tue, Oct 29, 2019 at 9:39 AM Brian Byrne wrote: > > > Hello all, > > > > I'd like to call a vote on KIP-543: Expand ConfigCommand's non-ZK >

Re: [ANNOUNCE] New committer: Mickael Maison

Congratulations Mickael! Very well deserved! Regards, Kevin On Thu, Nov 7, 2019 at 5:12 PM Gurudatt Kulkarni wrote: > Congratulations Mickael! > > On Friday, November 8, 2019, Matthias J. Sax > wrote: > > Congrats Mickeal! > > > > > > -Matthias > > > > On 11/7/19 1:53 PM, Bill Bejeck wrote: >

Re: [DISCUSS] KIP-531: Drop support for Scala 2.11 in Kafka 2.5

About time :) Let's do it. On Thu, Nov 7, 2019 at 5:35 PM Ismael Juma wrote: > > Hi all, > > I think it's time to simplify our development environment by dropping > support for Scala 2.11. Please take a look at the proposal and > provide feedback: > >

Jenkins build is back to normal : kafka-trunk-jdk8 #4024

See

[DISCUSS] KIP-531: Drop support for Scala 2.11 in Kafka 2.5

Hi all, I think it's time to simplify our development environment by dropping support for Scala 2.11. Please take a look at the proposal and provide feedback: https://cwiki.apache.org/confluence/display/KAFKA/KIP-531%3A+Drop+support+for+Scala+2.11+in+Kafka+2.5 Ismael

Re: [ANNOUNCE] New committer: Mickael Maison

Congratulations Mickael! On Friday, November 8, 2019, Matthias J. Sax wrote: > Congrats Mickeal! > > > -Matthias > > On 11/7/19 1:53 PM, Bill Bejeck wrote: >> Congratulations Mickael! Well deserved! >> >> -Bill >> >> On Thu, Nov 7, 2019 at 4:38 PM Jun Rao wrote: >> >>> Hi, Everyone, >>> >>> The

Re: [ANNOUNCE] New committer: Mickael Maison

Congrats Mickeal! -Matthias On 11/7/19 1:53 PM, Bill Bejeck wrote: > Congratulations Mickael! Well deserved! > > -Bill > > On Thu, Nov 7, 2019 at 4:38 PM Jun Rao wrote: > >> Hi, Everyone, >> >> The PMC of Apache Kafka is pleased to announce a new Kafka committer >> Mickael >> Maison. >> >>

Re: [VOTE] KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics

Hello Brian, Could you elaborate a bit more on this sentence: "This logic can be made more intelligent by managing the expiry from when the topic was last used, enabling the expiry duration to be reduced to improve cases where a large number of topics are touched intermittently." Not sure I fully

Re: [VOTE] KIP-280: Enhanced log compaction

Hi, Senthil, Thanks for the KIP. Added a few more comments on the discussion thread. Jun On Wed, Nov 6, 2019 at 3:38 AM Senthilnathan Muthusamy wrote: > Thanks Matthias! > > Received 2 +1 binding... looking for one more +1 binding ! > > Regards, > Senthil > > -Original Message- >

Re: [DISCUSS] KIP-280: Enhanced log compaction

Hi, Senthil, Thanks for bringing back this KIP. Overall, this seems like a useful feature. A few comments below. 50. One use case for the timestamp based compaction is to resolve conflicts during data center failures. The failover of a data center typically happens much longer tha millisec. So,

Re: [VOTE] KIP-543: Expand ConfigCommand's non-ZK functionality

Hi Brian, LGTM. +1 (non-binding) On Thu, Nov 7, 2019 at 3:28 PM Colin McCabe wrote: > Hi Brian, > > Thanks for the KIP. +1 (binding). > > best, > Colin > > > On Thu, Nov 7, 2019, at 08:41, Brian Byrne wrote: > > Hello all, > > > > Ping. Any further votes or opinions? > > > > Thanks, > > Brian

[jira] [Created] (KAFKA-9159) Consumer.endOffsets Throw TimeoutException: Failed to get offsets by times in 30000ms after a leader change

zhangzhanchang created KAFKA-9159: - Summary: Consumer.endOffsets Throw TimeoutException: Failed to get offsets by times in 3ms after a leader change Key: KAFKA-9159 URL:

Re: [VOTE] KIP-543: Expand ConfigCommand's non-ZK functionality

Hi Brian, Thanks for the KIP. +1 (binding). best, Colin On Thu, Nov 7, 2019, at 08:41, Brian Byrne wrote: > Hello all, > > Ping. Any further votes or opinions? > > Thanks, > Brian > > On Tue, Oct 29, 2019 at 9:39 AM Brian Byrne wrote: > > > Hello all, > > > > I'd like to call a vote on

[jira] [Created] (KAFKA-9158) producer fetch metadata until buffer is full

Brandon Jiang created KAFKA-9158: Summary: producer fetch metadata until buffer is full Key: KAFKA-9158 URL: https://issues.apache.org/jira/browse/KAFKA-9158 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-9101) Create a fetch.max.bytes configuration for the broker

[ https://issues.apache.org/jira/browse/KAFKA-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-9101. - Resolution: Fixed https://github.com/apache/kafka/pull/7595 > Create a fetch.max.bytes

Re: [ANNOUNCE] New committer: Mickael Maison

Congratulations Mickael! Well deserved! -Bill On Thu, Nov 7, 2019 at 4:38 PM Jun Rao wrote: > Hi, Everyone, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > Mickael > Maison. > > Mickael has been contributing to Kafka since 2016. He proposed and > implemented multiple

[ANNOUNCE] New committer: Mickael Maison

Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer Mickael Maison. Mickael has been contributing to Kafka since 2016. He proposed and implemented multiple KIPs. He has also been propomating Kafka through blogs and public talks. Congratulations, Mickael! Thanks,

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

> > > > Thanks, I missed that point. However, there's still a point at which the > consumer fetches start getting served from remote storage (even if that > point isn't as soon as the local log retention time/size). This represents > a kind of performance cliff edge and what I'm really interested

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

On Wed, Nov 6, 2019 at 6:28 PM Tom Bentley wrote: > Hi Ying, > > Because only inactive segments can be shipped to remote storage, to be able > > to ship log data as soon > > as possible, we will roll log segment very fast (e.g. every half hour). > > > > So that means a consumer which gets behind

[VOTE] KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics

Hello all, I'd like to propose a vote for a producer change to improve producer behavior when dealing with a large number of topics, in part by reducing the amount of metadata fetching performed. The full KIP is provided here:

Re: [DISCUSS] KIP-544: Make metrics exposed via JMX configurable

Thanks Xavier for the KIP, I think it is a great idea to add to AK. A couple of questions / comments: 1. I do feel there're similar needs for clients make JMX configurable. Some context: in modules like Connect and Streams we have added / refactored a large number of metrics so far [0, 1], and

[VOTE] KIP-544: Make metrics exposed via JMX configurable

Hi everyone, I'd like to open up the vote for KIP-544 on making exposed JMX metrics more configurable. https://cwiki.apache.org/confluence/display/KAFKA/KIP-544%3A+Make+metrics+exposed+via+JMX+configurable Thank you! Xavier

Build failed in Jenkins: kafka-trunk-jdk11 #939

See Changes: [github] MINOR: Added one test and some clarifying comments on tests with -- [...truncated 2.74 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

Hi Sophie, Thank you for your reply, very insightful. Looking forward hearing others opinion as well on this. Kind regards, Levani > On Nov 6, 2019, at 1:30 AM, Sophie Blee-Goldman wrote: > >> Personally, I think Matthias’s concern is valid, but on the other hand > Kafka Streams has already

Re: [DISCUSS] KIP-535: Allow state stores to serve stale reads during rebalance

Hi Navinder, Vinoth, thanks for the updated KIP! Read through the discussions so far and made another pass on the wiki page, and here are some more comments: 1. About the public APIs: 1.1. It is not clear to me how allStandbyMetadataForStore and allStandbyMetadata would be differentiated from

[jira] [Created] (KAFKA-9157) logcleaner could generate empty segment files after cleaning

Jun Rao created KAFKA-9157: -- Summary: logcleaner could generate empty segment files after cleaning Key: KAFKA-9157 URL: https://issues.apache.org/jira/browse/KAFKA-9157 Project: Kafka Issue Type:

Re: [VOTE] KIP-543: Expand ConfigCommand's non-ZK functionality

Hello all, Ping. Any further votes or opinions? Thanks, Brian On Tue, Oct 29, 2019 at 9:39 AM Brian Byrne wrote: > Hello all, > > I'd like to call a vote on KIP-543: Expand ConfigCommand's non-ZK > functionality, linked here: https://cwiki.apache.org/confluence/x/ww-3Bw > > Thanks, > Brian >

Re: [VOTE] KIP-514 Add a bounded flush() API to Kafka Producer

+1 (non-binding) On Thu, Nov 7, 2019 at 8:58 PM Ismael Juma wrote: > > +1 (binding) > > On Thu, Oct 24, 2019 at 9:33 PM radai wrote: > > > Hello, > > > > I'd like to initiate a vote on KIP-514. > > > > links: > > the kip - > >

Re: [VOTE] KIP-514 Add a bounded flush() API to Kafka Producer

+1 (binding) On Thu, Oct 24, 2019 at 9:33 PM radai wrote: > Hello, > > I'd like to initiate a vote on KIP-514. > > links: > the kip - > https://cwiki.apache.org/confluence/display/KAFKA/KIP-514%3A+Add+a+bounded+flush%28%29+API+to+Kafka+Producer > the PR -

Re: [VOTE] KIP-514 Add a bounded flush() API to Kafka Producer

+1 (non binding, and another bump) On Fri, Oct 25, 2019 at 11:51 AM Harsha Chintalapani wrote: > > +1 (binding) > -Harsha > > > On Fri, Oct 25 2019 at 11:01 AM, wrote: > > > > > +1 > > > > On Thu, Oct 24, 2019 at 9:33 PM radai wrote: > > > > Hello, > > > > > > > > > I'd like to initiate a vote

Build failed in Jenkins: kafka-trunk-jdk8 #4023

See Changes: [manikumar] KAFKA-9150; DescribeGroup uses member assignment as metadata -- [...truncated 5.55 MB...] org.apache.kafka.streams.test.TestRecordTest >

[jira] [Created] (KAFKA-9156) LazyTimeIndex & LazyOffsetIndex may cause niobufferoverflow in concurrent state

shilin Lu created KAFKA-9156: Summary: LazyTimeIndex & LazyOffsetIndex may cause niobufferoverflow in concurrent state Key: KAFKA-9156 URL: https://issues.apache.org/jira/browse/KAFKA-9156 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk11 #938

See Changes: [manikumar] KAFKA-9150; DescribeGroup uses member assignment as metadata -- [...truncated 2.75 MB...] org.apache.kafka.streams.TestTopicsTest >

[jira] [Created] (KAFKA-9155) __consuemer_offsets unable to compress properly

yanrui created KAFKA-9155: - Summary: __consuemer_offsets unable to compress properly Key: KAFKA-9155 URL: https://issues.apache.org/jira/browse/KAFKA-9155 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-2.4-jdk8 #56

See Changes: [manikumar] KAFKA-9150; DescribeGroup uses member assignment as metadata -- [...truncated 2.69 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Build failed in Jenkins: kafka-trunk-jdk8 #4022

See Changes: [bbejeck] [MINOR] Clean up PartitionAssignor for KIP-441 (#7649) [wangguoz] KAFKA-8729: Change `PartitionResponse` to include all troubling records --