Re: Question about Kafka Streams error message when a message is larger than the maximum size the server will accept

2018-03-28 Thread Mihaela Stoycheva
Hello Guozhang, Thank you for the answer, that could explain what is happening. Is it possible that this is related in some way to https://issues.apache.org/jira/browse/KAFKA-6538? Mihaela On Wed, Mar 28, 2018 at 2:21 AM, Guozhang Wang wrote: > Hello Mihaela, > > It is possible that when you h

Re: [VOTE] 1.1.0 RC4

2018-03-28 Thread Rajini Sivaram
This vote passes with 9 +1 votes (4 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Jason Gustafson * Jun Rao * Gwen Shapira * Rajini Sivaram Committers: * No votes Community: * Ted Yu * Manikumar * Jeff Chao * Vahid Hashemian * Brett Rann 0 votes * No votes -1 votes * No votes Vot

Kafka Streams Internal Topic Retention not applied

2018-03-28 Thread Björn Häuser
Hello Everyone, we are running a Kafka Streams Application with does time window aggregates (using kafka 1.0.0). Unfortunately one of the changelog topics is now growing quite a bit in size maxing out the brokers. I did not find any settings in the kafka stream properties to configure retentio

kafka IO utilization with more disks and brokers

2018-03-28 Thread Elad Eldor
Hi all, We performed a kafka benchmark (BM) in order to figure out the maximum throughput (TP) available with the given kafka brokers and disks. *kafka brokers setup (machine spec & disks):* 3 kafka brokers, Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz, 8 cores. each broker has sdb device mounted

Re: Question about Kafka Streams error message when a message is larger than the maximum size the server will accept

2018-03-28 Thread Guozhang Wang
Yes that is correlated, thanks for the reminder. I've updated the JIRA to reflect your observations as well. Guozhang On Wed, Mar 28, 2018 at 12:41 AM, Mihaela Stoycheva < mihaela.stoych...@gmail.com> wrote: > Hello Guozhang, > > Thank you for the answer, that could explain what is happening.

[ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Becket Qin
Hello everyone, The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted our invitation to be a new Kafka committer. Dong started working on Kafka about four years ago, since which he has contributed numerous features and patches. His work on Kafka core has been consistent and im

Re: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Ismael Juma
Congratulations Dong! Thanks for your contributions so far and looking forward to future ones. Ismael On Wed, 28 Mar 2018, 10:58 Becket Qin, wrote: > Hello everyone, > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > our invitation to be a new Kafka committer. > > D

Re: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Mickael Maison
Congratulations Dong! On Wed, Mar 28, 2018 at 7:31 PM, Ismael Juma wrote: > Congratulations Dong! Thanks for your contributions so far and looking > forward to future ones. > > Ismael > > On Wed, 28 Mar 2018, 10:58 Becket Qin, wrote: > >> Hello everyone, >> >> The PMC of Apache Kafka is pleased

Re: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Jason Gustafson
Congrats Dong! On Wed, Mar 28, 2018 at 12:04 PM, Mickael Maison wrote: > Congratulations Dong! > > On Wed, Mar 28, 2018 at 7:31 PM, Ismael Juma wrote: > > Congratulations Dong! Thanks for your contributions so far and looking > > forward to future ones. > > > > Ismael > > > > On Wed, 28 Mar 201

Re: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Paolo Patierno
Congrats Dong !! From: Becket Qin Sent: Wednesday, March 28, 2018 7:58:07 PM To: dev; users@kafka.apache.org Subject: [ANNOUNCE] New Committer: Dong Lin Hello everyone, The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted our invitation to be

Re: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread James Cheng
Congrats, Dong! -James > On Mar 28, 2018, at 10:58 AM, Becket Qin wrote: > > Hello everyone, > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > our invitation to be a new Kafka committer. > > Dong started working on Kafka about four years ago, since which he has >

Re: Kafka Streams Internal Topic Retention not applied

2018-03-28 Thread Guozhang Wang
Hello, You can set the topic-level configs via the StreamsConfig#topicPrefix(String), please find the following web docs (search for KIP-173): https://kafka.apache.org/documentation/streams/upgrade-guide#streams_api_changes_100 Guozhang On Wed, Mar 28, 2018 at 3:23 AM, Björn Häuser wrote:

Re: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Matthias J. Sax
Congrats! On 3/28/18 1:16 PM, James Cheng wrote: > Congrats, Dong! > > -James > >> On Mar 28, 2018, at 10:58 AM, Becket Qin wrote: >> >> Hello everyone, >> >> The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted >> our invitation to be a new Kafka committer. >> >> Dong star

答复: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Hu Xi
Congrats, Dong Lin! 发件人: Matthias J. Sax 发送时间: 2018年3月29日 6:37 收件人: users@kafka.apache.org; d...@kafka.apache.org 主题: Re: [ANNOUNCE] New Committer: Dong Lin Congrats! On 3/28/18 1:16 PM, James Cheng wrote: > Congrats, Dong! > > -James > >> On Mar 28, 2018, at 1

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Dong Lin
Thanks everyone!! It is my great pleasure to be part of the Apache Kafka community and help make Apache Kafka more useful to its users. I am super excited to be a Kafka committer and I am hoping to contribute more to its design, implementation and review etc in the future. Thanks! Dong On Wed, M

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Tao Feng
Congrats Dong! On Wed, Mar 28, 2018 at 5:15 PM Dong Lin wrote: > Thanks everyone!! > > It is my great pleasure to be part of the Apache Kafka community and help > make Apache Kafka more useful to its users. I am super excited to be a > Kafka committer and I am hoping to contribute more to its de

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Manikumar
Congrats, Dong! On Thu, Mar 29, 2018 at 6:45 AM, Tao Feng wrote: > Congrats Dong! > > On Wed, Mar 28, 2018 at 5:15 PM Dong Lin wrote: > > > Thanks everyone!! > > > > It is my great pleasure to be part of the Apache Kafka community and help > > make Apache Kafka more useful to its users. I am su

Re: 答复: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Kamal Chandraprakash
Congratulations, Dong! On Thu, Mar 29, 2018 at 7:14 AM, Manikumar wrote: > Congrats, Dong! > > On Thu, Mar 29, 2018 at 6:45 AM, Tao Feng wrote: > > > Congrats Dong! > > > > On Wed, Mar 28, 2018 at 5:15 PM Dong Lin wrote: > > > > > Thanks everyone!! > > > > > > It is my great pleasure to be par