Re: I found kafka lsot message

2016-10-13 Thread Hans Jespersen
think these codes is common, What's your suggest about these codes? > In the end, I must explain: Lost message is not often, some time, couple days > can find one or two lost messages.But some day, maybe can find over 20 > messages were losted.Our message over 1,200,000 in one day. &

回复:Re: Re: I found kafka lsot message

2016-10-13 Thread yangyuqi
Other question: if account of consumer over broker number, whether loss data? if some broker rebooted, whether loss data? Thanks. - 原始邮件 - 发件人:Guozhang Wang 收件人:yangy...@sina.com 抄送人:users 主题:Re: Re: I found kafka lsot message 日期:2016年10月12日 07点

Re: Re: I found kafka lsot message

2016-10-11 Thread Guozhang Wang
st message is not often, some time, couple > days can find one or two lost messages. > But some day, maybe can find over 20 messages were losted. > Our message over 1,200,000 in one day. > > So, do your have any suggest? > Bye the way, can you speak Chinese? > Thank you very m

回复:Re: I found kafka lsot message

2016-10-10 Thread yangyuqi
, do your have any suggest?Bye the way, can you speak Chinese? Thank you very much & Best wishesJerry - 原始邮件 - 发件人:Guozhang Wang 收件人:"users@kafka.apache.org" , yangy...@sina.com 主题:Re: I found kafka lsot message 日期:2016年10月10日 01点25分 Jerry,

Re: I found kafka lsot message

2016-10-09 Thread Guozhang Wang
Jerry, Message lost scenarios usually are due to producer and consumer mis-configured. Have you read about the client configs web docs? http://kafka.apache.org/documentation#producerconfigs http://kafka.apache.org/documentation#newconsumerconfigs If not I'd suggest you reading those first and

I found kafka lsot message

2016-10-07 Thread yangyuqi
Hello every body,I build a kafka cluster(include 5 domains) use kafka_2.11-0.10.0.0 and kafka-python-1.3.1.I create a topic by 100 partitions and 2 replicate, then use 20 consumers to receive message. But, I found sometime the kafka lost message! I found some partition's offsite lost at consumer