Re: KIP-28 kafka processor

Thanks, Chris and Jay. So do we add comments in this thread? Seems I can not leave comments in the confluence. :) Thanks, Fang, Yan yanfang...@gmail.com On Mon, Aug 17, 2015 at 11:05 PM, Yi Pan nickpa...@gmail.com wrote: Hi, Chris and Jay, Thanks for the reminder. I plan to follow up this

Re: Review Request 37069: SAMZA-738 Samza Timer based metrics does not have enough precision

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37069/#review95692 --- Ship it! LGTM. - Yi Pan (Data Infrastructure) On Aug. 5, 2015,

Re: Use one producer for both coordinator stream and users system?

Hi Tao, First, one kafka producer has an i/o thread. (correct me if I am wrong). Second, after Samza 0.10.0, we have a coordinator stream, which stores the checkpoint, config and other locality information for auto-scaling, dynamic configuration, etc purpose. (See Samza-348

Re: remote kafka producer -- kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries

Thanks, Selina, for sharing this solution for the reference. :) Cheers, Fang, Yan yanfang...@gmail.com On Mon, Aug 17, 2015 at 7:17 PM, Job-Selina Wu swucaree...@gmail.com wrote: Hi, All: Finally I fixed this bug. 1. set advertised.host.name at config/server.properites as AWS

Re: KIP-28 kafka processor

Hi, Chris and Jay, Thanks for the reminder. I plan to follow up this week. Cheers! -Yi On Sun, Aug 16, 2015 at 12:27 PM, Jay Kreps jay.kr...@gmail.com wrote: +1 Any feedback would be appreciated! -Jay On Sat, Aug 15, 2015 at 3:55 PM, Chris Riccomini criccom...@apache.org wrote: Hey

Re: Review Request 37528: SAMZA-736 BrokerProxy will stuck in infinite loop if consumer.fetch throws OOME

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37528/ --- (Updated Aug. 18, 2015, 12:58 p.m.) Review request for samza. Changes

Re: Use one producer for both coordinator stream and users system?

Thanks Yan. I guess I am not very clear with the coordinatorStream concept before. -Tao On Tue, Aug 18, 2015 at 12:26 AM, Yan Fang yanfang...@gmail.com wrote: Hi Tao, First, one kafka producer has an i/o thread. (correct me if I am wrong). Second, after Samza 0.10.0, we have a coordinator

Re: Review Request 37528: SAMZA-736 BrokerProxy will stuck in infinite loop if consumer.fetch throws OOME

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37528/#review95817 ---

Re: Use one producer for both coordinator stream and users system?

Hi Yan, My (uneducated) guess is that the performance gains come from batching. I don't know if the new producer ever batches by destination broker. If not and it only batches by (broker,topic,partition) then I doubt that one vs two producers will affect performance as they send to different