Re: Samza 0.12.0 + synchronous KafkaProducer ?

Hi Jagadish, Thank you for very quick and detailed response. We have already set the task.commit.ms = -1 and are using the checkpointing mechanism to accumulate some work in memory in order to do it more efficiently in batches. So the flow is

Re: Multi task Container Starvation

We can certainly help you debug this more. Some questions: 1. Are you processing messages (at all) from the "suffering" containers? (You can verify that by observing metrics/ logging etc.) 2. If you are indeed processing messages, is it possible the impacted containers not able to keep up with

Re: Samza 0.12.0 + synchronous KafkaProducer ?

(correcting recipient address) On Thu, Mar 9, 2017 at 10:39 AM, Gaurav Agarwal wrote: > Hi All, > > We are trying to upgrade to Kafka 0.12.0. In the process we noticed that > the Kafka 0.10.0 KafkaProducer client api does not provide any > configuration to send() the

Samza 0.12.0 + synchronous KafkaProducer ?

Hi All, We are trying to upgrade to Kafka 0.12.0. In the process we noticed that the Kafka 0.10.0 KafkaProducer client api does not provide any configuration to send() the messages synchronously. One needs to wait on the returned Future for synchronous guarantees. I am trying to figure out, how

[GitHub] samza pull request #77: SAMZA-1124:Job coordinator with time out

Github user asfgit closed the pull request at: https://github.com/apache/samza/pull/77 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Multi task Container Starvation

Hi, While joining streams from 2 partitions to join 2 streams, we see that some containers start suffering in that, lag (messages behind high watermark) for one of the tasks starts sky rocketing while the other one is ~ 0. We are using default values for buffer sizes, fetch threshold, are

[GitHub] samza pull request #69: Samza 1114

Github user renato2099 closed the pull request at: https://github.com/apache/samza/pull/69 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] samza pull request #79: Samza 1123: Create intermediate stream in partitionB...

GitHub user xinyuiscool opened a pull request: https://github.com/apache/samza/pull/79 Samza 1123: Create intermediate stream in partitionBy() operator For partitionBy() operator, Samza generates an intermediate stream with id based on operator name and id, and system based on

Re: hm...What's wrong with it?

Hi there, Could you post your images somewhere else please? they can't be displayed, or at least I can't see them. Anyway, which gradle version are you using? It has to be 2.8 Best, Renato M. 2017-03-08 10:29 GMT+01:00 wu shaodong : > Hi > > I’m download

hm...What's wrong with it?

Hi I’m download samza git codes. Run gralde clean build in local faild! [cid:image001.png@01D29831.7E81A210] FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':samza-core_2.11:compileScala'. > Compilation failed * Try: Run with

[GitHub] samza pull request #78: SAMZA-1121: StreamAppender should not propagate exce...

Github user asfgit closed the pull request at: https://github.com/apache/samza/pull/78 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is