Hi Jagadish,
Thank you for very quick and detailed response.
We have already set the task.commit.ms = -1 and are using the checkpointing
mechanism to accumulate some work in memory in order to do it more
efficiently in batches. So the flow is
process->process->->doWork()->checkpoint->process.
Gaurav,
I really appreciate your diligent walkthrough of the code base. Please find
my replies inline.
*>> I am trying to figure out, how to make our Samza task processing
strictly ordered *
By default, Samza offers you guaranteed in-order atleast-once processing
out-of the box (same semantics a
We can certainly help you debug this more. Some questions:
1. Are you processing messages (at all) from the "suffering" containers?
(You can verify that by observing metrics/ logging etc.)
2. If you are indeed processing messages, is it possible the impacted
containers not able to keep up with th
(correcting recipient address)
On Thu, Mar 9, 2017 at 10:39 AM, Gaurav Agarwal
wrote:
> Hi All,
>
> We are trying to upgrade to Kafka 0.12.0. In the process we noticed that
> the Kafka 0.10.0 KafkaProducer client api does not provide any
> configuration to send() the messages synchronously. One
Hi All,
We are trying to upgrade to Kafka 0.12.0. In the process we noticed that
the Kafka 0.10.0 KafkaProducer client api does not provide any
configuration to send() the messages synchronously. One needs to wait on
the returned Future for synchronous guarantees.
I am trying to figure out, how t
Github user asfgit closed the pull request at:
https://github.com/apache/samza/pull/77
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enable
Hi,
While joining streams from 2 partitions to join 2 streams, we see that some
containers start suffering in that, lag (messages behind high watermark) for
one of the tasks starts sky rocketing while the other one is ~ 0.
We are using default values for buffer sizes, fetch threshold, are using
Github user renato2099 closed the pull request at:
https://github.com/apache/samza/pull/69
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is en
GitHub user xinyuiscool opened a pull request:
https://github.com/apache/samza/pull/79
Samza 1123: Create intermediate stream in partitionBy() operator
For partitionBy() operator, Samza generates an intermediate stream with id
based on operator name and id, and system based on confi
Hi there,
Could you post your images somewhere else please? they can't be displayed,
or at least I can't see them.
Anyway, which gradle version are you using? It has to be 2.8
Best,
Renato M.
2017-03-08 10:29 GMT+01:00 wu shaodong :
> Hi
>
> I’m download samza git codes. Run gralde c
Hi
I’m download samza git codes. Run gralde clean build in local faild!
[cid:image001.png@01D29831.7E81A210]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':samza-core_2.11:compileScala'.
> Compilation failed
* Try:
Run with --inf
Github user asfgit closed the pull request at:
https://github.com/apache/samza/pull/78
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enable
12 matches
Mail list logo