Review Request 38949: SAMZA-341: Support metrics report via Ganglia

2015-10-02 Thread Aleksandar Pejakovic
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38949/ --- Review request for samza. Repository: samza-hello-samza Description ---

How to synchronize KeyValueStore and Kafka cleanup

2015-10-02 Thread Bae, Jae Hyeon
Hi Samza devs and users This is my first try with KeyValueStore and I am really excited! I glanced through TaskStorageManager source code, it looks creates consumers for stores and I am wondering that how kafka cleanup will be propagated to KeyValueStore. My KeyValueStore usage is a little bit

Review Request 38966: SAMZA-786: Improve reliability of multithreaded host affinity tests.

2015-10-02 Thread Jake Maes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38966/ --- Review request for samza, Navina Ramesh and Yi Pan (Data Infrastructure).

Re: How to synchronize KeyValueStore and Kafka cleanup

2015-10-02 Thread Bae, Jae Hyeon
I found the following statement from Samza documentation: "Periodically the job scans over both stores and deletes any old events that were not matched within the time window of the join." It seems that I have to manually implement purging KeyValueStore, did I understand correctly? On Fri, Oct

Re: How to synchronize KeyValueStore and Kafka cleanup

2015-10-02 Thread Bae, Jae Hyeon
Thanks Yi Pan, I have one more question. Does KV-store consume automatically from a Kafka topic? Does it consume only on restore()? If so, do I have to implement the StreamTask job to consume a Kafka topic and call add() method? On Fri, Oct 2, 2015 at 2:01 PM, Yi Pan wrote:

Samza and KStreams (KIP-28): LinkedIn's POV

2015-10-02 Thread Yi Pan
Hi, all Samza-lovers, This question on the relationship of Kafka KStream (KIP-28) and Samza has come up a couple times recently. So we wanted to clarify where we stand at LinkedIn in terms of this discussion. Samza has historically had a symbiotic relationship with Kafka and will continue to

Re: How to synchronize KeyValueStore and Kafka cleanup

2015-10-02 Thread Chinmay Soman
> Does KV-store consume automatically from a Kafka topic? Yes - if you've configured changelog stream for your store > Does it consume only on restore()? It consumes only during container initialization (again, assuming if you have changelog configured) > implement the StreamTask job to consume