Re: Samza job having failed containers in YARN

2016-11-22 Thread Suraj choudhary
Hi Jagadish, Thanks for your response. *Question 1*: Do you write your output to kafka at all? (For example, is it possible for a message you write to an output topic to be more than 1M?) Yes, we write changelogs for RocksDB stores, metrics for monitoring purpose and offset checkpoints to

[GitHub] samza pull request #22: SAMZA-1050: Make samza-operator independent of avro ...

2016-11-22 Thread nickpan47
Github user nickpan47 closed the pull request at: https://github.com/apache/samza/pull/22 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] samza pull request #23: SAMZA-1051: Merge operator APIs to master

2016-11-22 Thread nickpan47
Github user nickpan47 closed the pull request at: https://github.com/apache/samza/pull/23 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Review Request 53826: added user document for Checkpoint callbacks

2016-11-22 Thread Boris Shkolnik
> On Nov. 22, 2016, 6:51 p.m., Prateek Maheshwari wrote: > > docs/learn/documentation/versioned/container/checkpointing.md, line 129 > > > > > > What does the "push system" mean? Maybe clarify/remove? done. > On

Re: Review Request 53826: added user document for Checkpoint callbacks

2016-11-22 Thread Prateek Maheshwari
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/53826/#review156607 --- Ship it! Looks good. Minor comments.

Re: Catching exceptions from serde

2016-11-22 Thread Jagadish Venkatraman
Hi Raj, You have an invalid JSON message in your input. When Samza tries to de-serialize the input from your source, it encountered a De-serialization error. If you are okay with dropping messages when there are ser-de errors, please take a look at : task.drop.deserialization.errors

Catching exceptions from serde

2016-11-22 Thread Raj raj
Hi, I am using json serde to receive json strings from kafka and automatically convert it to LinkedHashMap. I am using the following code fragment to achieve this: LinkedHashMap rawEvent = (LinkedHashMap) envelope.getMessage(); I am now getting an exception when