Review Request 43244: support elasticsearch version 2.x

2016-02-05 Thread Jiri Humpolicek
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43244/ --- Review request for samza. Repository: samza Description --- Samza elasti

Re: ChangeLog Question for TTL rocksDB stores

2016-02-05 Thread Tao Feng
Hi David, My understanding is that Samza changelog could still be logging those entries deleted by RocksDB TTL. You could refer to SAMZA-677 for more information. Thanks, -Tao On Wed, Feb 3, 2016 at 5:46 PM, David Garcia wrote: > Boris, thank you for the clarification. But just to make sure I

Re: Samza Throttling clarification

2016-02-05 Thread Benjamin Edwards
Recommend token bukets! Here is a solid implementation: https://github.com/bbeck/token-bucket On Fri, 5 Feb 2016 at 03:33 Jagadish Venkatraman wrote: > Hi Ramesh, > > I understand that you want to limit the calls to the destination service. > Currently, there's no framework level support for thr

Help to vote on Samza talks in HadoopSummit

2016-02-05 Thread Yi Pan
Hi, all Samza lovers, We recently submit a talk on Samza to Hadoop Summit this year. If you are interested in seeing this talk in the conference, please help to vote on the talk: https://hadoopsummit.uservoice.com/forums/344973-iot-and-streaming/suggestions/11665164-lambda-less-stream-processing-s

Re: Review Request 43074: SAMZA-866 Refactor and fix Container allocation logic.

2016-02-05 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43074/#review118073 --- Ship it! samza-yarn/src/main/java/org/apache/samza/job/yarn/Co

Re: Review Request 43053: allow warning instead of fail in case of invalid num of partitions in the checkpoint partition

2016-02-05 Thread Boris Shkolnik
> On Feb. 3, 2016, 2:36 a.m., Jagadish Venkatraman wrote: > > samza-kafka/src/test/scala/org/apache/samza/checkpoint/kafka/TestKafkaCheckpointManager.scala, > > line 84 > > > > > > nit: failOnTopicValidation. tnx, f

Re: Review Request 43053: allow warning instead of fail in case of invalid num of partitions in the checkpoint partition

2016-02-05 Thread Boris Shkolnik
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43053/ --- (Updated Feb. 5, 2016, 9:46 p.m.) Review request for samza. Changes ---

Re: Review Request 43053: allow warning instead of fail in case of invalid num of partitions in the checkpoint partition

2016-02-05 Thread Boris Shkolnik
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43053/ --- (Updated Feb. 5, 2016, 9:48 p.m.) Review request for samza. Bugs: SAMZA-864

Re: Review Request 43074: SAMZA-866 Refactor and fix Container allocation logic.

2016-02-05 Thread Jagadish Venkatraman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43074/#review118101 --- Ship it! Ship It! - Jagadish Venkatraman On Feb. 3, 2016, 8:

Re: Need Help with Samza - Changelog System

2016-02-05 Thread Ramesh Bhojan
Jason, Can we please share more information about the exact stack trace and the job configuration, especially the Kafka producer configuration for the changelog system, as requested by Yi Pan? Regards, Ramesh On Thu, Feb 4, 2016 at 11:56 AM, Ramesh Bhojan wrote: > Dear team @ Samza, > I would r

Re: Need Help with Samza - Changelog System

2016-02-05 Thread Jason Erickson
Is the Kafka producer configuration different than the Samza configuration of the Samza task that references the store? If not, here is are those configuration values. The changelog in question is resourceStore-changelog. # Job job.factory.class=org.apache.samza.job.local.ThreadJobFactory job.nam

Re: Need Help with Samza - Changelog System

2016-02-05 Thread Jagadish Venkatraman
Hey Jason, Can you share the entire container log? It will be useful to find out what went wrong. If this is a non-yarn, it will be also useful if you share the JobRunner logs. Thanks, Jagadish On Fri, Feb 5, 2016 at 4:33 PM, Jason Erickson wrote: > Is the Kafka producer configuration differen

Re: Need Help with Samza - Changelog System

2016-02-05 Thread Jagadish Venkatraman
Another pointer is to run the job with DEBUG level turned on and share the logs with us. On Fri, Feb 5, 2016 at 5:05 PM, Jagadish Venkatraman wrote: > Hey Jason, > > Can you share the entire container log? It will be useful to find out what > went wrong. > If this is a non-yarn, it will be also