Re: Review Request 43350: SAMZA-867 Fix job restart/shutdown in the event of a node outage.

2016-02-15 Thread Jake Maes
> On Feb. 11, 2016, 10:50 p.m., Navina Ramesh wrote: > > samza-yarn/src/main/java/org/apache/samza/job/yarn/ContainerAllocator.java, > > line 57 > > > > > > Is there any particular reason for updating state within th

Review Request 43589: Avoid unnecessary flushes in CachedStore

2016-02-15 Thread Nicolas Maquet
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43589/ --- Review request for samza. Repository: samza Description --- The class `o

Re: Review Request 43589: Avoid unnecessary flushes in CachedStore

2016-02-15 Thread Nicolas Maquet
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43589/ --- (Updated Feb. 15, 2016, 9:54 p.m.) Review request for samza. Repository: samz

Re: Review Request 43350: SAMZA-867 Fix job restart/shutdown in the event of a node outage.

2016-02-15 Thread Jake Maes
> On Feb. 11, 2016, 10:50 p.m., Navina Ramesh wrote: > > samza-yarn/src/main/java/org/apache/samza/job/yarn/ContainerUtil.java, line > > 244 > > > > > > You can modify the "TaskConfig.scala" to add an overrid method

Re: Review Request 43589: Avoid unnecessary flushes in CachedStore

2016-02-15 Thread Nicolas Maquet
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43589/ --- (Updated Feb. 15, 2016, 10:01 p.m.) Review request for samza. Changes ---

ElasticsearchSystemProducer Crashes Samza Job

2016-02-15 Thread jeremiah adams
We have a samza job configured to run in a yarn cluster. This job consumes multiple kafka topics and routes the messages to elasticsearch for indexing. When enough batch-updates to elasticsearch fail using the ElasticsearchSystemProducer, the entire samza job dies. Due to checkpointing + yarn, the