Re: Review Request 33146: New KeyValueStore Features

2015-04-28 Thread Mohamed Mahmoud (El-Geish)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33146/#review81774 --- samza-kv/src/main/scala/org/apache/samza/storage/kv/SerializedKeyVa

Re: Review Request 33146: New KeyValueStore Features

2015-04-28 Thread Mohamed Mahmoud (El-Geish)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33146/ --- (Updated April 28, 2015, 10:20 a.m.) Review request for samza. Changes --

Re: Review Request 33146: New KeyValueStore Features

2015-04-28 Thread Mohamed Mahmoud (El-Geish)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33146/ --- (Updated April 28, 2015, 10:50 a.m.) Review request for samza. Changes --

Re: What next for streaming SQL?

2015-04-28 Thread Milinda Pathirage
Hi Julian, I am working on tumbling windows and hoping to have a look at other types of window aggregates next. I was trying to extract the window spec out from the aggregate operator (for tumbling window) and figure out that its impossible to infer tumbling window size from date time expressions

Re: Review Request 33146: New KeyValueStore Features

2015-04-28 Thread Mohamed Mahmoud (El-Geish)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33146/#review81837 --- I'm sorry for the spam of emails, but please wait until I analyze th

Re: Review Request 33453: SAMZA-557 Reuse local state in SamzaContainer on clean shutdown

2015-04-28 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33453/#review81838 --- Overall looks good to me. It would be nice to add unit tests as well

Re: Review Request 33453: SAMZA-557 Reuse local state in SamzaContainer on clean shutdown

2015-04-28 Thread Navina Ramesh
> On April 28, 2015, 5:43 p.m., Yi Pan (Data Infrastructure) wrote: > > samza-core/src/main/scala/org/apache/samza/container/SamzaContainer.scala, > > line 457 > > > > > > Question: shouldn't the base dir to be determ

Reminder: May 5: Apache Samza Meetup

2015-04-28 Thread Ed Yakabosky
Hi all - LinkedIn will be hosting an Apache Samza Meetup on May 5. Food and drinks will be provided so please RSVP on meetup.com if you plan to attend. The event will

Errors and hung job on broker shutdown

2015-04-28 Thread Roger Hoover
Hi, I need some help figuring out what's going on. I'm running Kafka 0.8.2.1 and Samza 0.9.0 on YARN. All the topics have replication factor of 2. I'm bouncing the Kafka broker using SIGTERM (with controlled.shutdown.enable=true). I see the Samza job log this message and then hang (does not ex

Re: Errors and hung job on broker shutdown

2015-04-28 Thread Yi Pan
Roger, could you paste the full log from Samza container? If you can figure out which Kafka broker the message was sent to, it would be helpful if we get the log from the broker as well. On Tue, Apr 28, 2015 at 3:31 PM, Roger Hoover wrote: > Hi, > > I need some help figuring out what's going on.

Re: Errors and hung job on broker shutdown

2015-04-28 Thread Roger Hoover
At error level logging, this was the only entry in the Samza log: 2015-04-28 14:28:25 KafkaSystemProducer [ERROR] task[Partition 2] ssp[kafka,svc.call.w_deploy.c7tH4YaiTQyBEwAAhQzRXw,2] offset[9129395] Unable to send message from TaskName-Partition 1 to system kafka Here is the log from the Kafka