Review Request 40572: SAMZA-614 - Document coordinator stream

2015-11-20 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/40572/ --- Review request for samza, Boris Shkolnik, Yan Fang, Chris Riccomini, Jagadish Ve

Re: Review Request 40525: SAMZA-819: RocksDbKeyValueStore.flush() should be implemented

2015-11-20 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/40525/#review107431 --- Ship it! Ship It! - Navina Ramesh On Nov. 20, 2015, 8:20 a.m.,

Re: Review Request 40525: SAMZA-819: RocksDbKeyValueStore.flush() should be implemented

2015-11-20 Thread Navina Ramesh
> On Nov. 20, 2015, 6:53 a.m., Yi Pan (Data Infrastructure) wrote: > > samza-kv-rocksdb/src/test/scala/org/apache/samza/storage/kv/TestRocksDbKeyValueStore.scala, > > line 84 > > > > > > To make sure that it is flush

Re: Sample code or tutorial for writing/reading Avro type message in Samza

2015-11-20 Thread Selina Tech
Hi, Luis: Thanks a lot for your reply!. Sincerely, Selina On Fri, Nov 20, 2015 at 12:09 PM, Luis Casillas < luis.casil...@progressfin.com> wrote: > > We haven’t seriously considered Protocol Buffers. In general the tools > we’re interested in have better support for Avro than for protob

Re: Sample code or tutorial for writing/reading Avro type message in Samza

2015-11-20 Thread Luis Casillas
We haven’t seriously considered Protocol Buffers. In general the tools we’re interested in have better support for Avro than for protobuf; Avro was designed for storing data in big-data storage like HDFS, and many tools for analyzing such data have taken it up. For example Hive comes with Avr

Re: Error restoring kv store

2015-11-20 Thread Rick Mangi
So I left it running in this state for 15 minutes and then it started up. Usually the app takes about 10 seconds to initialize. > On Nov 20, 2015, at 10:23 AM, Rick Mangi wrote: > > Just started getting this error this morning. On startup the consumer trying > to reload the kv-store changelog

Error restoring kv store

2015-11-20 Thread Rick Mangi
Just started getting this error this morning. On startup the consumer trying to reload the kv-store changelog starts throwing this exception and keeps restarting and failing. 2015-11-20 10:16:19 [main] TaskStorageManager [DEBUG] Stopping consumers for stores. 2015-11-20 10:16:19 [main] Broker

Re: Sample code or tutorial for writing/reading Avro type message in Samza

2015-11-20 Thread Selina Tech
Hi, Luis: Thanks a lot for your detail reply with your codes and link of Avro schema registry. May I have a question, have you considered protocol buffer as your message type? Sincerely, Selina On Thu, Nov 19, 2015 at 2:22 PM, Luis Casillas < luis.casil...@progressfin.com> wrote

Re: Sample code or tutorial for writing/reading Avro type message in Samza

2015-11-20 Thread Selina Tech
Hi, Roger: I was looking for schema registry without Confluent. After the investigation for a while. Look like that Confluent's schema registry is a only way. I will study your code for sure. Thanks a lot. Sincerely, Selina On Tue, Nov 17, 2015 at 1:15 AM, Roger Hoover wrote: > Hi S

Re: Review Request 40472: SAMZA-816: avoid creating and registering CoordinatorSystemConsumer in LocalityManager in SamzaContainer

2015-11-20 Thread Yi Pan (Data Infrastructure)
> On Nov. 19, 2015, 10:31 p.m., Navina Ramesh wrote: > > samza-core/src/main/java/org/apache/samza/container/LocalityManager.java, > > line 86 > > > > > > Can you add some comment/javadoc explain which components can

Re: Review Request 40525: SAMZA-819: RocksDbKeyValueStore.flush() should be implemented

2015-11-20 Thread Yi Pan (Data Infrastructure)
> On Nov. 20, 2015, 6:53 a.m., Yi Pan (Data Infrastructure) wrote: > > samza-kv-rocksdb/src/test/scala/org/apache/samza/storage/kv/TestRocksDbKeyValueStore.scala, > > line 84 > > > > > > To make sure that it is flush

Re: Review Request 40525: SAMZA-819: RocksDbKeyValueStore.flush() should be implemented

2015-11-20 Thread tao feng
> On Nov. 20, 2015, 6:53 a.m., Yi Pan (Data Infrastructure) wrote: > > samza-kv-rocksdb/src/test/scala/org/apache/samza/storage/kv/TestRocksDbKeyValueStore.scala, > > line 84 > > > > > > To make sure that it is flush

Re: Review Request 40525: SAMZA-819: RocksDbKeyValueStore.flush() should be implemented

2015-11-20 Thread tao feng
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/40525/ --- (Updated Nov. 20, 2015, 8:20 a.m.) Review request for samza. Repository: samz