Samza hdfs

2015-11-10 Thread Aram Mkrtchyan
Hi guys, We are considering to move from spark streaming to Samza and we want to use samza as our main stream processor. We would like to know when you are planning to release 0.10.0 and will samza-hdfs be included in that release. Thanks.

Re: How to set up RocksDB

2015-11-10 Thread Lukáš Havrlant
Hi, I managed to start Samza after all. I am not sure what has helped eventually. But still I had to create a folder /opt/samza/state (/opt/samza is Samza's Home folder) and I don't want to have this folder there. Is there any option for it? I looked at the configuration page ( http://samza.apache.

Re: How to set up RocksDB

2015-11-10 Thread Navina Ramesh
Hi Lukas, My reply to your question was stuck in draft.. :( Pasting it below just for reference. You are right. I guess your option is to create a symlink. *Thanks for clarifying that you are not using Yarn. * *In Samza container implementation, we don't seem to allow any configuration related to

Re: Samza hdfs

2015-11-10 Thread Yi Pan
Hi, Aram, Welcome to the community! :) We are planning to release 0.10 in this month and YES HDFS producer is included in this release! -Yi On Tue, Nov 10, 2015 at 3:18 AM, Aram Mkrtchyan < aram.mkrtch...@picsart.com.invalid> wrote: > Hi guys, > > We are considering to move from spark streaming

Re: Unable to submit Samza job into YARN RM

2015-11-10 Thread Yi Pan
Hi, Raja, OK. Unfortunately, we are quite busy working on a release now. We may be able to get back to this patch sometime next month. In the meantime, applying the patch to test out the feature should not be too hard. You should give it a try. If you encounter any problems, we are more than happ

Re: Samza hdfs

2015-11-10 Thread Aram Mkrtchyan
Hi Yi, Many thanks! :) It's wonderful ! We really need samza-hdfs module. Thanks to samza being very simple we have been able to create cassandra producer for samza and we can share it if you think it's will be useful for others. Thanks. On Wed, Nov 11, 2015 at 9:13 AM, Yi Pan wrote: > Hi, Aram

Re: Samza hdfs

2015-11-10 Thread Bae, Jae Hyeon
Hi Aram May I know why you're moving off from Spark streaming to Samza? On Tue, Nov 10, 2015 at 11:04 PM, Aram Mkrtchyan < aram.mkrtch...@picsart.com.invalid> wrote: > Hi Yi, > Many thanks! :) > It's wonderful ! We really need samza-hdfs module. > Thanks to samza being very simple we have been a

Re: Review Request 40106: SAMZA-812 CachedStore flushes too often

2015-11-10 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/40106/#review106023 --- samza-kv/src/test/scala/org/apache/samza/storage/kv/TestCachedStor