Re: Review Request 43732: Implemented AvroDataFileHdfsWriter

2016-03-03 Thread Edi Bice
fully. Thanks, Edi Bice

Re: Review Request 43732: Implemented AvroDataFileHdfsWriter

2016-03-02 Thread Edi Bice
essed millions of records successfully. Thanks, Edi Bice

Re: Review Request 43732: Implemented AvroDataFileHdfsWriter

2016-02-25 Thread Edi Bice
27;ve been using AvroDataFileHdfsWriter at the end of my pipeline. I feed the generated avro files to Apache Samoa. Have processed millions of records successfully. Thanks, Edi Bice

Re: Review Request 43732: Implemented AvroDataFileHdfsWriter and exposed several RocksDb config

2016-02-25 Thread Edi Bice
. The RocksDb config changes are older and were used and verified to be working when originally implemented. Thanks, Edi Bice

Re: Review Request 43732: Implemented AvroDataFileHdfsWriter and exposed several RocksDb config

2016-02-25 Thread Edi Bice
; samza-kv-rocksdb/src/main/java/org/apache/samza/storage/kv/RocksDbOptionsHelper.java, > > line 19 > > <https://reviews.apache.org/r/43732/diff/1/?file=1254934#file1254934line19> > > > > This does not seem to be relevant to the AvroDataFileW

Re: [DISCUSS] Moving to github/pull-request for code review and check-in

2016-02-18 Thread Edi Bice
Yay! > On Feb 18, 2016, at 7:25 PM, Navina Ramesh > wrote: > > +1 > > Haven't tried any contribution with pull requests. But sounds simpler than > attaching the patch to JIRA. > > Navina > >> On Thu, Feb 18, 2016 at 4:01 PM, Jacob Maes wrote: >> >> +1 >> >> As a relatively new contributor

Review Request 43732: Implemented AvroDataFileHdfsWriter and exposed several RocksDb config

2016-02-18 Thread Edi Bice
. Thanks, Edi Bice

Re: Compression type Snappy is not linked with the binary

2016-02-11 Thread Edi Bice
:41 AM, Edi Bice wrote: > Navina, > > It's not my code changes. I started off fresh on a different but similar > RHEL 6.6 box. > > Cloned and built latest from master and changed only gradle/dependencies > jackson 1.9.3 and yarn 2.7.1 (as I used to do since day 1 to get jo

Re: Compression type Snappy is not linked with the binary

2016-02-10 Thread Edi Bice
at org.apache.samza.storage.kv.RocksDbKeyValueStore$.openDB(RocksDbKeyValueStore.scala:81) Edi On Wed, Feb 10, 2016 at 9:41 AM, Edi Bice wrote: > Navina, > > I created a pull request some time back and it's still probably the > easiest way to see what I changed. Let me know if you still prefer a patch > file attachmen

Re: Compression type Snappy is not linked with the binary

2016-02-10 Thread Edi Bice
in the library that is causing this > issue. > > Navina > > On Tue, Feb 9, 2016 at 2:06 PM, Edi Bice wrote: > > > Hi Navina, > > > > I did indeed came across the long thread dealing with this. And yes, > things > > were working fine after the rocksdb

Re: Compression type Snappy is not linked with the binary

2016-02-09 Thread Edi Bice
Thanks! > Navina > > On Mon, Feb 8, 2016 at 6:33 AM, Edi Bice wrote: > > > I'm running the latest master with a small patch of mine allowing for > > additional RocksDb config options. I deleted ~/.m2 and gradle cache to > > avoid some issues I was running into

Compression type Snappy is not linked with the binary

2016-02-08 Thread Edi Bice
I'm running the latest master with a small patch of mine allowing for additional RocksDb config options. I deleted ~/.m2 and gradle cache to avoid some issues I was running into. After rebuilding Samza, I'm getting the following exception on all my jobs: org.apache.samza.SamzaException: Error open

Re: RocksDB LOG file rotation

2016-01-21 Thread Edi Bice
, Jan 4, 2016 at 7:20 AM, Edi Bice wrote: > > > I noticed that the LOG files in each RocksDB kv store grow indefinitely. > I > > could set them up via logrotate but it would be cumbersome and against > the > > grain. Tried to figure out if RocksDB has a configuration file a

RocksDB LOG file rotation

2016-01-04 Thread Edi Bice
I noticed that the LOG files in each RocksDB kv store grow indefinitely. I could set them up via logrotate but it would be cumbersome and against the grain. Tried to figure out if RocksDB has a configuration file and I don't have a definite answer yet (the one mention is for version 4.3). RocksDB