[ 
https://issues.apache.org/jira/browse/SAMZA-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150052#comment-14150052
 ] 

Naveen commented on SAMZA-236:
------------------------------

Hey [~criccomini], I will add a patch to the ticket as well. As per the build, 
that's weird, I don't see it the repository as well, but a quick google search 
shows me that those options did exist.
https://github.com/vpallabs/vpal/blob/master/src/rocksdb/java/RocksDBSample.java
{code}
    Filter filter = new BloomFilter(10);
    options.setCreateIfMissing(true)
        .createStatistics()
        .setWriteBufferSize(8 * SizeUnit.KB)
        .setMaxWriteBufferNumber(3)
        .setDisableSeekCompaction(true)
        .setBlockSize(64 * SizeUnit.KB)
        .setMaxBackgroundCompactions(10)
        .setFilter(filter);
    Statistics stats = options.statisticsPtr();

    assert(options.createIfMissing() == true);
    assert(options.writeBufferSize() == 8 * SizeUnit.KB);
    assert(options.maxWriteBufferNumber() == 3);
    assert(options.disableSeekCompaction() == true);
    assert(options.blockSize() == 64 * SizeUnit.KB);
    assert(options.maxBackgroundCompactions() == 10);
{code}

Let me check if they have changed anything in the master.

> Switch samza-kv to use RocksDB
> ------------------------------
>
>                 Key: SAMZA-236
>                 URL: https://issues.apache.org/jira/browse/SAMZA-236
>             Project: Samza
>          Issue Type: Bug
>          Components: kv
>    Affects Versions: 0.6.0
>            Reporter: Chris Riccomini
>            Assignee: Naveen
>             Fix For: 0.8.0
>
>
> The samza-kv implementation is currently using LevelDB. RocksDB seems to have 
> a number of interesting options that would be useful to Samza:
> # Ability to swap out skip list for a faster implementation when restoring 
> data from a changelog stream.
> # Ability to disable compaction during changelog stream restoration.
> # Ability to have a single level (or single SST) rather than multiple levels 
> in order to reduce read amplification.
> # A merge operation for doing lazy read-modify-write during compaction.
> And a lot more.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to