[
https://issues.apache.org/jira/browse/SAMZA-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14050495#comment-14050495
]
Chinmay Soman commented on SAMZA-256:
-------------------------------------
The high level plan of action is the following:
* Create a trait which encapsulates the common functionality while creating a
key-value storage engine factory.
* Create additional modules for LevelDB/RocksDB/... that use this trait and
pass the appropriate key value store. The In-memory KV store can reside within
samza-kv module
* Modify Samza container (I think) to map something like:
org.apache.samza.storage.kv.KeyValueStorageEngineFactory =>
org.apache.samza.storage.kv.LevelDBKeyValueStorageEngineFactory
This is to maintain backwards compatibility.
> Provide in-memory data store implementation
> -------------------------------------------
>
> Key: SAMZA-256
> URL: https://issues.apache.org/jira/browse/SAMZA-256
> Project: Samza
> Issue Type: Improvement
> Components: kv
> Affects Versions: 0.6.0
> Reporter: Jakob Homan
> Assignee: Chinmay Soman
> Fix For: 0.8.0
>
>
> The sole current kv store, LevelDbKeyValueStore, works well when the amount
> of data to be stored is prohibitively large to keep it all in memory.
> However, in cases where the state is small enough to comfortably fit in
> whatever memory is available, it would be better to provide an in-memory
> implementation. This can be backed by either a native Java class, or perhaps
> a Guava class, if that is found to scale better (or, of course, the backing
> implementation could be configurable).
--
This message was sent by Atlassian JIRA
(v6.2#6252)
