Re: design a read-only data storage cluster

2013-12-21 Thread Damien Krotkine
On Sat, Dec 21, 2013, at 06:51 AM, Matthew Von-Maszewski wrote: On Dec 21, 2013, at 4:12 AM, Damien Krotkine <[1]dkrotk...@gmail.com> wrote: First option is to use leveldb as storage backend. And use an external script to expire (delete) keys that are too old (one of the secondary in

Re: design a read-only data storage cluster

2013-12-21 Thread Matthew Von-Maszewski
On Dec 21, 2013, at 4:12 AM, Damien Krotkine wrote: > First option is to use leveldb as storage backend. And use an external > script to expire (delete) keys that are too old (one of the secondary > index being the timestamp, it's easy). However it seems that deleted > keys in leveldb may not be

design a read-only data storage cluster

2013-12-21 Thread Damien Krotkine
Hi, I'm trying to use Riak for - basically - a short-lived data storage system. Here are my prerequisites: - keys will contain a timestamp and some properties. I can work on making them short - values will be binary blobs. From few bytes to few MB - values are read-only : once written they are ne