Re: Pluggable storage engine discussion

2017-11-05 Thread Michael Burman
Hi, There's a ticket also for columnar storage option, which I guess is something that many might want. Not least because in many cases it could reduce the storage footprint by a large margin (and enable more sophisticated compression options), even if we discount the possible query advantage

Re: Pluggable storage engine discussion

2017-11-03 Thread Dikang Gu
Hi Stefan, Yeah, my team has been working for 6+ months on the development and testing of the RocksDB based storage engine, and we are in the process of rolling it out to our production deployment inside Instagram! We see huge gains in reducing the latency and footprint of our Cassandra clusters.

Re: Pluggable storage engine discussion

2017-11-03 Thread Stefan Podkowinski
Hi Dikang Have you been able to continue evaluating RocksDB? I'm afraid we might be a bit too much ahead in the discussion by already talking about a pluggable architecture, while we haven't fully evaluated yet if we can and want to support an alternative RocksDB engine implementation at all. Beca

Pluggable storage engine discussion

2017-11-03 Thread Dikang Gu
Hi, We are having discussions about the pluggable storage engine plan on the jira: https://issues.apache.org/jira/browse/CASSANDRA-13475. We are trying to figure out a plan for the pluggable storage engine effort. Right now, the discussion is mainly happening between couple C* committers, like Bl