Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
I think there is a very important point in Scylladb - latency. Performance can be an important requirement, but the fact scylladb is written in C and uses lock free algorithms inside means it should have lower latency than Cassandra, which enables it's use for a wider range of applications. It seems like a huge milestone achieved by Cassandra community, congratulations! From: user@cassandra.apache.org Subject: Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL Looking at the architecture and what scylladb does, I'm not surprised they got 10x improvement. SeaStar skips a lot of the overhead of copying stuff and it gives them CPU core affinity. Anyone that's listened to Clif Click talk about cache misses, locks and other low level stuff would recognize the huge boost in performance when many of those bottlenecks are removed. Using an actor model to avoid locks doesn't hurt either. On Tue, Sep 22, 2015 at 5:20 PM, Minh Do <m...@netflix.com> wrote: First glance at their github, it looks like they re-implemented Cassandra in C++. 90% components in Cassandra are in scylladb, i.e. compaction, repair, CQL, gossip, SStable. With C++, I believe this helps performance to some extent up to a point when compaction has not run yet. Then, it will be disk IO to be the dominant factor in the performance measurement as the more traffics to a node the more degrading the performance is across the cluster. Also, they only support Thrift protocol so it won't work with Java Driver with the new asynchronous protocol. I doubt their tests are truly a fair one. On Tue, Sep 22, 2015 at 2:13 PM, Venkatesh Arivazhagan <venkey.a...@gmail.com> wrote: I came across this article: zdnet.com/article/kvm-creators-open-source-fast-cassandra-drop-in-replacement-scylla/ Tzach, I would love to know/understand moree about ScyllaDB too. Also the benchmark seems to have only 1 DB Server. Do you have benchmark numbers where more than 1 DB servers were involved? :) On Tue, Sep 22, 2015 at 1:40 PM, Sachin Nikam <skni...@gmail.com> wrote: Tzach, Can you point to any documentation on scylladb site which talks about how/why scylla db performs better than Cassandra while using the same architecture? Regards Sachin On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan <tz...@cloudius-systems.com> wrote: Hello Cassandra users, We are pleased to announce a new member of the Cassandra Ecosystem - ScyllaDB ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, written with the goal of delivering superior performance and consistent low latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. ScyllaDB supports CQL, is compatible with Cassandra drivers, and works out of the box with Cassandra tools like cqlsh, Spark connector, nodetool and cassandra-stress. ScyllaDB is a drop-in replacement solution for the Cassandra server side packages. Scylla is implemented using the new shared-nothing Seastar framework for extreme performance on modern multicore hardware, and the Data Plane Development Kit (DPDK) for high-speed low-latency networking. Try Scylla Now - http://www.scylladb.com We will be at Cassandra summit 2015, you are welcome to visit our booth to hear more and see a demo. Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM - 2:30 PM in rooms M1 - M3. Regards Tzach scylladb << ideas dont deserve respect >>
Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
Looking at the architecture and what scylladb does, I'm not surprised they got 10x improvement. SeaStar skips a lot of the overhead of copying stuff and it gives them CPU core affinity. Anyone that's listened to Clif Click talk about cache misses, locks and other low level stuff would recognize the huge boost in performance when many of those bottlenecks are removed. Using an actor model to avoid locks doesn't hurt either. On Tue, Sep 22, 2015 at 5:20 PM, Minh Do <m...@netflix.com> wrote: > First glance at their github, it looks like they re-implemented Cassandra > in C++. 90% components in Cassandra are > in scylladb, i.e. compaction, repair, CQL, gossip, SStable. > > > With C++, I believe this helps performance to some extent up to a point > when compaction has not run yet. > Then, it will be disk IO to be the dominant factor in the performance > measurement as the more traffics to a node the more degrading > the performance is across the cluster. > > Also, they only support Thrift protocol so it won't work with Java Driver > with the new asynchronous protocol. I doubt their tests > are truly a fair one. > > On Tue, Sep 22, 2015 at 2:13 PM, Venkatesh Arivazhagan < > venkey.a...@gmail.com> wrote: > >> I came across this article: >> zdnet.com/article/kvm-creators-open-source-fast-cassandra-drop-in-replacement-scylla/ >> >> Tzach, I would love to know/understand moree about ScyllaDB too. Also the >> benchmark seems to have only 1 DB Server. Do you have benchmark numbers >> where more than 1 DB servers were involved? :) >> >> >> On Tue, Sep 22, 2015 at 1:40 PM, Sachin Nikam <skni...@gmail.com> wrote: >> >>> Tzach, >>> Can you point to any documentation on scylladb site which talks about >>> how/why scylla db performs better than Cassandra while using the same >>> architecture? >>> Regards >>> Sachin >>> >>> On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan < >>> tz...@cloudius-systems.com> wrote: >>> >>>> Hello Cassandra users, >>>> >>>> We are pleased to announce a new member of the Cassandra Ecosystem - >>>> ScyllaDB >>>> ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, >>>> written with the goal of delivering superior performance and consistent low >>>> latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. >>>> >>>> ScyllaDB supports CQL, is compatible with Cassandra drivers, and works >>>> out of the box with Cassandra tools like cqlsh, Spark connector, nodetool >>>> and cassandra-stress. ScyllaDB is a drop-in replacement solution for the >>>> Cassandra server side packages. >>>> >>>> Scylla is implemented using the new shared-nothing Seastar >>>> <http://www.seastar-project.org/> framework for extreme performance on >>>> modern multicore hardware, and the Data Plane Development Kit (DPDK) for >>>> high-speed low-latency networking. >>>> >>>> Try Scylla Now - http://www.scylladb.com >>>> >>>> We will be at Cassandra summit 2015, you are welcome to visit our booth >>>> to hear more and see a demo. >>>> Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM >>>> - 2:30 PM in rooms M1 - M3. >>>> >>>> Regards >>>> Tzach >>>> scylladb >>>> >>>> >>> >> >
Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
Tzach, Can you point to any documentation on scylladb site which talks about how/why scylla db performs better than Cassandra while using the same architecture? Regards Sachin On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan <tz...@cloudius-systems.com> wrote: > Hello Cassandra users, > > We are pleased to announce a new member of the Cassandra Ecosystem - > ScyllaDB > ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, > written with the goal of delivering superior performance and consistent low > latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. > > ScyllaDB supports CQL, is compatible with Cassandra drivers, and works > out of the box with Cassandra tools like cqlsh, Spark connector, nodetool > and cassandra-stress. ScyllaDB is a drop-in replacement solution for the > Cassandra server side packages. > > Scylla is implemented using the new shared-nothing Seastar > <http://www.seastar-project.org/> framework for extreme performance on > modern multicore hardware, and the Data Plane Development Kit (DPDK) for > high-speed low-latency networking. > > Try Scylla Now - http://www.scylladb.com > > We will be at Cassandra summit 2015, you are welcome to visit our booth to > hear more and see a demo. > Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM - > 2:30 PM in rooms M1 - M3. > > Regards > Tzach > scylladb > >
Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
First glance at their github, it looks like they re-implemented Cassandra in C++. 90% components in Cassandra are in scylladb, i.e. compaction, repair, CQL, gossip, SStable. With C++, I believe this helps performance to some extent up to a point when compaction has not run yet. Then, it will be disk IO to be the dominant factor in the performance measurement as the more traffics to a node the more degrading the performance is across the cluster. Also, they only support Thrift protocol so it won't work with Java Driver with the new asynchronous protocol. I doubt their tests are truly a fair one. On Tue, Sep 22, 2015 at 2:13 PM, Venkatesh Arivazhagan < venkey.a...@gmail.com> wrote: > I came across this article: > zdnet.com/article/kvm-creators-open-source-fast-cassandra-drop-in-replacement-scylla/ > > Tzach, I would love to know/understand moree about ScyllaDB too. Also the > benchmark seems to have only 1 DB Server. Do you have benchmark numbers > where more than 1 DB servers were involved? :) > > > On Tue, Sep 22, 2015 at 1:40 PM, Sachin Nikam <skni...@gmail.com> wrote: > >> Tzach, >> Can you point to any documentation on scylladb site which talks about >> how/why scylla db performs better than Cassandra while using the same >> architecture? >> Regards >> Sachin >> >> On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan < >> tz...@cloudius-systems.com> wrote: >> >>> Hello Cassandra users, >>> >>> We are pleased to announce a new member of the Cassandra Ecosystem - >>> ScyllaDB >>> ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, >>> written with the goal of delivering superior performance and consistent low >>> latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. >>> >>> ScyllaDB supports CQL, is compatible with Cassandra drivers, and works >>> out of the box with Cassandra tools like cqlsh, Spark connector, nodetool >>> and cassandra-stress. ScyllaDB is a drop-in replacement solution for the >>> Cassandra server side packages. >>> >>> Scylla is implemented using the new shared-nothing Seastar >>> <http://www.seastar-project.org/> framework for extreme performance on >>> modern multicore hardware, and the Data Plane Development Kit (DPDK) for >>> high-speed low-latency networking. >>> >>> Try Scylla Now - http://www.scylladb.com >>> >>> We will be at Cassandra summit 2015, you are welcome to visit our booth >>> to hear more and see a demo. >>> Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM >>> - 2:30 PM in rooms M1 - M3. >>> >>> Regards >>> Tzach >>> scylladb >>> >>> >> >
Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
I came across this article: zdnet.com/article/kvm-creators-open-source-fast-cassandra-drop-in-replacement-scylla/ Tzach, I would love to know/understand moree about ScyllaDB too. Also the benchmark seems to have only 1 DB Server. Do you have benchmark numbers where more than 1 DB servers were involved? :) On Tue, Sep 22, 2015 at 1:40 PM, Sachin Nikam <skni...@gmail.com> wrote: > Tzach, > Can you point to any documentation on scylladb site which talks about > how/why scylla db performs better than Cassandra while using the same > architecture? > Regards > Sachin > > On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan < > tz...@cloudius-systems.com> wrote: > >> Hello Cassandra users, >> >> We are pleased to announce a new member of the Cassandra Ecosystem - >> ScyllaDB >> ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, >> written with the goal of delivering superior performance and consistent low >> latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. >> >> ScyllaDB supports CQL, is compatible with Cassandra drivers, and works >> out of the box with Cassandra tools like cqlsh, Spark connector, nodetool >> and cassandra-stress. ScyllaDB is a drop-in replacement solution for the >> Cassandra server side packages. >> >> Scylla is implemented using the new shared-nothing Seastar >> <http://www.seastar-project.org/> framework for extreme performance on >> modern multicore hardware, and the Data Plane Development Kit (DPDK) for >> high-speed low-latency networking. >> >> Try Scylla Now - http://www.scylladb.com >> >> We will be at Cassandra summit 2015, you are welcome to visit our booth >> to hear more and see a demo. >> Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM - >> 2:30 PM in rooms M1 - M3. >> >> Regards >> Tzach >> scylladb >> >> >
Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
On Wed, Sep 23, 2015 at 12:20 AM, Minh Do <m...@netflix.com> wrote: > First glance at their github, it looks like they re-implemented Cassandra > in C++. 90% components in Cassandra are > in scylladb, i.e. compaction, repair, CQL, gossip, SStable. > True > > > With C++, I believe this helps performance to some extent up to a point > when compaction has not run yet. > Then, it will be disk IO to be the dominant factor in the performance > measurement as the more traffics to a node the more degrading > the performance is across the cluster. > Also, they only support Thrift protocol so it won't work with Java Driver > with the new asynchronous protocol. I doubt their tests > are truly a fair one. > Scylla currently only support CQL For more info, I suggest to continue the discussion at the new Scylla list https://groups.google.com/forum/#!forum/scylladb-users > > On Tue, Sep 22, 2015 at 2:13 PM, Venkatesh Arivazhagan < > venkey.a...@gmail.com> wrote: > >> I came across this article: >> zdnet.com/article/kvm-creators-open-source-fast-cassandra-drop-in-replacement-scylla/ >> >> Tzach, I would love to know/understand moree about ScyllaDB too. Also the >> benchmark seems to have only 1 DB Server. Do you have benchmark numbers >> where more than 1 DB servers were involved? :) >> >> >> On Tue, Sep 22, 2015 at 1:40 PM, Sachin Nikam <skni...@gmail.com> wrote: >> >>> Tzach, >>> Can you point to any documentation on scylladb site which talks about >>> how/why scylla db performs better than Cassandra while using the same >>> architecture? >>> Regards >>> Sachin >>> >>> On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan < >>> tz...@cloudius-systems.com> wrote: >>> >>>> Hello Cassandra users, >>>> >>>> We are pleased to announce a new member of the Cassandra Ecosystem - >>>> ScyllaDB >>>> ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, >>>> written with the goal of delivering superior performance and consistent low >>>> latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. >>>> >>>> ScyllaDB supports CQL, is compatible with Cassandra drivers, and works >>>> out of the box with Cassandra tools like cqlsh, Spark connector, nodetool >>>> and cassandra-stress. ScyllaDB is a drop-in replacement solution for the >>>> Cassandra server side packages. >>>> >>>> Scylla is implemented using the new shared-nothing Seastar >>>> <http://www.seastar-project.org/> framework for extreme performance on >>>> modern multicore hardware, and the Data Plane Development Kit (DPDK) for >>>> high-speed low-latency networking. >>>> >>>> Try Scylla Now - http://www.scylladb.com >>>> >>>> We will be at Cassandra summit 2015, you are welcome to visit our booth >>>> to hear more and see a demo. >>>> Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM >>>> - 2:30 PM in rooms M1 - M3. >>>> >>>> Regards >>>> Tzach >>>> scylladb >>>> >>>> >>> >> >
Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
On Wed, Sep 23, 2015 at 12:13 AM, Venkatesh Arivazhagan < venkey.a...@gmail.com> wrote: > I came across this article: > zdnet.com/article/kvm-creators-open-source-fast-cassandra-drop-in-replacement-scylla/ > > Tzach, I would love to know/understand moree about ScyllaDB too. Also the > benchmark seems to have only 1 DB Server. Do you have benchmark numbers > where more than 1 DB servers were involved? :) > Benchmark specs are here http://www.scylladb.com/technology/cassandra-vs-scylla-benchmark/ Yes, it is one server. More benchmarks, with more servers, will be publish soon. > > > On Tue, Sep 22, 2015 at 1:40 PM, Sachin Nikam <skni...@gmail.com> wrote: > >> Tzach, >> Can you point to any documentation on scylladb site which talks about >> how/why scylla db performs better than Cassandra while using the same >> architecture? >> Regards >> Sachin >> >> On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan < >> tz...@cloudius-systems.com> wrote: >> >>> Hello Cassandra users, >>> >>> We are pleased to announce a new member of the Cassandra Ecosystem - >>> ScyllaDB >>> ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, >>> written with the goal of delivering superior performance and consistent low >>> latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. >>> >>> ScyllaDB supports CQL, is compatible with Cassandra drivers, and works >>> out of the box with Cassandra tools like cqlsh, Spark connector, nodetool >>> and cassandra-stress. ScyllaDB is a drop-in replacement solution for the >>> Cassandra server side packages. >>> >>> Scylla is implemented using the new shared-nothing Seastar >>> <http://www.seastar-project.org/> framework for extreme performance on >>> modern multicore hardware, and the Data Plane Development Kit (DPDK) for >>> high-speed low-latency networking. >>> >>> Try Scylla Now - http://www.scylladb.com >>> >>> We will be at Cassandra summit 2015, you are welcome to visit our booth >>> to hear more and see a demo. >>> Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM >>> - 2:30 PM in rooms M1 - M3. >>> >>> Regards >>> Tzach >>> scylladb >>> >>> >> >
Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
very interesting. I'm glad to see someone building a drop in replacement for Cassandra. On Tue, Sep 22, 2015 at 5:40 PM, Tzach Livyatan <tz...@cloudius-systems.com> wrote: > Hi Sachin > > On Tue, Sep 22, 2015 at 11:40 PM, Sachin Nikam <skni...@gmail.com> wrote: > >> Tzach, >> Can you point to any documentation on scylladb site which talks about >> how/why scylla db performs better than Cassandra while using the same >> architecture? >> > see here > http://www.scylladb.com/technology/architecture/ > > >> Regards >> Sachin >> >> On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan < >> tz...@cloudius-systems.com> wrote: >> >>> Hello Cassandra users, >>> >>> We are pleased to announce a new member of the Cassandra Ecosystem - >>> ScyllaDB >>> ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, >>> written with the goal of delivering superior performance and consistent low >>> latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. >>> >>> ScyllaDB supports CQL, is compatible with Cassandra drivers, and works >>> out of the box with Cassandra tools like cqlsh, Spark connector, nodetool >>> and cassandra-stress. ScyllaDB is a drop-in replacement solution for the >>> Cassandra server side packages. >>> >>> Scylla is implemented using the new shared-nothing Seastar >>> <http://www.seastar-project.org/> framework for extreme performance on >>> modern multicore hardware, and the Data Plane Development Kit (DPDK) for >>> high-speed low-latency networking. >>> >>> Try Scylla Now - http://www.scylladb.com >>> >>> We will be at Cassandra summit 2015, you are welcome to visit our booth >>> to hear more and see a demo. >>> Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM >>> - 2:30 PM in rooms M1 - M3. >>> >>> Regards >>> Tzach >>> scylladb >>> >>> >> >
Re: ScyllaDB, a new open source, Cassandra-compatible NoSQL
Hi Sachin On Tue, Sep 22, 2015 at 11:40 PM, Sachin Nikam <skni...@gmail.com> wrote: > Tzach, > Can you point to any documentation on scylladb site which talks about > how/why scylla db performs better than Cassandra while using the same > architecture? > see here http://www.scylladb.com/technology/architecture/ > Regards > Sachin > > On Tue, Sep 22, 2015 at 9:18 AM, Tzach Livyatan < > tz...@cloudius-systems.com> wrote: > >> Hello Cassandra users, >> >> We are pleased to announce a new member of the Cassandra Ecosystem - >> ScyllaDB >> ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, >> written with the goal of delivering superior performance and consistent low >> latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. >> >> ScyllaDB supports CQL, is compatible with Cassandra drivers, and works >> out of the box with Cassandra tools like cqlsh, Spark connector, nodetool >> and cassandra-stress. ScyllaDB is a drop-in replacement solution for the >> Cassandra server side packages. >> >> Scylla is implemented using the new shared-nothing Seastar >> <http://www.seastar-project.org/> framework for extreme performance on >> modern multicore hardware, and the Data Plane Development Kit (DPDK) for >> high-speed low-latency networking. >> >> Try Scylla Now - http://www.scylladb.com >> >> We will be at Cassandra summit 2015, you are welcome to visit our booth >> to hear more and see a demo. >> Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM - >> 2:30 PM in rooms M1 - M3. >> >> Regards >> Tzach >> scylladb >> >> >
ScyllaDB, a new open source, Cassandra-compatible NoSQL
Hello Cassandra users, We are pleased to announce a new member of the Cassandra Ecosystem - ScyllaDB ScyllaDB is a new, open source, Cassandra-compatible NoSQL data store, written with the goal of delivering superior performance and consistent low latency. Today, ScyllaDB runs 1M tps per server with sub 1ms latency. ScyllaDB supports CQL, is compatible with Cassandra drivers, and works out of the box with Cassandra tools like cqlsh, Spark connector, nodetool and cassandra-stress. ScyllaDB is a drop-in replacement solution for the Cassandra server side packages. Scylla is implemented using the new shared-nothing Seastar <http://www.seastar-project.org/> framework for extreme performance on modern multicore hardware, and the Data Plane Development Kit (DPDK) for high-speed low-latency networking. Try Scylla Now - http://www.scylladb.com We will be at Cassandra summit 2015, you are welcome to visit our booth to hear more and see a demo. Avi Kivity, our CTO, will host a session on Scylla on Thursday, 1:50 PM - 2:30 PM in rooms M1 - M3. Regards Tzach scylladb
