Re: Jepsen testing
For those relatively new to Cassandra, Riptano is the previous company name for Datastax, back in 2011. :) http://www.h-online.com/open/news/item/Cassandra-service-company-Riptano-changes-name-to-DataStax.html Thanks, James Briggs. -- Cassandra/MySQL DBA. Available in San Jose area or remote. cass_top: https://github.com/jamesbriggs/cassandra-top From: Oleksandr Shulgin To: User Cc: d...@cassandra.apache.org Sent: Friday, November 9, 2018 12:33 AM Subject: Re: Jepsen testing On Thu, Nov 8, 2018 at 10:42 PM Yuji Ito wrote: We are working on Jepsen testing for Cassandra.https://github.com/scalar-labs/jepsen/tree/cassandra/cassandra As you may know, Jepsen is a framework for distributed systems verification.It can inject network failure and so on and check data consistency.https://github.com/jepsen-io/jepsen Our tests are based on riptano's great work.https://github.com/riptano/jepsen/tree/cassandra/cassandra I refined it for the latest Jepsen and removed some tests.Next, I'll fix clock-drift tests. I would like to get your feedback. Cool stuff! Do you have jepsen tests as part of regular testing in scalardb? How long does it take to run all of them on average? I wonder if Apache Cassandra would be willing to include this as part of regular testing drill as well. Cheers,--Alex
Re: Is Apache Cassandra supports Data at rest
Thanks Jeff for the clarification :) On Mon, Nov 12, 2018 at 10:44 PM Jeff Jirsa wrote: > If you mean encryption at rest: no, it’s not currently supported. It’ll > eventually be implemented in > https://issues.apache.org/jira/browse/CASSANDRA-9633 , but that ticket is > currently unassigned and there’s no ETA. > > > -- > Jeff Jirsa > > > On Nov 12, 2018, at 10:21 PM, Goutham reddy > wrote: > > Hi, > Does Apache Cassandra supports data at rest, because datastax Cassandra > supports it. Can anybody help me. > > Thanks and Regards, > Goutham. > -- > Regards > Goutham Reddy > > -- Regards Goutham Reddy
Re: Released an ACID-compliant transaction library on top of Cassandra
Hi, Fanastic news! Ariel On Tue, Nov 13, 2018, at 10:36 AM, Hiroyuki Yamada wrote: > Hi all, > > I am happy to release it under Apache 2 license now. > https://github.com/scalar-labs/scalardb > > It passes not only jepsen but also our-built destructive testing. > For jepsen tests, please check the following. > https://github.com/scalar-labs/scalardb/tree/master/jepsen/scalardb > > Also, as Yuji mentioned the other day, we also fixed/updated jepsen > tests for C* to make it work with the latest C* version properly and > follow the new style. > https://github.com/scalar-labs/jepsen/tree/cassandra > > In addition to that, we fixed/updated cassaforte used in the jepsen > tests for C* to make it work with the latest java driver since > cassaforte is not really maintained any more. > https://github.com/scalar-labs/cassaforte/tree/driver-3.0-for-jepsen > > We are pleased to be able to contribute to the community by the above updates. > Please give us any feedbacks or questions. > > Thanks, > Hiro > > > On Wed, Oct 17, 2018 at 8:52 AM Hiroyuki Yamada wrote: > > > > Hi all, > > > > Thank you for the comments and feedbacks. > > > > As Jonathan pointed out, it relies on LWT and uses the protocol > > proposed in the paper. > > Please read the design document for more detail. > > https://github.com/scalar-labs/scalardb/blob/master/docs/design.md > > > > Regarding the licensing, we are thinking of releasing it with Apache 2 > > if lots of developers are interested in it. > > > > Best regards, > > Hiroyuki > > On Wed, Oct 17, 2018 at 3:13 AM Jonathan Ellis wrote: > > > > > > Which was followed up by > > > https://www.researchgate.net/profile/Akon_Dey/publication/282156834_Scalable_Distributed_Transactions_across_Heterogeneous_Stores/links/56058b9608ae5e8e3f32b98d.pdf > > > > > > On Tue, Oct 16, 2018 at 1:02 PM Jonathan Ellis wrote: > > >> > > >> It looks like it's based on this: > > >> http://www.vldb.org/pvldb/vol6/p1434-dey.pdf > > >> > > >> On Tue, Oct 16, 2018 at 11:37 AM Ariel Weisberg > > >> wrote: > > >>> > > >>> Hi, > > >>> > > >>> Yes this does sound great. Does this rely on Cassandra's internal > > >>> SERIAL consistency and CAS functionality or is that implemented at a > > >>> higher level? > > >>> > > >>> Regards, > > >>> Ariel > > >>> > > >>> On Tue, Oct 16, 2018, at 12:31 PM, Jeff Jirsa wrote: > > >>> > This is great! > > >>> > > > >>> > -- > > >>> > Jeff Jirsa > > >>> > > > >>> > > > >>> > > On Oct 16, 2018, at 5:47 PM, Hiroyuki Yamada > > >>> > > wrote: > > >>> > > > > >>> > > Hi all, > > >>> > > > > >>> > > # Sorry, I accidentally emailed the following to dev@, so > > >>> > > re-sending to here. > > >>> > > > > >>> > > We have been working on ACID-compliant transaction library on top of > > >>> > > Cassandra called Scalar DB, > > >>> > > and are pleased to announce the release of v.1.0 RC version in open > > >>> > > source. > > >>> > > > > >>> > > https://github.com/scalar-labs/scalardb/ > > >>> > > > > >>> > > Scalar DB is a library that provides a distributed storage > > >>> > > abstraction > > >>> > > and client-coordinated distributed transaction on the storage, > > >>> > > and makes non-ACID distributed database/storage ACID-compliant. > > >>> > > And Cassandra is the first supported database implementation. > > >>> > > > > >>> > > It's been internally tested intensively and is jepsen-passed. > > >>> > > (see jepsen directory for more detail) > > >>> > > If you are looking for ACID transaction capability on top of > > >>> > > cassandra, > > >>> > > Please take a look and give us a feedback or contribution. > > >>> > > > > >>> > > Best regards, > > >>> > > Hiroyuki Yamada > > >>> > > > > >>> > > - > > >>> > > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > > >>> > > For additional commands, e-mail: user-h...@cassandra.apache.org > > >>> > > > > >>> > > > >>> > - > > >>> > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > > >>> > For additional commands, e-mail: user-h...@cassandra.apache.org > > >>> > > > >>> > > >>> - > > >>> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > > >>> For additional commands, e-mail: user-h...@cassandra.apache.org > > >>> > > >> > > >> > > >> -- > > >> Jonathan Ellis > > >> co-founder, http://www.datastax.com > > >> @spyced > > > > > > > > > > > > -- > > > Jonathan Ellis > > > co-founder, http://www.datastax.com > > > @spyced > > - > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > For additional commands, e-mail: user-h...@cassandra.apache.org > - To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org For additional commands, e-mail: user-h..
Re: Lost counter updates during Cassandra upgrade 2.2.11 to 3.11.2
Hi, I haven't investigated the issue further. -- Konrad On Sat, Nov 10, 2018, at 05:49, Laxmikant Upadhyay wrote: > Hi, > > I have faced similar issue while upgrading from 2.1.16 -> 3.11.2 in a > 3 node cluster.> I have raised jira ticket CASSANDRA-14881[1] for this issue > , but have > not got any response on this yet.> @Konrad did you get any resolution on this > ? > > Regards, > Laxmikant > > > > > On Thu, Jul 26, 2018 at 5:34 PM Konrad wrote:>> Hi, >> >> During rolling upgrade of our cluster we noticed that some updates >> on table with counters were not being applied. It looked as if it >> depended on whether coordinator handling request was already >> upgraded or not. I observed similar behavior while using cqlsh and >> executing queries manually. Sometimes it took several retries to see >> counter updated. There were no errors/warns in neither application >> nor Cassandra logs. The updates started working reliably once again >> when all nodes in dc have been upgraded. However, the lost updates >> did not reappear.>> >> Our setup: >> 2 dc cluster, 5 + 5 nodes. However, only one is used for queries as >> client application is co-located in one region. I believe 1 dc is >> enough to reproduce it.>> Replication factor 3+2 >> Consistency level LOCAL_QUORUM >> Upgrading 2.2.11 to 3.11.2 >> >> I haven't found any report of similar issue on the internet. Has >> anyone heard about such behavior?>> >> Thanks, >> Konrad >> >> --- >> -->> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org >> For additional commands, e-mail: user-h...@cassandra.apache.org >> > > > -- > > regards, > Laxmikant Upadhyay > Links: 1. https://issues.apache.org/jira/browse/CASSANDRA-14881
Re: Released an ACID-compliant transaction library on top of Cassandra
Hi all, I am happy to release it under Apache 2 license now. https://github.com/scalar-labs/scalardb It passes not only jepsen but also our-built destructive testing. For jepsen tests, please check the following. https://github.com/scalar-labs/scalardb/tree/master/jepsen/scalardb Also, as Yuji mentioned the other day, we also fixed/updated jepsen tests for C* to make it work with the latest C* version properly and follow the new style. https://github.com/scalar-labs/jepsen/tree/cassandra In addition to that, we fixed/updated cassaforte used in the jepsen tests for C* to make it work with the latest java driver since cassaforte is not really maintained any more. https://github.com/scalar-labs/cassaforte/tree/driver-3.0-for-jepsen We are pleased to be able to contribute to the community by the above updates. Please give us any feedbacks or questions. Thanks, Hiro On Wed, Oct 17, 2018 at 8:52 AM Hiroyuki Yamada wrote: > > Hi all, > > Thank you for the comments and feedbacks. > > As Jonathan pointed out, it relies on LWT and uses the protocol > proposed in the paper. > Please read the design document for more detail. > https://github.com/scalar-labs/scalardb/blob/master/docs/design.md > > Regarding the licensing, we are thinking of releasing it with Apache 2 > if lots of developers are interested in it. > > Best regards, > Hiroyuki > On Wed, Oct 17, 2018 at 3:13 AM Jonathan Ellis wrote: > > > > Which was followed up by > > https://www.researchgate.net/profile/Akon_Dey/publication/282156834_Scalable_Distributed_Transactions_across_Heterogeneous_Stores/links/56058b9608ae5e8e3f32b98d.pdf > > > > On Tue, Oct 16, 2018 at 1:02 PM Jonathan Ellis wrote: > >> > >> It looks like it's based on this: > >> http://www.vldb.org/pvldb/vol6/p1434-dey.pdf > >> > >> On Tue, Oct 16, 2018 at 11:37 AM Ariel Weisberg wrote: > >>> > >>> Hi, > >>> > >>> Yes this does sound great. Does this rely on Cassandra's internal SERIAL > >>> consistency and CAS functionality or is that implemented at a higher > >>> level? > >>> > >>> Regards, > >>> Ariel > >>> > >>> On Tue, Oct 16, 2018, at 12:31 PM, Jeff Jirsa wrote: > >>> > This is great! > >>> > > >>> > -- > >>> > Jeff Jirsa > >>> > > >>> > > >>> > > On Oct 16, 2018, at 5:47 PM, Hiroyuki Yamada > >>> > > wrote: > >>> > > > >>> > > Hi all, > >>> > > > >>> > > # Sorry, I accidentally emailed the following to dev@, so re-sending > >>> > > to here. > >>> > > > >>> > > We have been working on ACID-compliant transaction library on top of > >>> > > Cassandra called Scalar DB, > >>> > > and are pleased to announce the release of v.1.0 RC version in open > >>> > > source. > >>> > > > >>> > > https://github.com/scalar-labs/scalardb/ > >>> > > > >>> > > Scalar DB is a library that provides a distributed storage abstraction > >>> > > and client-coordinated distributed transaction on the storage, > >>> > > and makes non-ACID distributed database/storage ACID-compliant. > >>> > > And Cassandra is the first supported database implementation. > >>> > > > >>> > > It's been internally tested intensively and is jepsen-passed. > >>> > > (see jepsen directory for more detail) > >>> > > If you are looking for ACID transaction capability on top of > >>> > > cassandra, > >>> > > Please take a look and give us a feedback or contribution. > >>> > > > >>> > > Best regards, > >>> > > Hiroyuki Yamada > >>> > > > >>> > > - > >>> > > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > >>> > > For additional commands, e-mail: user-h...@cassandra.apache.org > >>> > > > >>> > > >>> > - > >>> > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > >>> > For additional commands, e-mail: user-h...@cassandra.apache.org > >>> > > >>> > >>> - > >>> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > >>> For additional commands, e-mail: user-h...@cassandra.apache.org > >>> > >> > >> > >> -- > >> Jonathan Ellis > >> co-founder, http://www.datastax.com > >> @spyced > > > > > > > > -- > > Jonathan Ellis > > co-founder, http://www.datastax.com > > @spyced - To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org For additional commands, e-mail: user-h...@cassandra.apache.org
