Re: [External] Re: Whch version is the best version to run now?

We run on the order of a thousand Cassandra nodes in production. Most of that is 3.0.16, but new clusters are defaulting to 3.11.2 and some older clusters have been upgraded to it as well. All of the bugs I encountered in 3.11.x were also seen in 3.0.x, but 3.11.x seems to get more love from the

RE: [EXTERNAL] Re: Version Rollback

My short answer is always – there are no rollbacks, we only go forward. Jeff’s answer is much more complete and technically precise. You *could* rollback a few nodes (depending on topology) by just replacing them as if they had died. I always upgrade all nodes (the binaries) as quickly as

RE: [EXTERNAL] Re: Even after the drop table, the data actually was not erased.

We have found it very useful to set up an infrastructure where we can execute a nodetool command (or any other arbitrary command) from a single (non-Cassandra) host that will get executed on each node across the cluster (or a list of nodes). Sean Durity From: Alain RODRIGUEZ

Re: [EXTERNAL] Cassandra cluster add new node slowly

> > I suspect the compactionthroughput has an influence on the new node > joining. The command nodetool | getcompactionthroughput says 'Current > compaction throughput: 32 MB/s’. I would say this guess is true, but maybe not the way you think: the more disk IO you use for compactions, the

Re: [EXTERNAL] Cassandra cluster add new node slowly

The speed at which compactions operate is also physically restricted by the speed of the disk. If the disks used on the new node are HDDs, then increasing the compaction throughput will be of little help. However, if the disks on the new node are SSDs then increasing the compaction throughput to

Re: [EXTERNAL] Cassandra cluster add new node slowly

The cassandra version is 3.0.9. I have changed the heap size (about 32G). Also, the streaming throughput is set 800MB/sec, and the streaming_socket_timeout_in_ms is default 8640. I suspect the compactionthroughput has an influence on the new node joining. The command nodetool |

RE: [EXTERNAL] Cassandra cluster add new node slowly

You don't mention the version, but here are some general suggestions - 2 GB heap is very small for a node, especially with 1 TB+ of data. What is the physical RAM on the host? In general, you want ½ of physical RAM for the JVM. (Look in jvm.options or cassandra-env.sh) - You

RE: [EXTERNAL] 3.0.15 or 3.11.1

It might help if you let us know about which 3.11 features you are interested. As I hear it, some of the features may not be PR ready (like materialized views). In my opinion, it seems that 3.0.15 is the more stable way to go. However, I have not been testing 3.11, so my thoughts are more based

RE: [EXTERNAL] Re: Reg:- Data modelling For E-Commerce Pattern data modelling for Search

DataStax Enterprise (pay to license) has embedded SOLR search with Cassandra if you don’t want to move the data to another cluster for indexing/searching. Similar to Cassandra modeling, you will need to understand the exact search queries in order to build the SOLR schema to support them. The

Re: [EXTERNAL] Add nodes change

> On Dec 28, 2017, at 11:09 AM, Durity, Sean R > wrote: > > --> See inline > > Hello All, > > We are going add 2 new nodes to our production server, there are 2 questions > would like to have some advices? > > 1. In current production env, the cassandra

RE: [EXTERNAL] Add nodes change

--> See inline Hello All, We are going add 2 new nodes to our production server, there are 2 questions would like to have some advices? 1. In current production env, the cassandra version is 3.0.4, is it ok if we use 3.0.15 for the new node? --> I would not do this. Streaming between

RE: [EXTERNAL] Lots of simultaneous connections?

Have you determined if a specific query is the one getting timed out? It is possible that the query/data model does not scale well, especially if you are trying to do something like a full table scan. It is also possible that your OS settings will limit the number of connections to the host.

RE: [EXTERNAL] Bring 2 nodes down

Decommission the two nodes, one at a time (assumes you have enough disk space on the remaining hosts). That will move the data to the remaining nodes and keep RF=3. Then fix the host. Then add the hosts back into the cluster, one at a time. This is easier with vnodes. Finally, run clean-up on

RE: [EXTERNAL] Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?

Datos IO solves many of the problems inherent in Cassandra backups (primarily issues with acceptable restores). It is worth considering. Other groups in my company are happy with it. Sean Durity From: Lerh Chuan Low [mailto:l...@instaclustr.com] Sent: Thursday, December 14, 2017 4:13 PM To:

RE: [EXTERNAL] Re: Data Node Density

You asked for experience; here’s mine. I support one PR cluster where the hardware was built more for HBase than Cassandra. So the data capacity is large (4.5 TB/node). Administratively, it is the worst cluster to work on because any kind of repairs, streaming, replacement take forever. And

RE: [EXTERNAL] Re: Upgrade using rebuild

The sstable formats/versions are different. Streaming uses those formats. Streaming doesn’t work across major versions (for sure), and I don’t even try it across minor versions. To ensure Cassandra-happiness, follow the rule: For streaming operations (adding nodes, rebuild, repairs, etc.) have

RE: [EXTERNAL] Lot of hints piling up

@cassandra.apache.org Subject: Re: [EXTERNAL] Lot of hints piling up No OOM or HEAP errors On Tue, Oct 24, 2017 at 2:51 PM, Mohapatra, Kishore <kishore.mohapa...@nuance.com> wrote: Check how many sstables are there for the table you are having issues with. You might be having th

Re: [EXTERNAL] Lot of hints piling up

rror or HEAP error. > > > > Thanks > > > > *Kishore Mohapatra* > > Principal Operations DBA > > Seattle, WA > > Email : kishore.mohapa...@nuance.com > > > > > > *From:* Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com] > *Sent:* Mo

RE: [EXTERNAL] Lot of hints piling up

apa...@nuance.com> From: Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com] Sent: Monday, October 23, 2017 11:54 AM To: user@cassandra.apache.org Subject: Re: [EXTERNAL] Lot of hints piling up Do not see any errors in the logs or OS and compactions are happening in the regular interval an

RE: [EXTERNAL]

Hi Vedant, I was actually referring to command line select query with Consistency level=ALL . This will force a read repair in the background. But as I can see, you have tried with consistency level = one and and it is still timing out. SO what error you see in the

Re: [EXTERNAL] Lot of hints piling up

Do not see any errors in the logs or OS and compactions are happening in the regular interval and good too. Issue here is, this causing replication lag across the datacenters. On Mon, Oct 23, 2017 at 10:23 AM, Mohapatra, Kishore < kishore.mohapa...@nuance.com> wrote: > Do you see any error in

RE: [EXTERNAL] Lot of hints piling up

Do you see any error in the cassandra log ? Check compactionstats ? Also check the OS level log messages to see if you are getting hardware level error messages. Thanks Kishore Mohapatra Principal Operations DBA Seattle, WA Ph : 425-691-6417 (cell) Email :

RE: [EXTERNAL]

What is your RF for the keyspace and how many nodes are there in each DC ? Did you force a Read Repair to see, if you are getting the data or getting an error ? Thanks Kishore Mohapatra Principal Operations DBA Seattle, WA Email : kishore.mohapa...@nuance.com -Original Message- From:

Re: [EXTERNAL] Re: Increasing VNodes

Cant you just increase segmentCount option to split it more? On Wed, Oct 4, 2017 at 12:50 PM, Mohapatra, Kishore < kishore.mohapa...@nuance.com> wrote: > Thanks a lot for all of your input. We are actually using Cassandra > reaper. But it is just splitting the ranges into 256 per node. > > But I

RE: [EXTERNAL] Re: Increasing VNodes

Thanks a lot for all of your input. We are actually using Cassandra reaper. But it is just splitting the ranges into 256 per node. But I will certainly try out splitting into smaller ranges going thru the system.size_estimate table. Thanks Kishore Mohapatra Principal Operations DBA Seattle, WA

Re: [EXTERNAL] Cassandra copy command is giving OverflowError

That did not work. It was giving me the same error. However I came to know that it can happen if there is out of range date values. Now I ran the following query and got result: select id,created_date from table1 where solr_query = > '{"q":"*:*","sort":"created_date desc"}' limit 2; Traceback

RE: [EXTERNAL] Cassandra copy command is giving OverflowError

Try this. COPY keyspace1.table1 TO '/tmp/table1.csv' WITH PAGETIMEOUT=40 AND PAGESIZE=20; Thanks Kishore Mohapatra Principal Operations DBA Seattle, WA Email : kishore.mohapa...@nuance.com From: AI Rumman [mailto:rumman...@gmail.com] Sent: Thursday,

RE: [EXTERNAL] Re: Cassandra repair process in Low Bandwidth Network

Hi Jeff, Thanks for your reply. Infact I have tried with all the options. 1. We use Cassandra reaper for our repair, which does the sub range repair. 2. I have also developed a shell script, which exactly does the same, as what reaper does. But this can control, how

RE: [External] Re: Cassandra ad hoc search options

To: user@cassandra.apache.org Subject: Re: [External] Re: Cassandra ad hoc search options +1 On Tue, 31 Jan 2017 at 10:04 Jonathan Haddad <j...@jonhaddad.com<mailto:j...@jonhaddad.com>> wrote: With regards to having DCs for specific workloads, it would be nice to have per DC indexes

Re: [External] Re: Cassandra ad hoc search options

he data to > support ad hoc queries. It seems mostly limited to clustering columns. > Maybe in other cases, it would result in full scan, but that’s going to be > very slow. > > > > Regards, > > John > > > > *From:* siddharth verma [mailto:sidd.verma29

Re: [External] Re: Cassandra ad hoc search options

ases, it would result in full scan, but that’s going to be > very slow. > > > > Regards, > > John > > > > *From:* siddharth verma [mailto:sidd.verma29.l...@gmail.com] > *Sent:* Monday, January 30, 2017 10:20 PM > > *To:* user@cassandra.apache.org > *Subject:* Re: [E

Re: [External] Re: Cassandra ad hoc search options

that’s going to be > very slow. > > > > Regards, > > John > > > > *From:* siddharth verma [mailto:sidd.verma29.l...@gmail.com] > *Sent:* Monday, January 30, 2017 10:20 PM > > *To:* user@cassandra.apache.org > *Subject:* Re: [External] Re: Cassandra ad hoc sear

Re: [External] Re: Cassandra ad hoc search options

gt;> that’s going to be very slow. >> >> >> >> Regards, >> >> John >> >> >> >> *From:* siddharth verma [mailto:sidd.verma29.l...@gmail.com] >> *Sent:* Monday, January 30, 2017 10:20 PM >> >> *To:* user@cassandra.apac

Re: [External] Re: Cassandra ad hoc search options

l scan, > but that’s going to be very slow. > > > > Regards, > > John > > > > *From:* siddharth verma [mailto:sidd.verma29.l...@gmail.com] > *Sent:* Monday, January 30, 2017 10:20 PM > > *To:* user@cassandra.apache.org > *Subject:* Re: [External] Re: Cassan

RE: [External] Re: Cassandra ad hoc search options

, 2017 10:20 PM To: user@cassandra.apache.org Subject: Re: [External] Re: Cassandra ad hoc search options Hi, Are you using the DataStax connector as well? Yes, we used it to query on lucene index. Does it support querying against any column well (not just clustering columns)? Yes it does. We used

RE: [External] Re: Cassandra ad hoc search options

Does this work with Cassandra, or provide an alternative? Thanks. From: vincent gromakowski [mailto:vincent.gromakow...@gmail.com] Sent: Monday, January 30, 2017 11:38 PM To: user@cassandra.apache.org Subject: Re: [External] Re: Cassandra ad hoc search options I gave a try on spark+filodb

Re: [External] Re: Cassandra ad hoc search options

ohn...@sandc.com] > *Sent:* Monday, January 30, 2017 12:04 AM > *To:* user@cassandra.apache.org > *Subject:* RE: [External] Re: Cassandra ad hoc search options > > > > Thanks for the input! Are you using the DataStax connector as well? Does > it support querying against any co

Re: [External] Re: Cassandra ad hoc search options

(with multiple conditional filters). > > > > Thanks, > > John > > > > *From:* Yu, John [mailto:john...@sandc.com] > *Sent:* Monday, January 30, 2017 12:04 AM > *To:* user@cassandra.apache.org > *Subject:* RE: [External] Re: Cassandra ad hoc search options &g

RE: [External] Re: Cassandra ad hoc search options

@cassandra.apache.org Subject: RE: [External] Re: Cassandra ad hoc search options Thanks for the input! Are you using the DataStax connector as well? Does it support querying against any column well (not just clustering columns)? I’m wondering how it could build the index around them “on-the-fly

RE: [External] Re: Cassandra ad hoc search options

: Friday, January 27, 2017 12:15 AM To: user@cassandra.apache.org Subject: Re: [External] Re: Cassandra ad hoc search options Hi We used lucene stratio plugin with C*3.0.3 Helped to solve a lot of some read patterns. Served well for prefix. But created problems as repairs failed repeatedly. We

Re: [External] Re: Cassandra ad hoc search options

Hi We used lucene stratio plugin with C*3.0.3 Helped to solve a lot of some read patterns. Served well for prefix. But created problems as repairs failed repeatedly. We might have used it sub optimally, not sure. Later, we had to do away with it, and tried to serve most of the read patterns with

RE: [External] Re: Cassandra ad hoc search options

Thanks a lot. Mind sharing a couple of points where you feel it’s better than the alternatives. Regards, John From: Jonathan Haddad [mailto:j...@jonhaddad.com] Sent: Thursday, January 26, 2017 2:33 PM To: user@cassandra.apache.org Subject: [External] Re: Cassandra ad hoc search options > With

Re: External linking Was: Isolation in case of Single Partition Writes and Batching with LWT

Again: *dev list*. "Please Note: These requirements apply to Apache projects: that is, to *individual committer and PMC behaviors* and actions within the context of collaboratively building software products at The Apache Software Foundation. By definition here, "Apache project" means the

Re: [External] Re: Understanding when Cassandra drops expired time series data

, 2016 4:32:47 PM To: user@cassandra.apache.org Subject: Re: [External] Re: Understanding when Cassandra drops expired time series data Got it. Thanks again! But in versions of Cassandra after 2.0.15 getFullyExpiredSSTables is more in line with what people would consider to be fully expired (i.

Re: [External] Re: Understanding when Cassandra drops expired time series data

.ji...@crowdstrike.com> Sent: Friday, June 17, 2016 4:21:02 PM To: user@cassandra.apache.org Subject: Re: [External] Re: Understanding when Cassandra drops expired time series data Correcting myself - https://issues.apache.org/jira/browse/CASSANDRA-9882 made it check for fully expired tables n

Re: [External] Re: Understanding when Cassandra drops expired time series data

Correcting myself - https://issues.apache.org/jira/browse/CASSANDRA-9882 made it check for fully expired tables no more than once every 10 minutes (still happens on flush as described, just not EVERY flush). Went in 2.0.17 / 2.1.9. - Jeff From: Jeff Jirsa

RE: External authentication options for C* (no DSE)

Cassandra Admin From: Giampaolo Trapasso [mailto:giampaolo.trapa...@radicalbit.io] Sent: Wednesday, December 23, 2015 10:46 AM To: user@cassandra.apache.org Subject: Re: External authentication options for C* (no DSE) Search a bit deeper in DSE docs, I've found this: http://www.datastax.com/wp

Re: External authentication options for C* (no DSE)

Search a bit deeper in DSE docs, I've found this: http://www.datastax.com/wp-content/themes/datastax-2014-08/files/FF-DataStax-AdvancedSecurity.pdf . Pratically no external authentication is available for Apache Cassandra. giampaolo 2015-12-23 15:13 GMT+01:00 Giampaolo Trapasso <

Re: EXTERNAL: Re: Running Cassandra Server in an OSGi container

You mean unzip and run of an application using C* ? Am 23.07.2014 um 00:34 schrieb Rodgers, Hugh hugh.rodg...@lmco.com: What got our team on the path of trying to embed C* was the wiki page http://wiki.apache.org/cassandra/Embedding which implies this can be done. Also WSO2 Carbon and

RE: EXTERNAL: Re: Running Cassandra Server in an OSGi container

Yes, the application includes the C* server and client. From: Robert Stupp [mailto:sn...@snazy.de] Sent: Wednesday, July 23, 2014 12:19 AM To: user@cassandra.apache.org Subject: Re: EXTERNAL: Re: Running Cassandra Server in an OSGi container You mean unzip and run of an application using C

RE: EXTERNAL: Re: Running Cassandra Server in an OSGi container

What got our team on the path of trying to embed C* was the wiki page http://wiki.apache.org/cassandra/Embedding which implies this can be done. Also WSO2 Carbon and Achilles have both embedded C* (not in an OSGi container though, and Carbon is with an older C* version). We are wanting an

<    1   2   3   4