Re: Cassandra -stress write - Storage location

2015-10-29 Thread Sebastian Estevez
You can do a describe table to see the table layout and you can select to see some sample rows. Stress is pretty powerful though. I just dropped a blog post tonight on doing more targeted benchmarking / sizing with stress and my data modeler. Take a look: http://www.sestevez.com/data-modeler/ On

Re: Cassandra -stress write - Storage location

2015-10-29 Thread Arun Sandu
Thanks . Can I know, the format of the data that gets stored? Can you please suggest me some ways to perform load testing? I need a big picture of all the statistics. Thanks again Arun On Thu, Oct 29, 2015 at 9:41 PM, Sebastian Estevez < sebastian.este...@datastax.com> wrote: > By default this w

Re: Cassandra -stress write - Storage location

2015-10-29 Thread Sebastian Estevez
By default this will go in Keyspace1 Standard1. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.com [image: linkedin.png] [image: facebook.png]

Re: Cassandra stalls and dropped messages not due to GC

2015-10-29 Thread Jeff Ferland
Upgraded from 2.0.x. Using the other commit log sync method and 10 seconds. Enabling batch mode is like swallowing a grenade. It’s starting to look to me like it’s possibly related to brief IO spikes that are smaller than my usual graphing granularity. It feels surprising to me that these would

Cassandra -stress write - Storage location

2015-10-29 Thread Arun Sandu
Hi, I am currently working on load testing my cluster. When we write 10 to cassandra, where does the writes data gets stored in Cassandra and the same for read operation too. ./cassandra-stress write n=10 -rate threads=100 -node 10.34.100.13 ./cassandra-stress read n=10 -node 10.34.1

Re: Cassandra stalls and dropped messages not due to GC

2015-10-29 Thread Graham Sanderson
Only if you actually change cassandra.yaml (that was the change in 2.1.6 which is why it matters what version he upgraded from) > On Oct 29, 2015, at 10:06 PM, Sebastian Estevez > wrote: > > The thing about the CASSANDRA-9504 theory is that it was solved in 2.1.6 and > Jeff's running 2.1.11.

cassandra state listener sends duplicate signals one with public ip and another with private ip

2015-10-29 Thread Dhyan Muralidharan
Hi, Can some one respond to this ? http://stackoverflow.com/questions/33428094/cassandra-state-listener-sends-duplicate-signals-one-with-public-ip-and-another —Dhyan

Re: unsubscribe

2015-10-29 Thread Gene
You have been unsuccessfully unsubscribed from the mailing list. We are sad to see you go. While waiting for you to return we will be watching this on repeat. https://www.youtube.com/watch?v=eh7lp9umG2I On Thu, Oct 29, 2015 at 7:55 PM, M.Tarkeshwar Rao wrote: >

Re: Cassandra stalls and dropped messages not due to GC

2015-10-29 Thread Sebastian Estevez
The thing about the CASSANDRA-9504 theory is that it was solved in 2.1.6 and Jeff's running 2.1.11. @Jeff How often does this happen? Can you watch ttop as soon as you notice increased read/write latencies? wget > https://bintray.com/artifact/download/aragozin/generic/sjk-plus-0.3.6.jar > java -

unsubscribe

2015-10-29 Thread M.Tarkeshwar Rao

Re: Cassandra stalls and dropped messages not due to GC

2015-10-29 Thread Graham Sanderson
you didn’t say what you upgraded from, but if it is 2.0.x, then look at CASSANDRA-9504 If so and you use commitlog_sync: batch Then you probably want to set commitlog_sync_batch_window_in_ms: 1 (or 2) Note I’m only slightly convinced this is the cause because of your READ_REPAIR issues (though i

Cassandra stalls and dropped messages not due to GC

2015-10-29 Thread Jeff Ferland
Using DSE 4.8.1 / 2.1.11.872, Java version 1.8.0_66 We upgraded our cluster this weekend and have been having issues with dropped mutations since then. Intensely investigating a single node and toying with settings has revealed that GC stalls don’t make up enough time to explain the 10 seconds

Re: Cassandra security using openssl or keytool

2015-10-29 Thread Jason J. W. Williams
> > I certainly don't vouch for the advisability of attempting a task you've > described as a "real pain" ... but if OP wants/needs to, it's their > funeral? :D > Agreed. I just wanted to elaborate what a "real pain" meant so OP would know I wasn't just blowing him off. -J

Re: Cassandra security using openssl or keytool

2015-10-29 Thread Robert Coli
On Thu, Oct 29, 2015 at 4:18 PM, Jason J. W. Williams < jasonjwwilli...@gmail.com> wrote: > I wasted 4-5 hours of my life recently importing an OpenSSL key in a PEM >> into a Cassandra keystore using exactly that article as a starting point >> (the server's hostname already had a certificate and k

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Brice Dutheil
My point is about the difficulty in having perfect clocks in a distributed system. If nanosecond precision isn’t happening at Google scale, it’s unlikely to be happening anywhere. The fact that dapper was written in the context of tracing is irrelevant. I agree with you : yes precise time at the n

Re: Cassandra security using openssl or keytool

2015-10-29 Thread Jason J. W. Williams
> > Google words like : > > " > import openssl private key into keytool > " > > Find results like : > > > http://stackoverflow.com/questions/906402/importing-an-existing-x509-certificate-and-private-key-in-java-keystore-to-use-i/8224863#8224863 > > I wasted 4-5 hours of my life recently importing a

Re: Downtime-Limit for a node in Network-Topology-Replication-Cluster?

2015-10-29 Thread Robert Coli
On Wed, Oct 28, 2015 at 2:20 PM, Vasileios Vlachos < vasileiosvlac...@gmail.com> wrote: > Thanks for clarifying this Rob. > > -However no step other than 2) provides a *guarantee* of consistency. And > it only provides that guarantee for data that exists when the repair starts. > > I read the abov

Re: Cassandra security using openssl or keytool

2015-10-29 Thread Robert Coli
On Thu, Oct 29, 2015 at 1:08 AM, Vishwajeet Singh wrote: > But I want to do using OpenSSL because It's my requirement. > > Can somebody please guide me, How I will do Cassandra Client to node > security using SSL and I want to use OpenSSL (Not keytool). > Google words like : " import openssl pr

Re: nodetool status Load not same with disk used

2015-10-29 Thread Robert Coli
On Thu, Oct 29, 2015 at 1:08 AM, qihuang.zheng wrote: > *We have some nodes Load too large, but some are normal. * > tl;dr - Clear the snapshots on the nodes which are too large. Longer : Are you sure that the nodes which are too large differ in the actual *data* size, or do they just contain

Re: Weird replace_address issue in 1.2

2015-10-29 Thread Robert Coli
On Thu, Oct 29, 2015 at 6:41 AM, Carlos Alonso wrote: > Tonight one of our 3 nodes cluster has died. This is Cassandra 1.2. and RF > = 3 > > After bringing up a new node and starting it with -Dreplace_address of the > dead one different things are happening. > > On the new node nodetool status is

Re: Re : Data restore to a new cluster

2015-10-29 Thread Robert Coli
On Mon, Oct 26, 2015 at 9:12 AM, sai krishnam raju potturi < pskraj...@gmail.com> wrote: > hi; >we are working on a data backup and restore procedure to a new cluster. > We are following the datastax documentation. It mentions a step > > "Restore the SSTable files snapshotted from the old clus

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Jonathan Haddad
My point is about the difficulty in having perfect clocks in a distributed system. If nanosecond precision isn't happening at Google scale, it's unlikely to be happening anywhere. The fact that dapper was written in the context of tracing is irrelevant. On Thu, Oct 29, 2015 at 7:27 PM Brice Dutheil

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Brice Dutheil
Additionally if the time uuid is generated client side, make sure the boxes that will perform the write hava correct ntp/ptp configuration. @John Haddad Keep in mind that in a distributed environment you probably have so much variance that nanosecond precision is pointless. Even google notes that

Re: Error Code

2015-10-29 Thread Eduardo Alfaia
Hi Tyler, in fact I am having a problem like this: https://groups.google.com/a/lists.datastax.com/forum/#!searchin/python-driver-user/Unable$20to$20connect$20to$20any$20servers/python-driver-user/F_pjeclCJdY/b9E5jCreNacJ The error code was shown me cause this error. > On 29 Oct 2015, at 16:27, T

Re: Error Code

2015-10-29 Thread Tyler Hobbs
That means the driver could not decode a Result message from Cassandra. Can you post the query that's failing along with your schema for that table to the Python driver mailing list? Here's a link: https://groups.google.com/a/lists.datastax.com/forum/#!forum/python-driver-user On Thu, Oct 29, 201

Re: Error Connecting to Cassandra

2015-10-29 Thread Eduardo Alfaia
Hi Adam I changed the timeout to 10 sec, but It happened the same error. > On 29 Oct 2015, at 16:13, Adam Holmberg wrote: > > It's timing out at the default of two seconds while trying to query and build > the schema metadata. You can raise this timeout: > http://datastax.github.io/python-driv

Re: memtable flush size with LCS

2015-10-29 Thread Ken Hancock
Or if you're doing a high volume of writes, then your flushed file size may be completely determined by other CFs that have consumed the commitlog size, forcing any memtables whose commitlog is being delete to be forced to disk. On Wed, Oct 28, 2015 at 2:51 PM, Jeff Jirsa wrote: > It’s worth men

Re: Error Connecting to Cassandra

2015-10-29 Thread Adam Holmberg
It's timing out at the default of two seconds while trying to query and build the schema metadata. You can raise this timeout: http://datastax.github.io/python-driver/api/cassandra/cluster.html#cassandra.cluster.Cluster.control_connection_timeout Adam On Thu, Oct 29, 2015 at 10:06 AM, Eduardo Alf

Re: Error Connecting to Cassandra

2015-10-29 Thread Eduardo Alfaia
I have gotten the log from the application.{\rtf1\ansi\ansicpg1252\cocoartf1404\cocoasubrtf130 {\fonttbl\f0\fswiss\fcharset0 Helvetica;} {\colortbl;\red255\green255\blue255;} \paperw11900\paperh16840\margl1440\margr1440\vieww10800\viewh8400\viewkind0 \pard\tx566\tx1133\tx1700\tx2267\tx2834\tx3401\t

Re: Error Code

2015-10-29 Thread Eduardo Alfaia
I am using a python driver from DataStax. Cassandra driver 2.7.2 > On 29 Oct 2015, at 15:26, Chris Lohfink wrote: > > It means a response (opcode 8) message couldn't be decoded. What driver are > you using? What version? What version of C*? > > Chris > > On Thu, Oct 29, 2015 at 9:19 AM, Eduard

Re: Re : Data restore to a new cluster

2015-10-29 Thread Luigi Tagliamonte
+1 also interested about an official documentation about this. On Mon, Oct 26, 2015 at 5:12 PM, sai krishnam raju potturi < pskraj...@gmail.com> wrote: > hi; >we are working on a data backup and restore procedure to a new cluster. > We are following the datastax documentation. It mentions a

Re: Error Code

2015-10-29 Thread Chris Lohfink
It means a response (opcode 8) message couldn't be decoded. What driver are you using? What version? What version of C*? Chris On Thu, Oct 29, 2015 at 9:19 AM, Eduardo Alfaia wrote: > yes, but what does it mean? > > On 29 Oct 2015, at 15:18, Kai Wang wrote: > > > https://github.com/datastax/py

Re: Error Code

2015-10-29 Thread Eduardo Alfaia
yes, but what does it mean? > On 29 Oct 2015, at 15:18, Kai Wang wrote: > > https://github.com/datastax/python-driver/blob/75ddc514617304797626cc69957eb6008695be1e/cassandra/connection.py#L573 > >

Re: Error Code

2015-10-29 Thread Kai Wang
https://github.com/datastax/python-driver/blob/75ddc514617304797626cc69957eb6008695be1e/cassandra/connection.py#L573 Is your error message complete? On Thu, Oct 29, 2015 at 9:45 AM, Eduardo Alfaia wrote: > Hi Guys, > > Does anyone know what error code in cassandra is? > > Error decoding respons

Error Code

2015-10-29 Thread Eduardo Alfaia
Hi Guys, Does anyone know what error code in cassandra is? Error decoding response from Cassandra. opcode: 0008; Thanks

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Clint Martin
Generating the time uuid on the server side via the now() function also makes the operation non idempotent. This may not be a huge problem for your application but it is something to keep in mind. Clint On Oct 29, 2015 9:01 AM, "Kai Wang" wrote: > If you want the timestamp to be generated on the

Weird replace_address issue in 1.2

2015-10-29 Thread Carlos Alonso
Hi guys. Tonight one of our 3 nodes cluster has died. This is Cassandra 1.2. and RF = 3 After bringing up a new node and starting it with -Dreplace_address of the dead one different things are happening. On the new node nodetool status is showing the expected ring (him along with the other two w

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Kai Wang
If you want the timestamp to be generated on the C* side, you need to sync clocks among nodes to the nanosecond precision first. That alone might be hard or impossible already. I think the safe bet is to generate the timestamp on the client side. But depending on your data volume, if data comes fro

RE: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread chandrasekar.krc
Hi Doan, Is the timeBased() method available in Java driver similar to now() function in cqlsh. Does both provide identical results. Also, the preference is to generate values during record insertion from database side, rather than client side. Something similar to SYSTIMESTAMP in Oracle. Reg

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Jon Haddad
Keep in mind that in a distributed environment you probably have so much variance that nanosecond precision is pointless. Even google notes that in the paper, Dapper, a Large-Scale Distributed Systems Tracing Infrastructure [http://research.google.com/pubs/pub36356.html

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread DuyHai Doan
You can use TimeUUID data type and provide the value yourself from client side. The Java driver offers an utility class com.datastax.driver.core.utils.UUIDs and the method timeBased() to generate the TimeUUID. The precision is only guaranteed up to 100 nano seconds. So you can have possibly 10k

Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread chandrasekar.krc
Hi, Oracle Timestamp data type supports fractional seconds (upto 9 digits, 6 is default). What is the Cassandra equivalent data type for Oracle TimeStamp nanosecond precision. This is required for determining the order of insertion of record where the number of records inserted per sec is clos

Re: Cassandra security using openssl or keytool

2015-10-29 Thread Vishwajeet Singh
But I want to do using OpenSSL because It's my requirement. Can somebody please guide me, How I will do Cassandra Client to node security using SSL and I want to use OpenSSL (Not keytool). On Thu, Oct 29, 2015 at 12:40 PM, Jason Williams wrote: > Because when you use keytool it stores the gener

nodetool status Load not same with disk used

2015-10-29 Thread qihuang.zheng
We have some nodes Load too large, but some are normal. [qihuang.zheng@cass047221 forseti]$ /usr/install/cassandra/bin/nodetool status -- AddressLoadTokens Owns Host ID Rack UN 192.168.47.221 2.66 TB 256 8.7% 87e100ed-85c4-44cb-9d9f-2d602d016038 RAC1 UN

Re: Cassandra security using openssl or keytool

2015-10-29 Thread Jason Williams
Because when you use keytool it stores the generated private key in the keystore and tags it waiting for the certificate. Then when you import the issued certificate it is paired in the same record with the key. It's a real pain to get OpenSSL encoded private keys into a keytool keystore. Don't

Cassandra security using openssl or keytool

2015-10-29 Thread Vishwajeet Singh
Hi, I saw Cassandra documentation. http://docs.datastax.com/en/cassandra/2.1/cassandra/security/secureSSLCertificates_t.html I found this line "SSL certificates must be generated using keytool". Can somebody explain me why SSL certificates must be generated using keytool? Can we use OpenSSL fo