Re: Recommended hardware

2013-09-23 Thread Franc Carter
Far from expert opinion, however one configuration I have seen talked about is 3 x m1.xlarge in AWS. I have tested 4 x m1.xlarge and 4 x m1.large. The m1.xlarge was fine for out tests (we were hitting it pretty hard), the m1.large was eratic - from that I took way that you either need to give Cas

Re: Recommended hardware

2013-09-23 Thread Jan Algermissen
Tim, On 23.09.2013, at 18:17, Tim Dunphy wrote: > Hello, > > I am running Cassandra 2.0 on a 2gb memory 10 gb HD in a virtual "cloud" > environment. It's supporting a php application running on the same node. I have played with C* (1.2 and 2.0) in a low-RAM environment the last month. The ma

Re: Recommended hardware

2013-09-23 Thread Michał Michalski
Hi Tim, Not sure if you've seen this, but I'd start from DataStax's documentation: http://www.datastax.com/documentation/cassandra/2.0/webhelp/index.html#cassandra/architecture/architecturePlanningAbout_c.html?pagename=docs&version=1.2&file=cluster_architecture/cluster_planning Taking a look at

Re: 答复: Frequent Full GC that take > 30s

2013-09-23 Thread Mohit Anchlia
Your ParNew size is way too small. Generally 4GB ParNew (-Xmn) works out best for 16GB heap On Mon, Sep 23, 2013 at 9:05 PM, 谢良 wrote: > it looks to me that "MaxTenuringThreshold" is too small, do you have any > chance to try with a bigger one, like 4 or 8 or sth else? > > __

答复: Frequent Full GC that take > 30s

2013-09-23 Thread 谢良
it looks to me that "MaxTenuringThreshold" is too small, do you have any chance to try with a bigger one, like 4 or 8 or sth else? 发件人: André Cruz [andre.c...@co.sapo.pt] 发送时间: 2013年9月23日 22:51 收件人: user@cassandra.apache.org 主题: Frequent Full GC that take

Re: cass 1.2.8 -> 1.2.9

2013-09-23 Thread Robert Coli
On Wed, Sep 11, 2013 at 7:42 AM, Christopher Wirt wrote: > I tried upgrading one server in a three node DC. > > ** > > [...] > Had to rollback sharpish as this was a live system. > Did you ever determine what happened here? What is your RF and CL? =Rob

Re: Issue with leveled compaction and data migration

2013-09-23 Thread Mike
Thanks for the response Rob, And yes, the relevel helped the bloom filter issue quite a bit, although it took a couple of days for the relevel to complete on a single node (so if anyone tried this, be prepared) -Mike Sent from my iPhone On Sep 23, 2013, at 6:34 PM, Robert Coli wrote: > On F

Re: Issue with leveled compaction and data migration

2013-09-23 Thread Robert Coli
On Fri, Sep 13, 2013 at 4:27 AM, Michael Theroux wrote: > Another question on [the topic of row fragmentation when old rows get a > large append to their "end" resulting in larger-than-expected bloom > filters]. > > Would forcing the table to relevel help this situation? I believe the > process t

Re: All subsequent CAS requests time out after heavy use of new CAS feature

2013-09-23 Thread Robert Coli
On Mon, Sep 16, 2013 at 9:09 AM, Jan Algermissen wrote: > I am experimenting with C* 2.0 ( and today's java-driver 2.0 snapshot) for > implementing distributed locks. > [ and I'm experiencing the problem described in the subject ... ] > Any idea how to approach this problem? > 1) Upgrade to 2

Re: Cassandra 1.2: old node does not want to re-join the ring

2013-09-23 Thread Robert Coli
On Mon, Aug 26, 2013 at 5:39 AM, Denis Kot wrote: > Please help. We spent almost 3 days trying to fix it with no luck. > Did you ultimately succeed in this task? =Rob

Re: Memtable flush blocking writes

2013-09-23 Thread Robert Coli
On Fri, Aug 23, 2013 at 10:35 AM, Ken Hancock wrote: > I appear to have a problem illustrated by > https://issues.apache.org/jira/browse/CASSANDRA-1955. At low data > rates, I'm seeing mutation messages dropped because writers are > blocked as I get a storm of memtables being flushed. OpsCenter >

Re: Moving a cluster between networks.

2013-09-23 Thread Robert Coli
On Fri, Aug 23, 2013 at 9:39 AM, Tim Wintle wrote: > I tried a quick test on local VMs before an it appeared to work, but I'm > still a little worried if the old ip addresses would appear through some > process that only kicks in in a realistic use. > > I'll try to set up a more realistic simulat

Counters way off.

2013-09-23 Thread Stephanie Jackson
Hi all, I'm working on getting a new cassandra implementation up and functional. We're running cassandra 2.0 on Centos 6.4. Right now, the issue that we've run into is that counters are vastly different depending on what hosts they're hitting. Our keyspace has a replication factor of 2, which

Re: Row Mutation Errors while upgrading to Cassandra2.0

2013-09-23 Thread sankalp kohli
"It is quite possible that this is expected, major version upgrades semi-frequently spam logs with non-pathological error messages." The exception is while trying to deserialize the endpoints in the remote DC. Due to this error, the mutation will not be applied to any node in the remote DC. On M

Re: Is it possible to control the sstable file size in incremental backup or snapshot

2013-09-23 Thread Robert Coli
On Fri, Sep 20, 2013 at 6:56 PM, java8964 java8964 wrote: > I noticed the snapshot and incremental backup sstable files size generated > from our production environment vary dramatically. Some files can be > hundreds of M, or even close to G, but a lot of files are even less than 1k > bytes, espec

Re: Row Mutation Errors while upgrading to Cassandra2.0

2013-09-23 Thread Robert Coli
On Sun, Sep 22, 2013 at 7:02 PM, Shashilpi Krishan < shashilpi.kris...@wizecommerce.com> wrote: > We had a Cassandra cluster (running with v1.0.7) spread across 3 data > centers with each data center having 16 nodes. We started upgrading that to > 2.0 but realized that we can’t go directly to 2.0

Re: Commit log and data separation on SSD

2013-09-23 Thread Andrey Ilinykh
Actually, many SSD drives show much better performance for sequential write then random writes, so you may benefit from a separate drive for commit logs. On Mon, Sep 23, 2013 at 11:21 AM, Robert Coli wrote: > On Sun, Sep 22, 2013 at 4:02 PM, Shahryar Sedghi wrote: > >> This my first SSD experi

Re: Commit log and data separation on SSD

2013-09-23 Thread Robert Coli
On Sun, Sep 22, 2013 at 4:02 PM, Shahryar Sedghi wrote: > This my first SSD experience. With normal disks we separate commit log > from data. We have 2 SSDs dedicated to Cassandra I was wondering if we > gain a better performance if we put commit log in one and data in > another, or just use

Re: Row Mutation Errors while upgrading to Cassandra2.0

2013-09-23 Thread sankalp kohli
I have not used 2.0 but plainly looking at the code for this exception this is what I am seeing. So in multi DC deployments, the co-ordinator node sends a write to only one node in other data center. Now this node in other DC forwards it to other local nodes if the replication in that DC is more th

Re: [Pig] ERROR 2118: Could not get input splits

2013-09-23 Thread Cyril Scetbon
I get less issues with Pig 0.9.2 but still some. It seems to depend on the script too. I have less issues if i change the script to get only 1 job created, ie when I use 1 dump instead of 2. FYI, I have only 3 rows Regards -- Cyril SCETBON On Sep 21, 2013, at 7:55 AM, Janne Jalkanen wrote: >

composite with null prefix in CQL3(porting from thrift)

2013-09-23 Thread Hiller, Dean
I ran into this same issue on this stackoverflow post… http://stackoverflow.com/questions/18963248/how-can-i-have-null-column-value-for-a-composite-key-column-in-cql3 Does anyone know how to have the same composite column name pattern that enables wide rows with a null value? Ie. We had some in

Re: how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-09-23 Thread Cyril Scetbon
I tried with 1.2.10 and don't meet the issue anymore. Regards -- Cyril SCETBON On Sep 19, 2013, at 10:28 PM, Cyril Scetbon wrote: > Hi, > > Did you try to build 1.2.10 and to use it for your tests ? I've got the same > issue and will give it a try as soon as it's released (expected at the en

Recommended hardware

2013-09-23 Thread Tim Dunphy
Hello, I am running Cassandra 2.0 on a 2gb memory 10 gb HD in a virtual "cloud" environment. It's supporting a php application running on the same node. Mostly this instance runs smoothly but runs low on memory. Depending on how much the site is used, the VM will swap out sometimes excessively.

FYI - Pig CQL queries in Cassandra 1.2.10

2013-09-23 Thread Chad Johnston
I don't see this formally documented anywhere, so I thought I'd give a heads-up to folks using Pig with Cassandra. In pre-1.2.10 versions, storing data into Cassandra required a query like this: STORE data INTO 'cql://keyspace/table?output_query=update table set some_value @ #' USING CqlStorage();

Frequent Full GC that take > 30s

2013-09-23 Thread André Cruz
Hello. I'm having problems with frequent Full GCs that take a long time, and cause a burst of timeouts for the client application. But first, here is my configuration: Cassandra: 1.1.5 Key Cache: size 209715168 (bytes), capacity 209715168 (bytes), 1331992571 hits, 1831790912 requests,

Re: Bad Request: Invalid null value for clustering key part

2013-09-23 Thread Sylvain Lebresne
> Is it not permitted to have null values in a field that is part a primary > key? > It's not. > This seems to be ok when using the java-driver > Are you sure? Because that would qualify as a bug (in the sense that it's not supported by C* so there is not reason why this would work with any dri

[RELEASE] Apache Cassandra 2.0.1 released

2013-09-23 Thread Sylvain Lebresne
The Cassandra team is pleased to announce the release of Apache Cassandra version 2.0.1. Cassandra is a highly scalable second-generation distributed database, bringing together Dynamo's fully distributed design and Bigtable's ColumnFamily-based data model. You can read more here: http://cassand

Re: Nodes separating from the ring

2013-09-23 Thread Chris Burroughs
I have observed one problem with an inconsistent ring that is superficially similar (node thinks it's up but peers disagree) and noted details in CASSANDRA-6082. However, it does not sound like the details of either the symptoms, or the resolution match what you describe. If you have not alre

Bad Request: Invalid null value for clustering key part

2013-09-23 Thread Petter von Dolwitz (Hem)
I'm trying to import some rows to a table using the COPY command. I have a PRIMARY KEY that is built up from many fields. During the import I get Bad Request: Invalid null value for clustering key part {field_name} Is it not permitted to have null values in a field that is part a primary key? Thi

RE: Row Mutation Errors while upgrading to Cassandra2.0

2013-09-23 Thread Shashilpi Krishan
Thanks for replying Sankalp One has to start and test, and we have many such clusters and this cluster hold trivial data and a candidate for the trial. But if others also are seeing problems with 2.0 then we won't proceed to do that on our main clusters and let them upgrade to 1.2.9 only. Befo

[RELEASE] Apache Cassandra 1.2.10 released

2013-09-23 Thread Sylvain Lebresne
The Cassandra team is pleased to announce the release of Apache Cassandra version 1.2.10. Cassandra is a highly scalable second-generation distributed database, bringing together Dynamo's fully distributed design and Bigtable's ColumnFamily-based data model. You can read more here: http://cassan