Upgrade from 1.2.x to 2.0.x, upgradesstables has doubled the size on disk?

2017-12-29 Thread Dan Washusen
Hi All, We're taking advantage of the lull in traffic to go through a production cluster upgrade from 1.2.x (latest) to 2.0.x (latest). We have three nodes with a replication factor of three. I've noticed that the 'space used' has almost doubled as a result of running 'nodetool upgradesstables'. A

Re: Upgrade from 1.2.x to 2.0.x, upgradesstables has doubled the size on disk?

2017-12-30 Thread Dan Washusen
andra/data/dp/s_evt/dp-s_evt-jb-302,]. 9,663,696,752 bytes to 4,834,895,601 (~50% of original) in 3,899,888ms = 1.182320MB/s. 90,533 total partitions merged to 45,278. Partition merge counts were {1:23, 2:45255, } Dan Washusen On Sun, Dec 31, 2017 at 1:51 AM, Jeff Jirsa wrote: > 1.2 to 2

Re: Upgrade from 1.2.x to 2.0.x, upgradesstables has doubled the size on disk?

2017-12-30 Thread Dan Washusen
Nope, just ran out of disk space... So on 1.2.x I had 70GB used on a 200GB disk and everything was great, with 2.0.x I'm now at 99% used and getting exception while compacting about insufficient disk space. FML... Dan Washusen On Sun, Dec 31, 2017 at 6:47 AM, Dan Washusen wrote: > Th

Re: Configuring cassandra cluster with host preferences

2012-05-14 Thread Dan Washusen
It's not possible 'out of the box' but you could implement your own org.scale7.cassandra.pelops.pool.CommonsBackedPool.INodeSelectionStrategy that chooses the desired node. -- Dan Washusen Make big files fly visit digitalpigeon.com (http://digitalpigeon.com) On Tuesday, 15 M

Re: which high level Java client

2012-06-28 Thread Dan Washusen
Pelops is a very thin wrapper over the Thrift client so that could be a good option. You could also check out a fork by the VMWare/Spring guys which adds full async support: https://github.com/andrewswan/scale7-pelops. I'm not sure on the state of it, but it seems promising... On Thursday

Re: RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Dan Washusen
Pelops raises a RuntimeException? Can you provide more info please? -- Dan Washusen Make big files fly visit digitalpigeon.com On Tuesday, 5 April 2011 at 11:43 PM, Héctor Izquierdo Seliva wrote: El mar, 05-04-2011 a las 09:35 -0400, Dan Hendry escribió: > > I too have seen the out of se

Re: RE: batch_mutate failed: out of sequence response

2011-04-06 Thread Dan Washusen
ed on these type property of TApplicationException? Cheers, Dan On Wednesday, 6 April 2011 at 8:03 PM, Héctor Izquierdo Seliva wrote: El mié, 06-04-2011 a las 09:06 +1000, Dan Washusen escribió: > > Pelops raises a RuntimeException? Can you provide more info please? >

Re: RE: batch_mutate failed: out of sequence response

2011-04-07 Thread Dan Washusen
he also using Pelops? From his comment about retrying I'd assume not... -- Dan Washusen On Thursday, 7 April 2011 at 7:39 PM, Héctor Izquierdo Seliva wrote: > El mié, 06-04-2011 a las 21:04 -0500, Jonathan Ellis escribió: > > "out of sequence response" is thrift's way o

Re: Atomicity Strategies

2011-04-08 Thread Dan Washusen
Here's a good writeup on how fightmymonster.com does it... http://ria101.wordpress.com/category/nosql-databases/locking/ -- Dan Washusen Make big files fly visit digitalpigeon.com On Saturday, 9 April 2011 at 11:53 AM, Alex Araujo wrote: On 4/8/11 5:46 PM, Drew Kutcharian wrote: &g

Re: RE: batch_mutate failed: out of sequence response

2011-04-14 Thread Dan Washusen
I've looked over the Pelops code again and I really can't see how it could be at fault here... -- Dan Washusen On Wednesday, 13 April 2011 at 3:20 AM, Stephen McKamey wrote: > [I wrote this Apr 10, 2011 at 12:09 but my message seems to have gotten lost > along the way.] >

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
connections is all cases *except* NotFoundException. Cheers, -- Dan Washusen On Friday, 8 April 2011 at 7:28 AM, Dan Washusen wrote: > Pelops uses a single connection per operation from a pool that is backed by > Apache Commons Pool (assuming you're using Cassandra 0.7). I'm no

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
connection and Cassandra throws an ApplicationException A Pelops test case for this can be found here: https://github.com/s7/scale7-pelops/blob/3fe7584a24bb4b62b01897a814ef62415bd2fe43/src/test/java/org/scale7/cassandra/pelops/MutatorIntegrationTest.java#L262 Cheers, -- Dan Washusen On Tuesday

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
Sure is: scale7-pelops-1.1-0.7.x-20110418.225848-3.jar Cheers, -- Dan Washusen On Tuesday, 19 April 2011 at 3:58 PM, Héctor Izquierdo Seliva wrote: > Thanks Dan for fixing that! Is the change integrated in the latest maven > snapshot? > > El mar, 19-04-2011 a las 10:48 +1000,

0.7.5 Debian packages - can't upgrade?

2011-04-29 Thread Dan Washusen
Hey all, I can't seem upgrade to 0.7.5 using the Debian packages. Here's what I've done... Edited sources.list and changed "unstable" to "07x". > deb http://www.apache.org/dist/cassandra/debian 07x main > deb-src http://www.apache.org/dist/cassandra/debian 07x main Add the new key. > sudo gp

Re: 0.7.5 Debian packages - can't upgrade?

2011-04-29 Thread Dan Washusen
;: http://pastebin.com/PqRiGmWi On 30 April 2011 11:18, Eric Evans wrote: > On Sat, 2011-04-30 at 09:34 +1000, Dan Washusen wrote: > > > sudo aptitude update > > > > sudo aptitude safe-upgrade > > > > > > The upgrade shows this: > > > > > Read

Re: 0.7.5 Debian packages - can't upgrade?

2011-04-30 Thread Dan Washusen
It looks like it's an issue with Ubuntu 9.10 (or my install of 9.10). Tried on a machine running 10.04 and it works fine... On 30 April 2011 12:35, Dan Washusen wrote: > Thanks for the response. :) > > I should have also mentioned that I'm running this on Ubuntu Karmic

Re: Cassandra Clients for Java

2011-06-17 Thread Dan Washusen
I've added some comments/questions inline... Cheers, -- Dan Washusen On Saturday, 18 June 2011 at 8:02 AM, Daniel Colchete wrote: > Good day everyone! > > I'm getting started with a new project and I'm thinking about using Cassandra > because of its distributed

Re: Pelops authentication

2011-09-05 Thread Dan Washusen
You can set up an instance of org.scale7.cassandra.pelops.SimpleConnectionAuthenticator and pass it to org.scale7.cassandra.pelops.IConnection.Config. Cheers, Dan On Monday, 5 September 2011 at 4:24 PM, lacosa2...@libero.it wrote: > Hi, > I wanna know if exists and how to implement authentic

Re: Pelops - a new Java client library paradigm

2010-06-12 Thread Dan Washusen
Very nice! You mention that the connections are handled internally by Pelops, does that mean that potentially a different connection is used for each operation performed? I had assumed using the same connection for several operations with ConsistencyLevel.ONE would provide a basic level of atomic

Re: Pelops - a new Java client library paradigm

2010-06-12 Thread Dan Washusen
> <http://issues.apache.org/jira/browse/CASSANDRA-132> > http://issues.apache.org/jira/browse/CASSANDRA-132 > > On Jun 12, 2010, at 5:48 PM, Dan Washusen wrote: > > Very nice! > > You mention that the connections are handled internally by Pelops, does > that mean that pote

Re: Pelops 'up and running' post question + WTF is a SuperColumn => really confused.

2010-07-02 Thread Dan Washusen
L1Tickets = { // column family userId: { // row key 42C120DF-D44A-44E4-9BDC-2B5439A5C7B4: { category: "videoPhone", reportType: "POOR_PICTURE", ...}, 99B60047-382A-4237-82CE-AE53A74FB747: { category: "somethingElse", reportType: "FOO", ...} } } On 3 July 2010 02:29, S Ahmed

Re: Using Pelops with Cassandra 0.7.X

2010-07-13 Thread Dan Washusen
http://github.com/danwashusen/pelops/tree/cassandra-0.7.0 p.s. Pelops doesn't have any test coverage and my implicit tests (my app integration tests) don't touch anywhere near all of the Pelops API. p.s.s. I've made API breaking changes to support the new 0.7.0 API and Dominic (the original Pelop

Re: Upgrading to Cassanda 0.7 Thrift Erlang

2010-07-31 Thread Dan Washusen
Slightly off topic but still related (java instead of erlang). I just tried using the latest trunk build available on Hudson (2010-07-31_12-31-29) and I'm getting lock ups. The same code (without the framed transport) was working with a build form 2010-07-07_13-32-16 I'm connecting using the fol

Re: Upgrading to Cassanda 0.7 Thrift Erlang

2010-07-31 Thread Dan Washusen
p.s. If I set thrift_framed_transport_size_in_mb to 0 and just use TSocket instead of TFramedTransport everything works as expected... On 1 August 2010 12:16, Dan Washusen wrote: > Slightly off topic but still related (java instead of erlang). I just > tried using the latest trunk

Re: too many open files 0.7.0 beta1

2010-08-25 Thread Dan Washusen
Maybe you're seeing this: https://issues.apache.org/jira/browse/CASSANDRA-1416 On Thu, Aug 26, 2010 at 2:05 PM, Aaron Morton wrote: > Under 0.7.0 beta1 am seeing cassandra run out of files handles... > > Caused by: java.io.FileNotFoundException: /local1/junkbox/cassandra/data/ > junkbox.wetafx.co

Re: Error when compile pelops

2010-09-13 Thread Dan Washusen
I just downloaded the jar file in question and it seems fine... > wget -O cassandra.jar > http://github.com/s7/mvnrepo/raw/master/org/apache/cassandra/cassandra/0.7.0-2010-09-12_19-23-07/cassandra-0.7.0-2010-09-12_19-23-07.jar&&; > unzip -t cassandra.jar Which version of Maven are you using? O

Re: Running out of heap

2010-09-22 Thread Dan Washusen
http://wiki.apache.org/cassandra/FAQ#i_deleted_what_gives That help? On Wed, Sep 22, 2010 at 5:27 PM, Chris Jansen < chris.jan...@cognitomobile.com> wrote: > Hi all, > > > > I have written a test application that does a write, read and delete on one > of the sample column families that ship with

Re: Running out of heap

2010-09-22 Thread Dan Washusen
I > see is the usage grow then shrink, but it despite the periodic compaction > the overall result is a slow but steady growth. > > > > Regards, > > > > Chris > > > > *From:* Dan Washusen [mailto:d...@reactive.org] > *Sent:* 22 September 2010 08:39

Re: What is the correct way of changing a partitioner?

2010-10-18 Thread Dan Washusen
http://wiki.apache.org/cassandra/DistributedDeletes >From the http://wiki.apache.org/cassandra/StorageConfiguration page: > Achtung! Changing this parameter requires wiping your data directories, > since the partitioner can modify the !sstable on-disk format. So delete your data and commit log

Re: HintedHandoff and ReplicationFactor with a downed node

2010-10-22 Thread Dan Washusen
The last time this came up on the list Jonathan Ellis said (something along the lines of) if your application can't tolerate stale data then you should read with a consistency level of QUORUM. It would be nice if there was some sort of middle ground for an application that can tolerate slightly st

cassandra-cli multiline commands?

2010-11-23 Thread Dan Washusen
I notice CASSANDRA-1742 mentions support for commands that span multiple lines in cassandra-cli. Did it make it in? If so what's the syntax? Cheers, Dan

Re: Range Queries in RP on SCF in 0.7 with UUID SCs

2010-12-01 Thread Dan Washusen
Using the methods on the Bytes class would be preferable. The byte[] related methods on UuidHelper should have been deprecated with the Bytes class was introduced... e.g. new Bytes(col.getName()).toUuid() Cheers, Dan On Thu, Dec 2, 2010 at 10:26 AM, Frank LoVecchio wrote: > Actually, it was a

Re: Java cient

2011-01-19 Thread Dan Washusen
Pelops is pretty thin wrapper for the Thrift API. It's thinness has both up and down sides; on the up side it's very easy to map functionality mentioned on the Cassandra API wiki page to functionality provided by Pelops, it is also relatively simple to add features (thanks to Alois^^ for indexing

Re: Java cient

2011-01-22 Thread Dan Washusen
g > dependency. Hector API's could have been simpler but I plan to > abstract the most commonly used functionality in a simpler set of APIs > > On Thu, Jan 20, 2011 at 11:06 AM, Dan Washusen wrote: > > Pelops is pretty thin wrapper for the Thrift API. It's thinness has bo

Re: Re: R: Re: Ring up but read fails ...

2011-01-23 Thread Dan Washusen
This is a known issue with the Cassandra 0.6 versions of Pelops. The issue was fixed in the 0.7 based versions a few months ago but never back-ported (Dominic, myself and the other contributors don't run 0.6)... On 24 January 2011 05:25, cbert...@libero.it wrote: > > Reconnect and try again? >

Re: seed node failure crash the whole cluster

2011-02-07 Thread Dan Washusen
Hi, I've added some comments and questions inline. Cheers, Dan On 8 February 2011 10:00, Jonathan Ellis wrote: > On Mon, Feb 7, 2011 at 1:51 AM, TSANG Yiu Wing wrote: > > cassandra version: 0.7 > > > > client library: scale7-pelops / 1.0-RC1-0.7.0-SNAPSHOT > > > > cluster: 3 machines (A, B, C)

Re: Another EOFException

2011-02-15 Thread Dan Washusen
I'm seeing this as well; several column families with keys_cached = 0 on 0.7.1. Debug level logs: http://pastebin.com/qvujKDth -- Dan Washusen On Wednesday, 16 February 2011 at 1:12 PM, Jonathan Ellis wrote: > Created https://issues.apache.org/jira/browse/CASSANDRA-2172. > >

Re: Are row-keys sorted by the compareWith?

2011-02-20 Thread Dan Washusen
h row entry are definitely in the order that Cassandra provides them, take a look at org.scale7.cassandra.pelops.Selector#toColumnList if you need more info. Cheers, Dan -- Dan Washusen Sent with Sparrow On Saturday, 19 February 2011 at 8:16 AM, cbert...@libero.it wrote: > Hi all, > I crea

Re: I: Re: Are row-keys sorted by the compareWith?

2011-02-23 Thread Dan Washusen
Hi Matthew, As you mention the map returned from multiget_slice is not order preserving, Pelops is doing this on the client side... Cheers, Dan -- Dan Washusen Sent with Sparrow On Wednesday, 23 February 2011 at 8:38 PM, Matthew Dennis wrote: > The map returned by multiget_slice (wha

Re: I: Re: Are row-keys sorted by the compareWith?

2011-03-01 Thread Dan Washusen
Pelops moved to github several months ago... https://github.com/s7/scale7-pelops/blob/master/src/main/java/org/scale7/cassandra/pelops/Selector.java#L1179 Cheers, -- Dan Washusen On Wednesday, 2 March 2011 at 3:35 AM, Matthew Dennis wrote: > I'm not really familiar with pelops cod

OOM during compaction with half the heap still available?

2011-03-24 Thread Dan Washusen
ink) with nmap disabled on Java 1.6.0_24-b07. I'm now running 0.7.4 with nmap enabled and just got the same crash (based on the error message in the log)... Log snippet from crash that matches screenshot: http://pastebin.com/ACa8fKUu Log snippet from 0.7.4 crash: http://pastebin.com/SwSQawUM Cheers, -- Dan Washusen

Re: OOM during compaction with half the heap still available?

2011-03-24 Thread Dan Washusen
Ah, it would appear I forgot to do that on the hudson machine. Thanks! -- Dan Washusen On Friday, 25 March 2011 at 2:23 PM, Jonathan Ellis wrote: > Have you run nodetool scrub? The data versioning problem scrub fixes > can manifest itself as trying to read GB of data into memory