Re: Data Modeling- another question

2012-08-27 Thread Guy Incognito
i would respectfully disagree, what you have said is true but it really depends on the use case. 1) do you expect to be doing updates to individual fields of an item, or will you always update all fields at once? if you are doing separate updates then the first is definitely easier to handle

Re: Cassandra 1.1.4 RPM required

2012-08-27 Thread aaron morton
>> Dear Aaron, Its required username and password which I have not. Can yo >> share direct link? There is no security on the wiki, you should be able to see http://wiki.apache.org/cassandra/GettingStarted What about this page ? http://wiki.apache.org/cassandra/DebianPackaging Cheers --

Re: Order of the cyclic group of hashed partitioners

2012-08-27 Thread aaron morton
Sorry I don't understand your question. Can you explain it a bit more or maybe someone else knows. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 27/08/2012, at 7:16 PM, Romain HARDOUIN wrote: > > Thank you Aaron. > This limit was pus

Re: TTL and Cassandra counters

2012-08-27 Thread aaron morton
> but we fail to see how we can define a > call back which will trigger an update (decrease) to the counters’ value. It's not possible. TTL kind of works in two steps. First we stop returning the column in results, later the column will be purged during compaction. So there is no "hey this tim

Re: JMX(RMI) dynamic port allocation problem still exists?

2012-08-27 Thread Nick Bailey
The problem still exists. There was a discussion about resolving inside cassandra here: https://issues.apache.org/jira/browse/CASSANDRA-2967 But the ultimate resolution was that since workarounds like the one you mentioned exist it would be left as is for now. On Mon, Aug 27, 2012 at 6:07 PM, Ya

Re: QUORUM writes, QUORUM reads -- and eventual consistency

2012-08-27 Thread Philip O'Toole
Cool - thanks to all for the replies. I believe I have what I need now. Philip On Aug 25, 2012, at 12:17 AM, Guillermo Winkler wrote: > Hi Philip, > > From http://wiki.apache.org/cassandra/ArchitectureOverview > > Quorum write: blocks until quorum is reached > > By my understanding if you

Re: Automating nodetool repair

2012-08-27 Thread Aaron Turner
I use cron. On one box I just do: for n in node1 node2 node3 node4 ; do nodetool -h $n repair sleep 120 done A lot easier then managing a bunch of individual crontabs IMHO although I suppose I could of done it with puppet, but then you always have to keep an eye out that your repairs don't

Automating nodetool repair

2012-08-27 Thread Edward Sargisson
Hi all, So nodetool repair has to be run regularly on all nodes. Does anybody have any interesting strategies or tools for doing this or is everybody just setting up cron to do it? For example, one could write some Puppet code to splay the cron times around so that only one should be running

Re: cassandra twitter ruby client

2012-08-27 Thread Yuhan Zhang
Hi Peter, works well. Thanks for lot! :D will check out cassandra-cql. Yuhan On Mon, Aug 27, 2012 at 3:34 PM, Peter Sanford wrote: > That library requires you to serialize and deserialize the data > yourself. So to insert a ruby Float you would > > value = 28.21 > [value].pack('G') > @

sstableloader error

2012-08-27 Thread Swathi Vikas
Hi,   I had uploaded data using sstablelaoder to a single node cluster earlier without any problem. Now, while trying to upload to 3 node cluster it is giving me below error:   localhost:~/apache-cassandra-1.0.7/sstableloader_folder # bin/sstableloader DEMO/ Starting client (and waiting 30 seco

Re: Dynamic Column Families in CQLSH v3

2012-08-27 Thread aaron morton
It's not possible to have Dynamic Columns in CQL 3. The CF definition must specify the column names you expect to store. The COMPACT STORAGE (http://www.datastax.com/docs/1.1/references/cql/CREATE_COLUMNFAMILY) clause of the Create CF statement means can have column names that are part dynamic

Re: Expanding cluster to include a new DR datacenter

2012-08-27 Thread Mohit Anchlia
Can you describe your schema again with TierPoint in it? On Mon, Aug 27, 2012 at 3:22 PM, Bryce Godfrey wrote: > Same results. I restarted the node also to see if it just wasn’t > picking up the changes and it still shows Simple. > > ** ** > > When I specify the DC for strategy_options I

Re: cassandra twitter ruby client

2012-08-27 Thread Peter Sanford
That library requires you to serialize and deserialize the data yourself. So to insert a ruby Float you would value = 28.21 [value].pack('G') @client.insert(:somecf, 'key', {'floatval' => [value].pack('G')}) and to read it back out: value = @client.get(:somecf, 'key', ['floatval']).unpac

RE: Expanding cluster to include a new DR datacenter

2012-08-27 Thread Bryce Godfrey
Same results. I restarted the node also to see if it just wasn't picking up the changes and it still shows Simple. When I specify the DC for strategy_options I should be using the DC name from properfy file snitch right? Ours is "Fisher" and "TierPoint" so that's what I used. From: Mohit Anc

Re: Counters and replication factor

2012-08-27 Thread Radim Kolar
Dne 25.5.2012 2:41, Edward Capriolo napsal(a): Also it does not sound like you have run anti entropy repair. You should do that when upping rf. i run entropy repairs and it still does not fix counters. I have some reports from users with same problem but nobody discovered repeatable scenario.

Re: JMX(RMI) dynamic port allocation problem still exists?

2012-08-27 Thread Yang
no, the priblem is that jmx listens on 7199, once an incoming connection is made, it literally tells the other side "come and connect to me on these 2 rmi ports", and open up 2 random Rmi ports we used to use the trick in the above link to resolve this On Aug 27, 2012 3:04 PM, "Hiller, Dean" w

Re: JMX(RMI) dynamic port allocation problem still exists?

2012-08-27 Thread Hiller, Dean
In cassandra-env.sh, search on JMX_PORT and it is set to 7199 (ie. Fixed) so that solves your issue, correct? Dean From: Yang mailto:tedd...@gmail.com>> Reply-To: "user@cassandra.apache.org" mailto:user@cassandra.apache.org>> Date: Monday, August 27, 2012 3

cassandra twitter ruby client

2012-08-27 Thread Yuhan Zhang
Hi all, I'm playing with cassandra's ruby client written by twitter, trying to perform a simple get. but looks like it assumed the value types to be uft8 string. however, my values are in double (keyed and column names are utf8types). The values that I got are like: {"Top":"?\ufffd\ufffd\ufffd\u

JMX(RMI) dynamic port allocation problem still exists?

2012-08-27 Thread Yang
in my previous job we ran across the issue that JMX allocates ports for RMI dynamically, so that nodetool does not work if our env is in EC2, and all the ports have to be specifically opened, and we can't open a range of ports, but only specific ports. at the time, we followed this: https://blogs

Re: one node with very high loads

2012-08-27 Thread Rob Coli
On Mon, Aug 27, 2012 at 9:25 AM, Senthilvel Rangaswamy wrote: > We are running 1.1.2 on m1.xlarge with ephemeral store for data. We are > seeing very high loads on one of the nodes in the ring, 30+. My first hunch would be that you are sending all client requests to this one node, so it is coordi

Re: Expanding cluster to include a new DR datacenter

2012-08-27 Thread Mohit Anchlia
In your update command is it possible to specify RF for both DC? You could just do DC1:2, DC2:0. On Mon, Aug 27, 2012 at 11:16 AM, Bryce Godfrey wrote: > Show schema output show the simple strategy still > > [default@unknown] show schema EBonding; > > create keyspace EBonding > > w

RE: Expanding cluster to include a new DR datacenter

2012-08-27 Thread Bryce Godfrey
Show schema output show the simple strategy still [default@unknown] show schema EBonding; create keyspace EBonding with placement_strategy = 'SimpleStrategy' and strategy_options = {replication_factor : 2} and durable_writes = true; This is the only thing I see in the system log at the time

Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-27 Thread Aaron Turner
On Mon, Aug 27, 2012 at 1:19 AM, aaron morton wrote: > After thinking about how > sstables are done on disk, it seems best (required??) to write out > each row at once. > > Sort of. We only want one instance of the row per SSTable created. Ah, good clarification, although I think for my purposes

can you use hostnames in the topology file?

2012-08-27 Thread Hiller, Dean
In the example, I see all ips being used, but our machines are on dhcp so I would prefer using hostnames for everything(plus if a machine goes down, I can bring it back online on another machine with a different ip but same hostname). If I use hostname, does the listen_address have to be hardwir

Re: unsubscribe

2012-08-27 Thread André Cruz
On Aug 27, 2012, at 4:16 PM, "Nikolaidis, Christos" wrote: > No worries :-) I was replying to the list so whoever manages it can > unsubscribe me. That's not how you unsubscribe. You need to send an email to user-unsubscr...@cassandra.apache.org. André

RE: unsubscribe

2012-08-27 Thread Nikolaidis, Christos
No worries :-) I was replying to the list so whoever manages it can unsubscribe me. -Original Message- From: Eric Evans [mailto:eev...@acunu.com] Sent: Monday, August 27, 2012 11:12 AM To: user@cassandra.apache.org Subject: Re: unsubscribe On Mon, Aug 27, 2012 at 9:50 AM, Nikolaidis, Ch

Re: unsubscribe

2012-08-27 Thread André Cruz
On Aug 27, 2012, at 4:11 PM, Eric Evans wrote: > Since I am not in a position to unsubscribe anyone, I can only assume > that I have received this message in error. As per the frightening > legalese quoted above, I hereby notify you by email, and will now > proceed to destroy the original message

Re: unsubscribe

2012-08-27 Thread Eric Evans
On Mon, Aug 27, 2012 at 9:50 AM, Nikolaidis, Christos wrote: > > This e-mail and files transmitted with it are confidential, and are intended > solely for the use of the individual or entity to whom this e-mail is > addressed. If you are not the intended recipient, or the employee or agent > re

unsubscribe

2012-08-27 Thread Nikolaidis, Christos
This e-mail and files transmitted with it are confidential, and are intended solely for the use of the individual or entity to whom this e-mail is addressed. If you are not the intended recipient, or the employee or agent responsible to deliver it to the intended recipient, you are hereby noti

Re: Secondary index partially created

2012-08-27 Thread Richard Crowley
On Mon, Aug 27, 2012 at 12:59 AM, aaron morton wrote: > If you are still having problems can you post the query and the output from > nodetool cfstats on one of the nodes that fails ? driftx got me sorted. It escaped me that a rolling restart was necessary to build secondary indexes, which was m

Understanding Cassandra + MapReduce + Composite Columns

2012-08-27 Thread Víctor Penela
Hi! I'm trying to use Hadoop's MapReduce on top of a Cassandra environment, and I've running into some issues while using Composite Columns. I'm currently using Cassandra 1.1.2 (I wouldn't mind having to update it) and Hadoop 1.0.3 (I'd rather keep this version). What I would like to do is send s

Re: Decreasing the number of nodes in the ring

2012-08-27 Thread Henrik Schröder
Removetoken should only be used when removing a dead node from a cluster, it's a much slower and more expensive operation since it triggers a repair so that the remaining nodes can figure out which data they should now have. Decommission on the other hand is much simpler, the node that's being deco

Re: QUORUM writes, QUORUM reads -- and eventual consistency

2012-08-27 Thread aaron morton
> Doesn't this mean that the read does not "reflect the most recent write"? Yes. A write that fails is not a write. > If it were to have read the newer data from the 1 node and then afterwards > read the old data from the other 2 then there is a consistency problem, but > in the example you g

Re: Expanding cluster to include a new DR datacenter

2012-08-27 Thread aaron morton
I did a quick test on a clean 1.1.4 and it worked Can you check the logs for errors ? Can you see your schema change in there ? Also what is the output from show schema; in the cli ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 25/08/

Re: unsubscribe

2012-08-27 Thread aaron morton
http://wiki.apache.org/cassandra/FAQ#unsubscribe - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 26/08/2012, at 4:12 AM, Shen wrote: >

Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-27 Thread aaron morton
> After thinking about how > sstables are done on disk, it seems best (required??) to write out > each row at once. Sort of. We only want one instance of the row per SSTable created. > Any other tips to improve load time or reduce the load on the cluster > or subsequent compaction activity?

Re: Cassandra 1.1.4 RPM required

2012-08-27 Thread Marco Schirrmeister
On Aug 23, 2012, at 12:15 PM, Adeel Akbar wrote: > Dear Aaron, Its required username and password which I have not. Can yo share > direct link? > There is no username and password for the Datastax rpm repository. http://rpm.datastax.com/community/ But there is no 1.1.4 version yet from Datast

Re: Commit log periodic sync?

2012-08-27 Thread aaron morton
> Brutally. kill -9. that's fine. I was thinking about reboot -f -n > We are wondering if the fsync of the commit log was working. I would say yes only because there other reported problems. I think case I would not expect to see data lose. If you are still in a test scenario can you try to rep

Re: Secondary index partially created

2012-08-27 Thread aaron morton
If you are still having problems can you post the query and the output from nodetool cfstats on one of the nodes that fails ? cfstats will tell us if the secondary index was built. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 25/08/2

Re: Cassandra API Library.

2012-08-27 Thread Paolo Bernardi
On 08/23/2012 01:40 PM, Thomas Spengler wrote: 4) pelops (Thrift,Java) I've been using Pelops for quite some time with pretty good results; it felt much cleaner than Hector. Paolo -- @bernarpa http://paolobernardi.wordpress.com

Re: Order of the cyclic group of hashed partitioners

2012-08-27 Thread Romain HARDOUIN
Thank you Aaron. This limit was pushed down in RandomPartitioner but the question still exists... aaron morton a écrit sur 26/08/2012 23:35:50 : > > AbstractHashedPartitioner > does not exist in the trunk. > https://git-wip-us.apache.org/repos/asf?p=cassandra.git; > a=commitdiff;h=a89ef1ffd