Re: Cannot resolve schema disagreement

2013-05-09 Thread srmore
Thought so. Thanks Aaron ! On Thu, May 9, 2013 at 6:09 PM, aaron morton wrote: > This raises an important question, where does Cassandra get the time > information from ? > > http://docs.oracle.com/javase/6/docs/api/java/lang/System.html > normally milliSeconds, not sure if 1.0.12 may use nano

pycassa failures in large batch cycling

2013-05-09 Thread John R. Frank
C* users, We have a process that loads a large batch of rows from Cassandra into many separate compute workers. The rows are one-column wide and range in size for a couple KB to ~100 MB. After manipulating the data for a while, each compute worker writes the data back with *new* row keys com

Compaction in Cassandra

2013-05-09 Thread Techy Teck
How to figure out from the Datastax OPSCENTER whether the compaction is finished/done?

Re: Cassandra Experts

2013-05-09 Thread Liz Lee-Red Oak
Obviously my inquiry was misdirected. Steven. You will have to pardon me, I was merely searching for help. I do appreciate you pointing me in the right direction (Datastax), and will be referring them to our customer. Thank you. On May 9, 2013, at 4:25 PM, Steven Siebert wrote: > Good point,

Re: Cassandra Experts

2013-05-09 Thread Steven Siebert
Good point, Viktor...I didn't bother checking if they were consulting firm or recruiting...which you are correct, they appear to be head hunters. My mistake in thinking the OP was involved in a more direct consulting situation and discovered they needed some outside expertise -- I guess my skeptic

Re: Cannot resolve schema disagreement

2013-05-09 Thread aaron morton
> This raises an important question, where does Cassandra get the time > information from ? http://docs.oracle.com/javase/6/docs/api/java/lang/System.html normally milliSeconds, not sure if 1.0.12 may use nanoTime() which is less reliable on some VM's. > and is it required (I know it is highly

Re: HintedHandoff

2013-05-09 Thread aaron morton
> ·If node ‘X ‘ in DC1 which is a ‘replica’ node is down and a write > comes with CL =1 to DC1, the co-ordinator node will write the hint and also > the data will be written to the other ‘replica’ node in DC2 ? Is this correct > ? Writes always go to all UP replicas. So yes. > ·

Re: Backup and restore between different node-sized clusters

2013-05-09 Thread aaron morton
Special case if you have 3 nodes and RF 3 you can copy the files to each node and use nodetool refresh. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 9/05/2013, at 11:20 AM, Jonathan Ellis wrote: > You want to u

Re: how to monitor nodetool cleanup?

2013-05-09 Thread aaron morton
nodetool setcompactionthroughput controls the speed of compaction, and cleanup runs in the compaction manager. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 8/05/2013, at 8:59 AM, Michael Morris wrote: > Not sur

Re: backup strategy

2013-05-09 Thread aaron morton
Assuming you are using the SimpleStrategy or the NetworkTopologyStrategy and one rack per DC. If you backed up every 2nd node you would get one copy *IF* all nodes were consistent on disk. That can be a reasonably large if that you need to monitor. It's easier to back up all the nodes it will a

Re: Cassanrda 1.1.11 compression: how to tell if it works ?

2013-05-09 Thread aaron morton
> At what point does compression start ? It starts for new SSTables created after the schema was altered. > How can I confirm it is working ? Compressed SSTables include a -CompressionInfo.db component on disk. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand

Re: mutation stalls and FileNotFoundException

2013-05-09 Thread aaron morton
When mutation stage messages are dropped I start by looking for GC problems in the cassandra logs. You also have some blocked flush writer tasks, which may be due to a large number of CF's, a large number of secondary indexes, slow disk IO or excessive use of snapshot / flush. Check the comment

Re: hector or astyanax

2013-05-09 Thread aaron morton
Yup, thats the one. A - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 8/05/2013, at 3:40 AM, Blair Zajac wrote: > On 05/07/2013 01:37 AM, aaron morton wrote: >>> i want to know which cassandra client is better? >> Go with

Re: how to get column family details dynamically in cassandra bulk load program

2013-05-09 Thread aaron morton
The schema is available over the various interfaces, check with the client you are using to see it exposes the information. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 8/05/2013, at 1:36 AM, chandana.tumm...@wip

RE: Cassandra Experts

2013-05-09 Thread Viktor Jevdokimov
Consulting company is a body shop that looking for a job candidates for their clients, shortly - recruiters, so not interested in support or learning, just selling bodies with some brains. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com

Re: Cannot resolve schema disagreement

2013-05-09 Thread srmore
Thanks Rob ! Tried the steps, that did not work, however I was able to resolve the problem by syncing the clocks. The thing that confuses me is that, the FAQ says "Before 0.7.6, this can also be caused by cluster system clocks being substantially out of sync with each other". The version I am usin

Re: Cassandra Experts

2013-05-09 Thread Steven Siebert
Hi Liz, Are you looking for a reference to professional cassandra services/support...or looking to learn cassandra to provide said support? If the former, I highly recommend DataStax ( http://www.datastax.com/what-we-offer/products-services/consulting). I'm a non-affiliated future customer (adop

Cassandra Experts

2013-05-09 Thread Liz Lee
Hello, My name is Liz and I just subscribed to the mailing list for Cassandra. I work for a consulting company by the name of Red Oak Technologies, and we have a world-class client who is in need of Cassandra professional services expertise. If anyone has any tips or leads for me, I surely wo

Re: Cannot resolve schema disagreement

2013-05-09 Thread Robert Coli
On Wed, May 8, 2013 at 5:40 PM, srmore wrote: > After running the commands, I get back to the same issue. Cannot afford to > lose the data so I guess this is the only option for me. And unfortunately I > am using 1.0.12 ( cannot upgrade as of now ). Any, ideas on what might be > happening or any p

Re: Sudden increase in diskspace usage

2013-05-09 Thread Robert Coli
On Wed, May 8, 2013 at 10:43 PM, Nicolai Gylling wrote: > At the time of normal operation there was 800 gb free space on each node. > After the crash, C* started using a lot more, resulting in an > out-of-diskspace situation on 2 nodes, eg. C* used up the 800 gb in just 2 > days, giving us very li

Re: Sudden increase in diskspace usage

2013-05-09 Thread Alexis Rodríguez
Nicolai, Perhaps you can check the system.log to see if there are any errors on compaction. Also, I believe C* 1.2.0 it's not a stable version. On Thu, May 9, 2013 at 2:43 AM, Nicolai Gylling wrote: > Hi > > I have a 3-node SSD-based cluster, with around 1 TB data, RF:3, C* > v.1.2.0, vnodes

Re: Replica info

2013-05-09 Thread Michael Morris
Not directly, but you should be able to use the output of the getendpoints operation, and of nodetool ring to find the IP address that matches the DC you are looking for. Thanks, Mike On Thu, May 9, 2013 at 11:08 AM, Kanwar Sangha wrote: > Thanks ! Is there also a way to find out the replica

RE: Replica info

2013-05-09 Thread Kanwar Sangha
Thanks ! Is there also a way to find out the replica nodes ? Say we have 2 DCs, DC1 and DC2 with RF=2 (DC1:1, DC2:1) Can we find out which node in DC2 is a replica ? From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: 08 May 2013 21:08 To: user@cassandra.apache.org Subject: Re: Replica