Re: Datastax Enterprise AMI EC2

Ok, thank you for your help! On Tue, Mar 24, 2015 at 11:59 PM, Nick Bailey wrote: > This is a known issue with older versions of the AMI. Use the 2.5.1 > version of the AMI (seehttps:// > raw.githubusercontent.com/riptano/ComboAMI/2.5/ami_ids.json for the ids > for your region). For a more detai

Re: Re-bootstrap node after disk failure

Is it what this command does? In that case the documentation is misleading because it says: "Use this command to bring up a new data center in an existing cluster", which is not really what I'm trying to do. On 24 March 2015 at 21:12, Phil Yang wrote: > you can use "nodetool rebuild" in this nod

Custom data types and dynamic tables

Hello, If i have a custom type EventDefinition and i create a table like create table TestTable { user_id long, ts timestamp, definition 'com.anishek.EventDefinition', Primary Key (user_id, ts)) with clustering order by (ts desc) and compression={'sstable_compression' : 'SnappyCompressor'} and c

Re: Re-bootstrap node after disk failure

you can use "nodetool rebuild" in this node. 2015-03-25 9:20 GMT+08:00 Flavien Charlon : > Hi, > > What is the process to re-bootstrap a node after hard drive failure > (Cassandra 2.1.3)? > > This is the same node as previously, but the data folder has been wiped, > and I would like to re-bootstr

Re-bootstrap node after disk failure

Hi, What is the process to re-bootstrap a node after hard drive failure (Cassandra 2.1.3)? This is the same node as previously, but the data folder has been wiped, and I would like to re-bootstrap it from the data stored on the other nodes of the cluster (I have RF=3). I am not using vnodes. Th

RE: error in bulk loading

Not sure if this will help, but I have had issues with windows file in Unix before and this has worked for me… To remove the ^M characters at the end of all lines in vi, use: :%s/^V^M//g The ^v is a CONTROL-V character and ^m is a CONTROL-M. When you type this, it will look like this: :%s/^M/

Re: error in bulk loading

On Tue, Mar 24, 2015 at 5:30 AM, Rahul Bhardwaj < rahul.bhard...@indiamart.com> wrote: > I need to import a csv file to a table using copy command, but file > contains carriage returns which causing me problem in doing so, Is there > any way in cassandra to solve this You can surround the field

Re: Datastax Enterprise AMI EC2

This is a known issue with older versions of the AMI. Use the 2.5.1 version of the AMI (seehttps:// raw.githubusercontent.com/riptano/ComboAMI/2.5/ami_ids.json for the ids for your region). For a more detailed discussion of what's going wrong, see this StackExchange answer:http://stackoverflow.com/

Re: Delayed events processing / queue (anti-)pattern

Some ideas I throw in here: "The delay Y will be at least 1 minute, and at most 90 days with a resolution per minute" --> Use the delay (with format MMDDHHMM as integer) as your partition key. Example: today March 24th at 12:00 (201502241200) you need to delay 3 actions, action A in exact 3 d

Re: Delayed events processing / queue (anti-)pattern

On Tue, Mar 24, 2015 at 5:05 AM, Robin Verlangen wrote: > - for every point in the future there are probably hundreds of actions > which have to be processed > - all actions for a point in time will be processed at once (thus not > removing action by action as a typical queue would do) > - once a

Re: Way to Cassandra File System

There's also Brisk (https://github.com/riptano/brisk), the original open source version of CFS before Riptano/Datastax made it proprietary. It's been moribund for years, but there does appear to be a fork with commits up to 2013: https://github.com/milliondreams/brisk Jim On Tue, Mar 24, 2015 at

Re: Deleted columns reappear after "repair"

Well, as I mentioned in my original email all machines running Cassandra are running NTP. This was one of the first things I verified and I triple checked that they all show the same time. Is this sufficient to ensure clocks are synched between the nodes? I have increased gc_grace to 100 days for

Re: CQL 3.x Update ...USING TIMESTAMP...

> > do you just mean that it's easy to forget to always set your timestamp > correctly, and if you goof it up, it makes it difficult to recover from > (i.e. you issue a delete with system timestamp instead of document version, > and that's way larger than your document version would ever be, so you

Re: Deleted columns reappear after "repair"

Hi Roman, On 24/03/15 18:05, Roman Tkachenko wrote: Hi Duncan, Thanks for the response! I can try increasing gc_grace_seconds and run repair on all nodes. It does not make sense though why all *new* deletes (for the same column that resurrects after repair) I do are forgotten as well after rep

Re: Deleted columns reappear after "repair"

Hi Duncan, Thanks for the response! I can try increasing gc_grace_seconds and run repair on all nodes. It does not make sense though why all *new* deletes (for the same column that resurrects after repair) I do are forgotten as well after repair? Doesn't Cassandra insert a new tombstone every tim

Re: upgrade from 1.0.12 to 1.1.12

Streaming is repair, adding & removing nodes. In general it's a bad idea to do any streaming op when you've got an upgrade in progress. On Tue, Mar 24, 2015 at 3:14 AM Jason Wee wrote: > Hello, > > Reading this documentation http://www.datastax.com/docs/ > 1.1/install/upgrading > > If you are u

Re: Deleted columns reappear after "repair"

Hi Roman, On 24/03/15 17:32, Roman Tkachenko wrote: Hey guys, Has anyone seen anything like this behavior or has an explanation for it? If not, I think I'm gonna file a bug report. this can happen if repair is run after the tombstone gc_grace_period has expired. I suggest you increase gc_gr

Re: Deleted columns reappear after "repair"

Hey guys, Has anyone seen anything like this behavior or has an explanation for it? If not, I think I'm gonna file a bug report. Thanks! Roman On Mon, Mar 23, 2015 at 4:45 PM, Roman Tkachenko wrote: > Hey guys, > > We're having a very strange issue: deleted columns get resurrected when > "rep

Re: cassandra source code

Make sure to have a priest nearby, or the demon can get out of hands! ;) On Tue, Mar 24, 2015 at 7:11 PM, Job Thomas wrote: > Hi, > > > Cassandra Demon found > in org/apache/cassandra/service/CassandraDaemon.java > > This contain Main() method also. > > > > > -- >

Re: error deleting messages

This talk from DataStax was talking about deletes as an Anti-pattern. It may be worth watching. > Thanks for your interest in the following webinar: > > Avoiding anti-patterns: How to stay in love with Cassandra > > Here are the links to the video recording and presentation slides. > > Than

Re: cassandra source code

Hi, Cassandra Demon found in org/apache/cassandra/service/CassandraDaemon.java This contain Main() method also. From: Divya Divs Sent: Tuesday, March 24, 2015 10:59 AM To: user@cassandra.apache.org; Jason Wee; Eric Stevens Subject: cassandra source code Hi I

Re: error deleting messages

Hi Anuj Yes, thanks.. looking at my log file I see: ERROR [SharedPool-Worker-2] 2015-03-24 13:52:06,751 SliceQueryFilter.java:218 - Scanned over 10 tombstones in test1.msg; query aborted (see tombstone_\ failure_threshold) WARN [SharedPool-Worker-2] 2015-03-24 13:52:06,759 AbstractTracingAwa

RE: Way to Cassandra File System

Cool I think that helps. Regards Tarun From: Jonathan Lacefield [mailto:jlacefi...@datastax.com] Sent: Tuesday, March 24, 2015 6:39 PM To: user@cassandra.apache.org Subject: Re: Way to Cassandra File System Hello, CFS is a DataStax proprietary implementation of the Hadoop File System interfac

Re: error deleting messages

Hi Joss We faced similar issue recently. The problem seems to be related to huge number of tombstones generated after deletion. I would suggest you to increase tombstone warning and failure threshold in cassandra.yaml. Once you do that and run your program make sure that you monitor Cassandra

Re: Way to Cassandra File System

Hello, CFS is a DataStax proprietary implementation of the Hadoop File System interface/abstract base class, sorry don't remember which of the top of my head. You could create your own implementation if you do not want to use DataStax's CFS. Or you could purchase DataStax Enterprise. Hope t

Way to Cassandra File System

Hi All, In DSE they claim to have Cassandra File System in place of Hadoop which makes it real fault tolerant. Is there a way to use Cassandra file system CFS in place of HDFS if I don't have DSE? Regards, Tarun Tiwari | Workforce Analytics-ETL | Kronos India M: +91 9540 28 27 77 | Tel: +91 120

Re: error deleting messages

Hi Joss, On 24/03/15 12:58, joss Earl wrote: I run into trouble after a while if I delete rows, this happens in both 2.1.3 and 2.0.13, and I encountered the same problem when using either the datastax java driver or the stock python driver. The problem is reproducible using the attached python p

Re: error deleting messages

It inserts 100,000 messages, I then start deleting the messages by grabbing chunks of 100 at a time and then individually deleting each message. So, the 100,000 messages get inserted without any trouble, I run into trouble when I have deleted about half of them. I've run this on machines with 4,8,

Re: error deleting messages

50100 inserts or deletes? also how much ram / cpu do you have on the server running this, and what's the ram / cpu usage at about the time it fails? On Tue, Mar 24, 2015 at 5:29 PM, joss Earl wrote: > on a stock install, it gets to about 50100 before grinding to a halt > > > > On 24 March 2015 a

Re: error deleting messages

on a stock install, it gets to about 50100 before grinding to a halt On 24 March 2015 at 12:19, Ali Akhtar wrote: > What happens when you run it? How far does it get before stopping? > > On Tue, Mar 24, 2015 at 5:13 PM, joss Earl > wrote: > >> sure: https://gist.github.com/joss75321/7d85e4c75

Re: error deleting messages

What happens when you run it? How far does it get before stopping? On Tue, Mar 24, 2015 at 5:13 PM, joss Earl wrote: > sure: https://gist.github.com/joss75321/7d85e4c75c06530e9d80 > > On 24 March 2015 at 12:04, Ali Akhtar wrote: > >> Can you put your code on gist.github.com or pastebin? >> >> O

Re: error deleting messages

sure: https://gist.github.com/joss75321/7d85e4c75c06530e9d80 On 24 March 2015 at 12:04, Ali Akhtar wrote: > Can you put your code on gist.github.com or pastebin? > > On Tue, Mar 24, 2015 at 4:58 PM, joss Earl > wrote: > >> I run into trouble after a while if I delete rows, this happens in both

Delayed events processing / queue (anti-)pattern

Hi there, I'm working on a project that needs delayed event processing. Example: Today a certain set of conditions X is met, and in 7 days and 12 hours (delay Y) we want to take action Z. The set of conditions X is out of the scope of this problem. The delay Y will be at least 1 minute, and at m

Re: error deleting messages

Can you put your code on gist.github.com or pastebin? On Tue, Mar 24, 2015 at 4:58 PM, joss Earl wrote: > I run into trouble after a while if I delete rows, this happens in both > 2.1.3 and 2.0.13, and I encountered the same problem when using either the > datastax java driver or the stock pytho

Re: cassandra source code

Thank very much. Thanks and Regards, Divya.K M-Tech IT Intern at Honeywell technology Solutions, Bangalore On Tue, Mar 24, 2015 at 4:15 PM, Brian O'Neill wrote: > FWIW — I just went through this, and posted the process I used to get up > and running: > http://brianoneill.blogspot.com/2015/03/g

error deleting messages

I run into trouble after a while if I delete rows, this happens in both 2.1.3 and 2.0.13, and I encountered the same problem when using either the datastax java driver or the stock python driver. The problem is reproducible using the attached python program. Once the problem is encountered, the ta

Re: cassandra source code

FWIW ‹ I just went through this, and posted the process I used to get up and running: http://brianoneill.blogspot.com/2015/03/getting-started-with-cassandra.html -brian --- Brian O'Neill Chief Technology Officer Health Market Science, a LexisNexis Company 215.588.6024 Mobile € @boneill42

error in bulk loading

Hi all, I need to import a csv file to a table using copy command, but file contains carriage returns which causing me problem in doing so, Is there any way in cassandra to solve this Regards: Rahul -- Follow IndiaMART.com for latest updates on this and more:

upgrade from 1.0.12 to 1.1.12

Hello, Reading this documentation http://www.datastax.com/docs/1.1/install/upgrading If you are upgrading to Cassandra 1.1.9 from a version earlier than 1.1.7, all nodes must be upgraded before any streaming can take place. Until you upgrade all nodes, you cannot add version 1.1.7 nodes or later

Datastax Enterprise AMI EC2

Hi, I tried to launch the datastax AMI using enterprise version following these steps: - I launched the AMI only with the Opscenter in a ec2 instance and then I have created a new Cluster containg 2 nodes - Cassanrda & Solr. This scenario works just fine in South America (Sao Paulo). I tried to