Re: CQL v1.0.0: why super column family not descirbed in it?

Hello Eric, Compound columns seem to be a very interesting feature. Do you have any idea in which Cassandra version it is going to be introduced : 0.8.X or 0.9.X ? Thanks, Victor 2011/5/5 Eric Evans > On Thu, 2011-05-05 at 18:19 +0800, Guofeng Zhang wrote: > > I read the CQL v1.0 document. Th

Re: CQL v1.0.0: why super column family not descirbed in it?

Thank you, I will look into that and I will probably wait until there is an "out of the box" comparator. But it's an excellent new feature ! Regards, Victor K. 2011/5/5 Eric Evans > On Thu, 2011-05-05 at 10:49 -0400, Victor Kabdebon wrote: > > Hello Eric, > > >

Re: Cassandra 0.8 questions

me. Again just experiment and be ready to change your organization if you begin with Cassandra, this is the best way to figure out what to do for your data organization. Victor Kabdebon http://www.voxnucleus.fr http://www.victorkabdebon.net 2011/5/24 Jian Fang > Does anyone have a good sug

Re: Appending to fields

a for long term storage. Here is an example with Redis : http://redis.io/commands/append The "append" command is said to be in O(1) but it is a little bit suspicious to me... Best regards, Victor Kabdebon http://www.voxnucleus.fr 2011/5/31 Jonathan Ellis > On Tue, May 31, 2011 at 2:22

Re: When should I use Solandra?

some fields. Victor Kabdebon http://www.victorkabdebon.com 2011/6/4 Jean-Nicolas Boulay Desjardins > Hi, > > I am planning to use Cassandra to store my users passwords and at the same > time data for my website that need to be accessible via search. My Question > is should I use tw

Re: When should I use Solandra?

Again I don't really know the specifics of Solandra but in Solr (so Solandra being a cousin of Solr it should be true too) you have XML fields like this : Just turn indexed to false and it's not going to be indexed... Thrift won't affect Solandra at all. 2011/6/4 Jean-Nicolas Boulay Desjardins

Re: New web client & future API

Hello Markus, Actually from what I understood (please correct me if I am wrong) CQL is based on Thrift / Avro. Victor Kabdebon 2011/6/14 Markus Wiesenbacher | Codefreun.de > > Hi, > > what is the future API for Cassandra? Thrift, Avro, CQL? > > I just released an early

Re: New web client & future API

Ok thanks for the update. I thought the query string was translated to Thrift, then send to a server. Victor Kabdebon 2011/6/15 Eric Evans > On Tue, 2011-06-14 at 09:49 -0400, Victor Kabdebon wrote: > > Actually from what I understood (please correct me if I am wrong) CQL > &

Re: solandra or pig or....?

a search engine. Personally for what you are asking I would use Pig and stock that in CF. I would update those CF regularly. For simple statistics you can generate them with your favorite language or a specialized language such as R as long as it concerns small sets. Hope it helps, Victor Kabdebon 2011/6

Re: [SOLVED] Very high memory utilization (not caused by mmap on sstables)

Hello everybody, I actually have the exact same problem. I have very little amount of data ( few hundred kb) and the memory consumption goes up without any end. in sight. For On my node I have limited ram ( 2 Gb) to run cassandra, but since I have very little data, I fought it was not a problem, h

Re: [SOLVED] Very high memory utilization (not caused by mmap on sstables)

Hello Peter, So more information on that problem : Yes I am using this node with very few data, it is used to design requests so I don't need a very large dataset. I am running Apache Cassandra 0.6.6 on a Debian Stable, with java version "1.6.0_22". I recently restarted cassandra, thus I have thi

Storing big objects into columns

Dear all, In a project I would like to store "big" objects in columns, serialized. For example entire images (several Ko to several Mo), flash animations (several Mo) etc... Does someone use Cassandra with those relatively big columns and if yes does it work well ? Is there any drawbacks using thi

Re: Storing big objects into columns

Is there any recommanded maximum size for a Column ? (not the very upper limit which is 2Gb) Why is it useful to chunk the content into multiple columns ? Thank you, Victor K. 2011/1/13 Ryan King > On Thu, Jan 13, 2011 at 2:38 PM, Victor Kabdebon > wrote: > > Dear all, > &

Re: Storing big objects into columns

Ok thank you very much for these information ! If somebody has more insights on this matter I am still interested ! Victor K. 2011/1/13 Ryan King > On Thu, Jan 13, 2011 at 2:44 PM, Victor Kabdebon > wrote: > > Is there any recommanded maximum size for a Column ? (not the very upp

Re: live data migration from mysql to cassandra

I personnally did it the other way around : from Cassandra to PostGreSQL, I needed an hybrid system : Cassandra solidly holds all data while PostGreSQL holds fewer data but request are simple and efficient ( with SELECT WHERE). This is pretty easy once you master key browsing and iterating. I thin

Re: live data migration from mysql to cassandra

gosh, sorry for the mistakes I am tired ! Victor K. 2011/1/14 Victor Kabdebon > I personnally did it the other way around : from Cassandra to PostGreSQL, I > needed an hybrid system : Cassandra solidly holds all data while PostGreSQL > holds fewer data but request are simple and

Re: Do you have a site in production environment with Cassandra? What client do you use?

Same here Hector + java Best Regards, Victor K 2011/1/14 Ran Tavory > Java > On Jan 14, 2011 8:25 PM, "Ertio Lew" wrote: > > what is the technology stack do you use? > > > > On 1/14/11, Ran Tavory wrote: > >> I use Hector, if that counts. .. > >> On Jan 14, 2011 7:25 PM, "Ertio Lew" wrote: >

Re: Cassandra in less than 1G of memory?

Dear rajat, Yes it is possible, I have the same constraints. However I must warn you, from what I see Cassandra memory consumption is not bounded in 0.6.X on debian 64 Bit Here is an example of an instance launch in a node : root 19093 0.1 28.3 1210696 *570052* ? Sl Jan11 9:08 /usr

Re: Cassandra in less than 1G of memory?

Capriolo > wrote: > > On Fri, Jan 14, 2011 at 2:13 PM, Victor Kabdebon > > wrote: > >> Dear rajat, > >> > >> Yes it is possible, I have the same constraints. However I must warn > you, > >> from what I see Cassandra memory consumption is not boun

Re: cass0.7: Creating colum family & Sorting

Comparator comparates only the column inside a Key. Key sorting is done by your partitionner. Best regards, Victor Kabdebon 2011/1/16 kh jo > I am having some problems with creating column families and sorting them, > > I want to create a countries column family where I can get a so

Re: Cassandra in less than 1G of memory?

Thank you very much, Best Regards, Victor Kabdebon PS : memory consumption : root 19093 0.1 35.8 *1362108 722312* ? Sl Jan11 14:01 /usr/bin/java -ea -Xms128M -Xmx512M -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringT

Re: Cassandra in less than 1G of memory?

Peter : What do you recommand ? using Aaron Morton solution and using JNA or just disable mmap ? (Or is it the same and I missed something ?) Thank you all for your advice, I am surprised to be the only one to have this problem even if I'm using a pretty standard distribution. Best regards, Victo

Re: Secondary Index information

Dear Sasha, I am currently thinking about using secondary index in the future. I have seen two pros : _Simplicity, it is "more simple" to query based on a second index than going for a first column then a second. _ "Consistency" : depending on where you store your inverted index, it may be unavail

Re: Cassandra and count

Buddasystem is right. A count returns columns to the client which count it. My advice : do not count big columns / supercolumns. People in the dev team are trying to develop distributed counters but I don't know the state of this research. Best regards, Victor Kabdebon http://www.voxnucle

Re: Using Cassandra to store files

Dear Brendan, I would really be interested by your findings too. I need a system to store various documents, I am thinking of Cassandra (that I am already using) or using a second type of database or any other system. Maybe like dan suggested, using mogilefs. Thank you, Victor Kabdebon http

Re: revisioned data

ong) Columns : { name other fields update time (long [date]) ...} CF2 : "ObjectOrder" Key : "myorderedobjects Column:{ { name : identifier that can be sorted value :ObjectID}, ... } Best regards, Victor Kabdebon, http://www.voxnucleus.fr 2011/2/5 Raj Bakhru

Re: unique key generation

lottery for 1e11 days in a row ( for 270 million years). Well if you do have a collision you should play the lottery :). Best regards, Victor Kabdebon http://www.voxnucleus.fr 2011/2/7 Kallin Nagelberg > Hey, > > I am developing a session management system using Cassandra and need >

Cassandra memory consumption

m ? Bad garbage collection ? Something that I ignore ? Thank you for your help I really need to get rid of that problem. Best regards, Victor Kabdebon

Re: Cassandra memory consumption

.jar:bin/../lib/uuid-3.1.jar org.apache.cassandra.thrift.CassandraDaemon It is really an annoying problem if we cannot really foresee memory consumption. Best regards, Victor K 2011/2/8 Victor Kabdebon > Dear all, > > Sorry to come back again to this point but I am really worried about &g

Re: Cassandra memory consumption

're getting your numbers > from. > > On Tue, Feb 8, 2011 at 9:32 AM, Victor Kabdebon > wrote: > > It is really weird that I am the only one to have this issue. > > I restarted Cassandra today and already the memory compution is over the > > limit : > > >

Re: Cassandra memory consumption

Information on the system : *Debian 5* *Jvm :* victor@testhost:~/database/apache-cassandra-0.6.6$ java -version java version "1.6.0_22" Java(TM) SE Runtime Environment (build 1.6.0_22-b04) Java HotSpot(TM) 64-Bit Server VM (build 17.1-b03, mixed mode) *RAM :* 2Go 2011/2/8 Victo

Re: Cassandra memory consumption

non-heap memory on a 0.7 box I have is around 27M. You numbers seem > large but it would be interesting to know what the JVM is reporting. > > Aaron > > On 09 Feb, 2011,at 05:57 AM, Victor Kabdebon > wrote: > > Information on the system : > > *Debian 5* > *Jvm :* >

Re: Cassandra memory consumption

etting rid of used memory ... I really am puzzled. (by the way it is not a Amazon EC2 server this is a dedicated server). Regards, Victor K. 2011/2/8 Edward Capriolo > On Tue, Feb 8, 2011 at 4:56 PM, Victor Kabdebon > wrote: > > I will do that in the future and I will post my res

Re: unique key generation

Yes i have done a mistake I know ! But I hoped nobody would notice :). It is the odds of winning 3 days in a row (standard probability fail). Still it is totally unlikely Sorry about this mistake, Best regards, Victor K.

Re: online chat scenario

t it might give you ideas on how to deal with that problem (I am not sure that DB are the best way to deal with that... but it's just my opinion). Victor Kabdebon http://www.voxnucleus.fr 2011/2/15 Sasha Dolgy > thanks for the response. thinking about this, this would not allow fo

Re: Subscribe

Looks like your wish has been granted. 2011/2/15 Chris Goffinet > I would like to subscribe to your newsletter. > > On Tue, Feb 15, 2011 at 8:04 AM, A J wrote: > >> >> >

Re: Cassandra memory consumption

Yes I didn't see there was 2 different parameters. I was personally setting ( in cassandra 0.6.6 ) MemTableThoughputInMB, but I don't know what BinaryMemtableThroughtputInMB is. And I take this opportunity to ask a question : If you have a small amount of data per key so that your memtable is mayb

Re: Cassandra memory consumption

Someone please correct me if I am wrong, but I think the overhead you can expect is something like : 16* MemTableThroughtPutInMB but I don't know when BinaryMemTableThroughputInMb come into account.. 2011/2/16 ruslan usifov > > > 2011/2/16 Victor Kabdebon > > >>

Re: Cassandra memory consumption

Thanks robert, and do you know if there is a way to control the maximum likely number of memtables ? (I'd like to cap it at 2) 2011/2/16 Robert Coli > On Wed, Feb 16, 2011 at 7:12 AM, Victor Kabdebon > wrote: > > Someone please correct me if I am wrong, but I think the

Re: memory consuption

Is it possible to change the maximum JVM heap memory use in 0.6.X ? 2011/2/17 Aaron Morton > What are you using for disk_access_mode ? > Have you tried reducing the JVM head size? > Have you added the Jna.jar file to lib/ ? This will allow Cassandra to lock > the JVM memory. > > > Aaron > > > On

Re: memory consuption

my result : 105 26115 0.2 27.3 1125328 755316 ? Sl Feb09 23:58 /usr/bin/java -ea -Xms64M -Xmx128M 2011/2/17 Aaron Morton > bin/cassandra.in.sh > set Xms and Xmx in the JVM_OPTS > > Aaron > > > On 18 Feb, 2011,at 09:10 AM, Victor Kabdebon > wrote: > &

Re: memory consuption

Sorry I forgot to say that this is the partial result of : ps aux | grep cassandra Best regards 2011/2/17 Victor Kabdebon > Oh right but Cassandra doesn't really respect that, I thought there was > another option to set that. > > Just for your information, I set xms and xm

Re: memory consuption

ode to standard if you want to reduce the overall memory > usage. > > Aaron > > On 18 Feb, 2011,at 09:34 AM, Victor Kabdebon > wrote: > > Sorry I forgot to say that this is the partial result of : > ps aux | grep cassandra > > Best regards > > 2011/2/17

Re: Abnormal memory consumption

And about the production 7Gb or RAM is sufficient ? Or 11 Gb is the minimum ? Thank you for your inputs for the JVM I'll try to tune that 2011/4/4 Peter Schuller > > You can change VM settings and tweak things like memtable thresholds > > and in-memory compaction limits to get it down and get a

Re: database design

ite needed. Now I found an alternative I use : Cassandra (data vault) + Redis (Sessions and other volatile data) + SolR (Search engine) + PostGreSQL ( for relational queries). Best regards, Victor Kabdebon http://www.voxnucleus.fr 2011/4/13 Edward Capriolo > On Wed, Apr 13, 2011 at 10:39 AM, Jea