RE: question about replicas & dynamic response to load

2011-03-03 Thread Dan Hendry
To some extent, the boot-strapping problem will be an issue with most solutions: the data has to be duplicated from somewhere. Bootstrapping should not cause much performance degradation unless you are already pushing capacity limits. It's the decommissioning problem which makes Cassandra somewhat

Re: UseCompressedStrings

2011-03-03 Thread Edward Capriolo
On Thu, Mar 3, 2011 at 3:21 PM, Timo Nentwig wrote: > Did somebody try -XX:+UseCompressedStrings with cassandra? Sounds very   > promising and reasonable. Would be nice except in 0.7.0 we are using mostly byte buffers now. Although the column family name is still a String.

Re: Network Topology Strategy error

2011-03-03 Thread Jonathan Ellis
Sounds like your nodes are not evenly spaced around the ring in each dc. On Thu, Mar 3, 2011 at 4:09 PM, A J wrote: > Thanks. > It worked when I changed as you suggested to: create keyspace ks1 with > strategy_options = [{DC1:1, DC2:1}] and > placement_strategy='org.apache.cassandra.locator.Netwo

Re: Network Topology Strategy error

2011-03-03 Thread A J
Thanks. It worked when I changed as you suggested to: create keyspace ks1 with strategy_options = [{DC1:1, DC2:1}] and placement_strategy='org.apache.cassandra.locator.NetworkTopologyStrategy'; Something that I am observing: The replicas are always put in the first node on the other DC. (So if the

Re: Storing photos, images, docs etc.

2011-03-03 Thread Robert Coli
On Thu, Mar 3, 2011 at 1:02 PM, Dan Kuebrich wrote: > It's still maintained: https://github.com/mogilefs/ .  I don't have a good > sense of the community, though we did use it at my last job. #mogilefs on freenode contains one of the most solicitous and helpful project maintainers I have ever hav

Re: Storing photos, images, docs etc.

2011-03-03 Thread Dan Kuebrich
It's still maintained: https://github.com/mogilefs/ . I don't have a good sense of the community, though we did use it at my last job. On Thu, Mar 3, 2011 at 3:44 PM, mcasandra wrote: > Well it's not just metadata that I need to store but also Username, > profiles, > followers etc. What I meant

Re: Storing photos, images, docs etc.

2011-03-03 Thread mcasandra
Well it's not just metadata that I need to store but also Username, profiles, followers etc. What I meant was store the location of the images along with other information that I described above. And when user queries them then pull it from the file sytem. Most of the high volume sites (facebook,

Re: Network Topology Strategy error

2011-03-03 Thread Jonathan Ellis
you need to specify per-DC replicas w/ NTS in strategy_options, instead of using replication_factor On Thu, Mar 3, 2011 at 1:52 PM, A J wrote: > using latest cassandra (0.7.2). I want to try out Network Topology Strategy. > > Following is related setting in cassandra.yaml > endpoint_snitch: org.a

UseCompressedStrings

2011-03-03 Thread Timo Nentwig
Did somebody try -XX:+UseCompressedStrings with cassandra? Sounds very promising and reasonable.

Re: Storing photos, images, docs etc.

2011-03-03 Thread A J
why would you keep metadata in cassandra ? Even for millions of documents, metadata would be very small, mysql/postgres should suffice. Luster ofcourse is well known and widely used along with glusterfs. Luster I think requires kernel modifications and will be much more complex. Also it is easier

Re: Storing photos, images, docs etc.

2011-03-03 Thread Edward Capriolo
On Thu, Mar 3, 2011 at 2:49 PM, mcasandra wrote: > Has anyone heard about lustre distributed file system? I am wondering if it > will work well where keep the metadata in Cassandra and images in Lustre. > > I looked at MogileFS but not too sure about it's support. > > -- > View this message in con

RE: Storing photos, images, docs etc.

2011-03-03 Thread Weili McClenahan
How Amazon implemented its S3? Seems to me that you are going to implement something like S3 - data storage system. I have the same requirement - need to store hugh amount of large files (pdf, image, zip, video, audio...). Another question: how about HDFS? -Original Message- From: mcasa

Network Topology Strategy error

2011-03-03 Thread A J
using latest cassandra (0.7.2). I want to try out Network Topology Strategy. Following is related setting in cassandra.yaml endpoint_snitch: org.apache.cassandra.locator.PropertyFileSnitch I have four nodes. Set them accordingly in ./conf/cassandra-topology.properties: 10.252.219.224=DC2:RAC1 10.

Re: Storing photos, images, docs etc.

2011-03-03 Thread mcasandra
Has anyone heard about lustre distributed file system? I am wondering if it will work well where keep the metadata in Cassandra and images in Lustre. I looked at MogileFS but not too sure about it's support. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.n

Re: Cassandra 0.7.2 - Enable/Disable HH via JMX (Jconsole)

2011-03-03 Thread Ching-Cheng Chen
The HintedHandoffEnabled attribute is read/write. You can always set it to true/false to enable/disable HH. Regards, Chen www.evidentosftware.com On Thu, Mar 3, 2011 at 1:47 PM, Narendra Sharma wrote: > I am unable to enable/disable HH via JMX (JConsole). > > Even though the load is on and re

Cassandra 0.7.2 - Enable/Disable HH via JMX (Jconsole)

2011-03-03 Thread Narendra Sharma
I am unable to enable/disable HH via JMX (JConsole). Even though the load is on and read/writes happening, I don't see "operations" component on Jconsole. To clarify further, I see only Jconsole->MBeans->org.apache.cassandra.db.StorageProxy.Attributes. I don't see Jconsole->MBeans->org.apache.cass

Re: cassandra-rack.properties or cassandra-topology.properties

2011-03-03 Thread A J
Yes, that has topology and not rack. conf/access.properties conf/log4j-server.properties conf/cassandra-env.sh conf/log4j-tools.properties conf/cassandra-topology.properties conf/passwd.properties conf/cassandra.yaml conf/README.txt On Thu, Mar 3, 2011

Re: cassandra-rack.properties or cassandra-topology.properties

2011-03-03 Thread Jonathan Ellis
Did you try "ls conf/" ? On Thu, Mar 3, 2011 at 11:27 AM, A J wrote: > In PropertyFileSnitch is cassandra-rack.properties or > cassandra-topology.properties file used ? > > Little confused by the stmt: > PropertyFileSnitch determines the location of nodes by referring to a > user-defined descript

question about replicas & dynamic response to load

2011-03-03 Thread Shaun Cutts
Hello, In our project our usage pattern is likely to be quite variable -- high for a a few days, then lower, etc could vary as much (or more) as 10x from peak to "non-peak". Also, much of our data is immutable -- but there is a considerable amount of it -- perhaps in the single digit TBs. Final

Re: cassandra as user-profile data store

2011-03-03 Thread Dave Gardner
Dave We are in production with 0.6. We started with this and haven't had time to figure out how to upgrade smoothly. It's on the horizon though; there's loads of features we really could do with in 0.7. In terms of strategy, we don't currently follow Tyler's suggestions. I can't see any reason wh

Error when bringing up nodes during failure testing

2011-03-03 Thread mcasandra
Whenever I do failure testing I see this error message and then cassandra process exits. This is what I am doing: 1. 3 node cluster. CF of RF=3, W=QUORUM and R=QUORUM 2. Execute client code in a loop which just reads data from CF in while loop. 2. Bring one node down (Node C). Everything ok. C

cassandra-rack.properties or cassandra-topology.properties

2011-03-03 Thread A J
In PropertyFileSnitch is cassandra-rack.properties or cassandra-topology.properties file used ? Little confused by the stmt: PropertyFileSnitch determines the location of nodes by referring to a user-defined description of the network details located in the property file cassandra-rack.properties.

Re: How to use JConsole to connect to a Cassandra cluster in Amazon EC2?

2011-03-03 Thread Frank Duan
We found this was very helpful: http://simplygenius.com/2010/08/jconsole-via-socks-ssh-tunnel.html (http://wiki.apache.org/cassandra/Operations#Monitoring) - fduan On Wed, Mar 2, 2011 at 9:10 PM, Sameer Farooqui wrote: > I want to use JConsole to look at the Cassandra's MBean's attributes (like

Re: Advice on a design

2011-03-03 Thread Jeremy Hanna
Have you considered using Solandra (Solr/Lucene + Cassandra) - https://github.com/tjake/Lucandra#readme ? There is a #solandra channel on freenode if you had any questions as well. On Mar 3, 2011, at 8:00 AM, Vodnok wrote: > Ok seems that i'll use Solr (with dedicated Cassandra) for search >

Re: Advice on a design

2011-03-03 Thread Vodnok
Ok seems that i'll use Solr (with dedicated Cassandra) for search I've readed this article : http://ria101.wordpress.com/2010/02/22/cassandra-randompartitioner-vs-orderpreservingpartitioner/ on RP vs OPP... Here is my case docs_shared{ //docs shared by users ordered by time 'time:id_user:i

Re: Advice on a design

2011-03-03 Thread Vodnok
Ok seems that i'll use Solr (with dedicated Cassandra) for search I've readed this article : http://ria101.wordpress.com/2010/02/22/cassandra-randompartitioner-vs-orderpreservingpartitioner/on RP vs OPP... Here is my case docs_shared{ //docs shared by users ordered by time 'time:id_user:id

Re: How to use JConsole to connect to a Cassandra cluster in Amazon EC2?

2011-03-03 Thread Matt Kennedy
If you edit the $CASSANDRA_HOME/conf/cassandra-env.sh script, you should be able to set up ssl for the JMX connection. That should allow you to do a direct connection from a locally running JConsole to the JMX port on the public IP of your EC2 instance. On Wed, Mar 2, 2011 at 9:10 PM, Sameer Faroo

Re: dropping keyspace in cassandra

2011-03-03 Thread Sylvain Lebresne
On Thu, Mar 3, 2011 at 1:01 PM, Sagar Kohli wrote: > Thanks Salvain to correct me, Have one more query, what is the > location(default) of snapshot created by security?? > That should be within your data directory, in a directory whose name is the current time of the snapshot (aka drop in this c

RE: dropping keyspace in cassandra

2011-03-03 Thread Sagar Kohli
Thanks Salvain to correct me, Have one more query, what is the location(default) of snapshot created by security?? ~sagar From: Sylvain Lebresne [mailto:sylv...@datastax.com] Sent: Thursday, March 03, 2011 5:22 PM To: user@cassandra.apache.org Cc: Sagar Kohli Subject: Re: dropping keyspace in ca

Re: dropping keyspace in cassandra

2011-03-03 Thread Sylvain Lebresne
Before a keyspace is dropped, a snapshot is taken (by security). It is your job to remove the snapshot manually. (the tombstones have no play here) -- Sylvain On Thu, Mar 3, 2011 at 12:36 PM, Sagar Kohli wrote: > Hi, > > Probably I got the answer, it is Tombstones in Cassandra. > It is somethin

RE: dropping keyspace in cassandra

2011-03-03 Thread Sagar Kohli
Hi, Probably I got the answer, it is Tombstones in Cassandra. It is something like soft delete.. Pl correct me if m wrong Regards sagar -Original Message- From: Sagar Kohli [mailto:sagar.ko...@impetus.co.in] Sent: Thursday, March 03, 2011 11:44 AM To: user@cassandra.apache.org Subject: R

Re: apache.org down?

2011-03-03 Thread Sasha Dolgy
unresponsive... : ) 2011/3/3 Donal Zang : > rt > > -- > Donal Zang

apache.org down?

2011-03-03 Thread Donal Zang
rt -- Donal Zang

Re: Issues connecting from outside of localhost

2011-03-03 Thread Karl Hiramoto
On 02/03/2011 17:57, David McNelis wrote: In case anyone is interested. Our problem revolved around one machine having the phpcassa thrift patch, and the other did not. Its resolved now. Which patch? I think there is a difference between tag v0.7.a.3 and the current HEAD of master. I

Re: Defrag

2011-03-03 Thread Peter Schuller
> Potential sources of simultaneous disk write : > > - Memtable flushing > - SSTable compaction/anticompaction > - SSTable streaming > - Commitlog writes (which should be on a different drive from data per > best practices anyway..) Honestly though, last time I measured the effects of multiple str