Re: Cassandra as session store under heavy load

2011-10-13 Thread Jonathan Ellis
Or upgrade to 1.0 and use leveled compaction (http://www.datastax.com/dev/blog/leveled-compaction-in-apache-cassandra) On Thu, Oct 13, 2011 at 4:28 PM, aaron morton wrote: > They only have a minimum time, gc_grace_seconds for deletes. > > If you want to be really watch disk space reduce the compa

Re: Cassandra as session store under heavy load

2011-10-13 Thread aaron morton
They only have a minimum time, gc_grace_seconds for deletes. If you want to be really watch disk space reduce the compaction thresholds on the CF. Or run a major compaction as part of maintenance. cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.the

Re: Cassandra as session store under heavy load

2011-10-13 Thread Maciej Miklas
durable_writes sounds great - thank you! I really do not need commit log here. Another question: it is possible to configure live time of Tombstones? Regards, Maciej

Re: Cassandra as session store under heavy load

2011-10-12 Thread aaron morton
> - Serializing data is not an option, because I would like to have possibility > to access data using console fair enough, but I would do some tests to see the difference in performance and disk space > - Using Cassandra to build something like "HTTP session store" with short TTL > is not an a

Re: Cassandra as session store under heavy load

2011-10-11 Thread Maciej Miklas
- RF is 1. We have few KeySpaces, only this one is not replicated - this data is not that very important. In case of error customer will have to execute process again. But again, I would like to persist it. - Serializing data is not an option, because I would like to have possibility to access data

Re: Cassandra as session store under heavy load

2011-10-11 Thread aaron morton
Some thoughts… > non replicated Key Space Not sure what you mean here. Do you mean RF 1 ? I would consider using 3. Consider what happens you want to install a rolling upgrade to the cluster. > single Column Family, where key is session ID and each column within row > stores single key/value -

Cassandra as session store under heavy load

2011-10-11 Thread Maciej Miklas
Hi *, I would like to use Cassandra to store session related informations. I do not have real HTTP session - it's different protocol, but the same concept. Memcached would be fine, but I would like to additionally persist data. Cassandra setup: - non replicated Key Space - single Column F

Re: cassandra as session store

2011-02-14 Thread Sasha Dolgy
hi, a few weeks back this topic had some discussion (cassandra as a session store). subsequently, i threw together a quick hack to have PHP use Cassandra as a session store. A benefit I quickly found is that I could rely on Cassandra to expire the sessions and not PHP session garbage collection.

Re: cassandra as session store

2011-02-02 Thread Jonathan Ellis
Sounds like you're seeing the bug in 0.7.0 preventing deletion of non-Data.db files (i.e. your Index.db) post-compaction. This is fixed for 0.7.1. (https://issues.apache.org/jira/browse/CASSANDRA-2059) On Wed, Feb 2, 2011 at 8:15 AM, Omer van der Horst Jansen wrote: > We're using Cassandra as t

Re: cassandra as session store

2011-02-02 Thread Omer van der Horst Jansen
We're using Cassandra as the back end for a home grown session management system. That system was originally built back in 2005 using BerkelyDB/Java and a data distribution system that used UDP multicast. Maintenance was becoming increasingly painful. I wrote a prototype replacement service using

Re: cassandra as session store

2011-02-01 Thread David
Hi Joe, On 02/02/2011 02:58 AM, Joe Stump wrote: FWIW we used Memcached for session data at Digg without any major issues. The one thing we did end up doing to reduce the LRU on sessions was to modify the slab size and put sessions in their own Memcached cluster. Probably not an issue for you

Re: cassandra as session store

2011-02-01 Thread William R Speirs
I'm still very new to Cassandra, but when I started reading about it the first thing I thought about was a session store. It's based (in part from what I understand) on Dynamo which is (again, I could be wrong) used at Amazon as the session store for your shopping cart. So I would certainly re

Re: cassandra as session store

2011-02-01 Thread Janne Jalkanen
If your sessions are fairly long-lived (more like hours instead of minutes) and you crank up a suitable row cache and make sure your db is consistent (via quorum read/writes or write:all, read:1) - sure, why not? Especially if you're already familiar with Cassandra; possibly even have a deploy

Re: cassandra as session store

2011-02-01 Thread Sasha Dolgy
What I'm still unclear about, and where I think this is suitable, is Cassandra being used as a data warehouse for current and past sessions tied to a user. Yes, other things are great for session management, but I want to provide near real time session information to my users ... quick and simple

Re: cassandra as session store

2011-02-01 Thread Kallin Nagelberg
was in Yahoo. >>>> >>>> Tong >>>> >>>> -Original Message- >>>> From: buddhasystem [mailto:potek...@bnl.gov] >>>> Sent: Tuesday, February 01, 2011 9:57 AM >>>> To: cassandra-u...@incubator.apache.org >>>>

Re: cassandra as session store

2011-02-01 Thread Kallin Nagelberg
o. >>> >>> Tong >>> >>> -Original Message- >>> From: buddhasystem [mailto:potek...@bnl.gov] >>> Sent: Tuesday, February 01, 2011 9:57 AM >>> To: cassandra-u...@incubator.apache.org >>> Subject: Re: cassandra as session store

Re: cassandra as session store

2011-02-01 Thread Kallin Nagelberg
...@bnl.gov] >> Sent: Tuesday, February 01, 2011 9:57 AM >> To: cassandra-u...@incubator.apache.org >> Subject: Re: cassandra as session store >> >> >> For completeness: >> >> http://stackoverflow.com/questions/3746685/running-django-site-in-multiserver

Re: cassandra as session store

2011-02-01 Thread Colin Vipurs
I was in Yahoo. > > Tong > > -Original Message- > From: buddhasystem [mailto:potek...@bnl.gov] > Sent: Tuesday, February 01, 2011 9:57 AM > To: cassandra-u...@incubator.apache.org > Subject: Re: cassandra as session store > > > For completeness: > &g

RE: cassandra as session store

2011-02-01 Thread Tong Zhu
AM To: cassandra-u...@incubator.apache.org Subject: Re: cassandra as session store For completeness: http://stackoverflow.com/questions/3746685/running-django-site-in-multiserver-environment-how-to-handle-sessions http://docs.djangoproject.com/en/dev/topics/http/sessions/#using-cached-sessions

Re: cassandra as session store

2011-02-01 Thread Edward Capriolo
n? >> >> Tong >> >> >> >> -Original Message- >> From: buddhasystem [mailto:potek...@bnl.gov] >> Sent: Tuesday, February 01, 2011 9:42 AM >> To: cassandra-u...@incubator.apache.org >> Subject: Re: cassandra as session store >>

Re: cassandra as session store

2011-02-01 Thread Sasha Dolgy
n context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/cassandra-as-session-store-tp5981871p5981961.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: cassandra as session store

2011-02-01 Thread Joe Stump
s probably faster and easier to set up. > > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/cassandra-as-session-store-tp5981871p5982024.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com.

Re: cassandra as session store

2011-02-01 Thread Anthony John
uesday, February 01, 2011 9:42 AM > To: cassandra-u...@incubator.apache.org > Subject: Re: cassandra as session store > > > Most if not all modern web application frameworks support sessions. This > applies to Django (with which I have most experience and also run it with > X.509 securi

Re: cassandra as session store

2011-02-01 Thread buddhasystem
http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/cassandra-as-session-store-tp5981871p5982024.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: cassandra as session store

2011-02-01 Thread Kallin Nagelberg
Too messy. It's all out there for you > to use. > > Regards, > Maxim > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/cassandra-as-session-store-tp5981871p5981961.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com. >

RE: cassandra as session store

2011-02-01 Thread Tong Zhu
...@incubator.apache.org Subject: Re: cassandra as session store Most if not all modern web application frameworks support sessions. This applies to Django (with which I have most experience and also run it with X.509 security layer) but also to Ruby on Rails and Pylons. So, why would you re-invent the wheel? Too

Re: cassandra as session store

2011-02-01 Thread buddhasystem
o use. Regards, Maxim -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/cassandra-as-session-store-tp5981871p5981961.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: cassandra as session store

2011-02-01 Thread Damick, Jeffrey
Are you going to use TTLs to expire the session columns automagically? (we're working on something similar as well) On 2/1/11 12:30 PM, "Roshan Dawrani" wrote: Please do keep this discussion on the mailing list and not take it offline. :-) I will be in the same boat very soon, I think. It wi

Re: cassandra as session store

2011-02-01 Thread Roshan Dawrani
Please do keep this discussion on the mailing list and not take it offline. :-) I will be in the same boat very soon, I think. It will be great to hear from people who have already gone down this road and used Cassandra as a session store in a clustered environment. On Tue, Feb 1, 2011 at 10:56

Re: cassandra as session store

2011-02-01 Thread Kallin Nagelberg
Cool, maybe we can help each other out. I'm using multiple web-apps, all running in Resin containers. Have you thought about schema or how to generate sessionIds for cookies? -Kal On Tue, Feb 1, 2011 at 12:22 PM, Sasha Dolgy wrote: > I am working on this tonight with jetty as front end and cassa

Re: cassandra as session store

2011-02-01 Thread Sasha Dolgy
I am working on this tonight with jetty as front end and cassandra as backend session store. Hopefully. On 1 Feb 2011 18:19, "Kallin Nagelberg" wrote: > Hey, > I am currently investigating Cassandra for storing what are > effectively web sessions. Our production environment has about 10 high > en

cassandra as session store

2011-02-01 Thread Kallin Nagelberg
Hey, I am currently investigating Cassandra for storing what are effectively web sessions. Our production environment has about 10 high end servers behind a load balancer, and we'd like to add distributed session support. My main concerns are performance, consistency, and the ability to create uniq