Re: memory allocation, does memcached play fair ?

2009-06-15 Thread tbs
On Jun 15, 1:22 pm, Joseph Engo wrote: > Have you tried a bucketing approach ?  (Using multiple NFS partitions   > and/or directories instead of a single giant directory). > Yes, we tried that, using an additional 2 levels of dir, and it helped a little, as we can now actual perform 'ls' on the

Re: List pseudo moderation.

2009-06-15 Thread Michael Shadle
I'd be game too if you need help. mike...@gmail.com Sent from my iPhone On Jun 15, 2009, at 9:21 AM, Brian Moon wrote: Sure, I will help Brian. http://brian.moonspot.net/ On 6/15/09 1:28 AM, dormando wrote: Yo, I hear people hate spam. Well, I do too. When we moved the lists

Re: memory allocation, does memcached play fair ?

2009-06-15 Thread Joseph Engo
Have you tried a bucketing approach ? (Using multiple NFS partitions and/or directories instead of a single giant directory). On Jun 15, 2009, at 10:00 AM, tbs wrote: David, Thank you for the well thought out reply to my post, I agree with a lot of what you said. Our current session hand

Re: stats cachedump output

2009-06-15 Thread Dustin
On Jun 15, 4:26 am, ankit wrote: > Hi All, > can anyone explain me the output of stats cachedump Chances are, stats cachedump doesn't do what you think it does. It's a sample. > ITEM foo [6 b; 1176415152 s] > > I assume, foo is key, 6 is length of data associated with key, but wat > is long

Re: dump and load data

2009-06-15 Thread Dustin
On Jun 15, 1:45 am, ankit wrote: > Hi All, > I am not sure if this question has been raised before here. > I want to dump all the data in a file before killing memcached. > After restarting the memcached, i want to load the data back from > file. Each data has expiry time associated with it. > >

Re: memory allocation, does memcached play fair ?

2009-06-15 Thread tbs
David, Thank you for the well thought out reply to my post, I agree with a lot of what you said. Our current session handler is actually using NFS over RAID on a NAS, however we are finding that due to our particular requirements (retain session data indefinitely, unless the session file becomes

Re: List pseudo moderation.

2009-06-15 Thread Brian Moon
Sure, I will help Brian. http://brian.moonspot.net/ On 6/15/09 1:28 AM, dormando wrote: Yo, I hear people hate spam. Well, I do too. When we moved the lists, I wasn't really expecting to see spam under the almighty google groups. However, it happens. Just ticked the box that says n

Re: Tag based invalidation

2009-06-15 Thread Eugene Bragin
Hi Dustin, could you give some more details on this inefficiency you mentioned please? We are using memcached-tags on 10 memcached servers with 40Gigs of cache all together. It works just fine. Invalidation of millions of items is just instant, so is propagation of tags. Are you sure you've used it

Re: Tag based invalidation

2009-06-15 Thread Dustin
On Jun 15, 3:24 am, Eugene Bragin wrote: > Hi Jean-Charles, > have a look:http://code.google.com/p/memcached-tags/ > andhttp://code.google.com/p/memcached-tag/ Last time I looked at either of these, they were too inefficient at storage and invalidation to make it into the code base proper.

stats cachedump output

2009-06-15 Thread ankit
Hi All, can anyone explain me the output of stats cachedump ITEM foo [6 b; 1176415152 s] I assume, foo is key, 6 is length of data associated with key, but wat is long integer 1176415152 ? Regards, Ankit

Re: Tag based invalidation

2009-06-15 Thread Eugene Bragin
Hi Jean-Charles, have a look: http://code.google.com/p/memcached-tags/ and http://code.google.com/p/memcached-tag/ 2009/6/15 JC > > Hi everyone, > > There was some time ago a topic about tag based invalidation. Some > ideas and even possible architecture were mentionned but not > described. Is i

Re: Locking contention

2009-06-15 Thread Jaime Medrano
On Mon, Jun 15, 2009 at 11:01 AM, Trond Norbye wrote: > >> > I have a version of memcached where I partitioned the hash into n > partitions and use a mutex per partition. I have not pushed that version to > github yet, because I haven't finished up benchmarking and running lock > analysis on it..

Re: Locking contention

2009-06-15 Thread Trond Norbye
On 15. juni. 2009, at 10.48, JC wrote: Hi, just out of curiosity, what are those tracks? I was thinking as Jaime per slab class mutex This mutex shouldn't really be such a big problem, because it is only used when you try to insert / modify something in your cache... (well, of course t

dump and load data

2009-06-15 Thread ankit
Hi All, I am not sure if this question has been raised before here. I want to dump all the data in a file before killing memcached. After restarting the memcached, i want to load the data back from file. Each data has expiry time associated with it. Any guidance? Regards, Ankit

Tag based invalidation

2009-06-15 Thread JC
Hi everyone, There was some time ago a topic about tag based invalidation. Some ideas and even possible architecture were mentionned but not described. Is it possible to know a little bit more about what you have in mind for this feature? Because the more I think about it, the more possible uses

Re: Locking contention

2009-06-15 Thread JC
Hi, just out of curiosity, what are those tracks? I was thinking as Jaime per slab class mutex and also static division of the hashtable with specific mutex for each part; am I in the right direction? cheers, Jean-Charles On Jun 15, 9:11 am, Toru Maesaka wrote: > Hi! > > Apologies for the late

Re: Locking contention

2009-06-15 Thread Toru Maesaka
Hi! Apologies for the late reply. Things you've mentioned are correct and we've talked about SMP performance issues of the daemon for a while at hackathons, events, IRC and etc. As Dustin had mentioned, some experimental work has been done and hopefully things will look better in future releases