Note that it could also be that your webapp's threads were all just stuck
waiting to time out on one node. Depending on the client you're using, how
your app is written, it may appear that everything is 'offline', but it's
really just that your app is spending a large amount of time waiting for
Curious, what kind of protocol problems? There were a couple Trond and I
were looking at with enabling out-of-order responses and some unsolicited
responses.
On Fri, Aug 25, 2017 at 2:53 PM dormando wrote:
> I have some thoughts but need to finish a few other things first.
It's off topic for this list, but that's in effect what Couchbase does
along with persistence.
- Matt
(full disclosure, I work for Couchbase)
On Mon, Oct 26, 2015 at 6:35 AM, Jonas Steinberg
wrote:
> I've been reading the web for an hour now and I'm still unclear as
Best to start with a pstack to see what state it is in. Use gdb to print a
stacktrace for all threads if your OS has no pstack command.
The other thing you may do is strace -c -f of the pid. This will let you
know what its trying to ask the OS for.
Finally, maybe try reducing the threads to 1
It is in response to a relatively rare, good problem to have. Imagine you
have so many processes each with a connection on so many servers that its
in the 10s of thousands. Then a proxy/mux makes sense over persistent
connections.
Matt
On Jul 26, 2013 6:01 AM, Ryan Chan ryanchan...@gmail.com
It's really a discussion for another mailing list, but if you could
elaborate to me directly or to couchb...@googlegroups.com, I'd be
interested in why you say Couchbase is much slower. I've not seen it that
way.
Full disclosure, I'm a couchbase person. I also do a lot of work on the
Adding TAP with a filter on key and TAP operation type would be cool indeed.
Why not run multiple instances?
There is the also the open source bucket engine (written for
membase/Couchbase) but it requires SASL with and 1.6. Could work,
depending on your environment. Bucket engine is used at and was written
for Heroku's memcached add on by Couchbase.
You're likely overrunning the input queue. If you configure it for a bit
of blocking, it'll work better for you. It's similar to the bulk loading
description here:
http://www.couchbase.com/wiki/display/couchbase/Couchbase+Java+Client+Library
The tuning here is spymemcahed, just extended.
Which client are you using? Any info in that area you can share? Also, is
there possibly a different amount of network traffic each time?
Actually, one cause could be setting memcached up with more memory than
available on your system. How much physical memory have you?
On Jul 30, 2012 6:22
On 10/24/11 12:46 PM, dormando wrote:
I'm using the last spymemcached release 2.7.3.
This is caused by validateKey method in MemcachedClient:
for(byte b : keyBytes) {
if(b == ' ' || b == '\n' || b == '\r' || b == 0) {
throw new IllegalArgumentException(Key contains
On 10/24/11 3:48 PM, dormando wrote:
There's nothing like that currently. Last discussion I remember is that
we decided against allowing binary keys at the client because we don't
know what other clients may expect when trying to get that item.
We can certainly reconsider that, but it's not
On 10/24/11 4:33 PM, dormando wrote:
Nobody fucking does that. Get over it, yo. People read the minimum amount
of crap they have to read until it works. Everyone else doesn't have a
hard time finding work.
Also; because when you don't, people switch to to other systems because
they believe
with netty 3.2.0+.
Matt Ingenthron (2):
No need for old debugging string in test.
Revert SPY-37 SPY-38: Fixed redistribution performance issue
Mike Wiederhold (21):
Operations can't timeout when writing to the write buffer.
SPY-125: Significant performance issue large number
of the testing server
Fixed issue with flags not being added properly to tap messages
Added README.markdown.
Added ability to do tap dump
Tap streams now pause every 10,000 messages.
Matt Ingenthron (7):
Adding a warmup state for nodes.
Also check for RETRY during
On 8/17/11 8:44 AM, Neeraj Agarwal wrote:
I installed memcached on Ubuntu box. Installed MongoDB too on the same
machine to compare the performance for these two.
By default, mongodb doesn't check for responses at all. It just sends
requests over. That *could* be playing a role here.
The
On 6/21/11 1:37 AM, Mark Maggelet wrote:
I'm hoping someone can explain this to me.
I turned on fragment caching with memcached for my rails app recently
and unless I'm tripping it made the disk io part of my ec2 bill go up.
The memcached server is on a different host than the rails app if
On 6/20/11 11:44 AM, nt wrote:
What's the upper bound on the number of keys a client can get from
the server? Info regarding both the ASCII and binary protocols would
be greatly appreciated.
127^256, but you can get the same key more than once.
Binary follows ASCII protocol in its
Hi Nickolay,
Couple things missing are OS and libevent version. :)
You may want to try preloading libsegfault, that'd give us a bit more
information. Verify you're updated on the latest 1.4 libevent too.
Otherwise there's not much useful info I see.
Matt
On 6/19/11 2:52 AM, Kutovoy Nickolay
any questions or issues.
Thanks,
Matt
--
Matt Ingenthron
Couchbase, Inc.
Hi Aditya,
You should take this to memb...@googlegroups.com or the membase
forums. This list is about memcached.
Regards,
Matt
On 6/5/11 7:32 PM, Aditya Kumar wrote:
How to use membase backets?
I have 4 tables that need to be created.so 4 vbackets.
Initially I have the default bucket
Hi Tony,
On May 28, 2011, at 4:36 AM, tony Cui wrote:
I wrote a c memcached client. The reason I wrote it is
because spymemcached has some problems, say connection reset by peer. And
the problems has driven crazy, so a idea came up , what about write a client.
I'm
Factory Bean, be 2.5 compatible.
Matt Ingenthron (19):
Changed ports in tests for non-listening to something higher.
Do not write timedout operations to the MemcachedNode.
Increased default timeout to 2500ms.
Test for timeout from operation epoch
On 5/13/11 4:10 AM, Alexey Zlobin wrote:
It looks like module name in POM was changed from memcached to
spymemcached. May be wiki page about maven repository should be
updated?
Yes, it should. Will do.
The changed module name seems more correct to me.
Does anyone have any opinions on that?
On 4/28/11 10:16 PM, Matt Sellars wrote:
How does one configured this value?
There is a -I parameter that was added around 1.4.3 I think.
The param is not to be used lightly, as you may have to do some slab
tuning. See the release notes for details.
Matt
On Apr 28, 10:50 pm, Dustin
Hi,
I'd recently been trying to fix an issue with spymemcached when the
server side allows larger than 1MiB. I'm fairly certain that other
clients may have similar issues, so I wanted to kind of collect how
clients should behave in this area.
With the change to allow max item size to be a
appreciate it if anyone can offer
feedback.
Thanks,
Matt
On 4/19/11 12:58 AM, Matt Ingenthron wrote:
After the review, I'll kick out a short rc2, followed by a final. The
plan is also to get this in a public maven repo and also do some
whitespace reformatting (sorry tab formatting fans) to make
Hi all,
Since a few of the core folks are in the same place at the same time,
we're going to hold a small hackathon... this time really hacking... to
work on some merging of a couple of branches together to push to the
next release.
If you are interested in participating and already have some
On 3/16/11 11:56 PM, dormando wrote:
what time does it start? ;)
Tentatively, 3pm-ish. That's admittedly an early start, but I suspect
it won't really get going until about 6pm.
Ideally, it ends when we've gotten something done. :)
On Wed, 16 Mar 2011, Matt Ingenthron wrote:
Hi all
On 3/7/11 4:29 PM, Fuzzpault wrote:
Anyone know of any open source projects (preferably in php) which use
memcache at its core, or that is greatly accelerated with it?
Mediawiki has built in support for memcache (as likely included by
occasional contributor Domas). It's also very important
Hi Lior,
On 3/3/11 1:53 PM, Evil Boy 4 Life wrote:
Hi,
I use the .net clients and 2 servers at 2 different machines.
When one of the memcached servers is down, I try to set an item to the
cache (According the hashing algoritem of the client, this item should
stored the inactive server!) and
On 3/4/11 3:55 AM, Priya wrote:
Does memcached load balance, i.e., what if most of the keys hash to a
particular server, does memcached take some actions to load balance
it?
Generally speaking, since responses come from RAM and memcached can
pretty easily saturate network interfaces with very
On 3/4/11 3:54 AM, Priya wrote:
Are the key-value pairs replicated on different nodes or does the pair
remain with only on one RAM?
With memcached, key/value pairs remain only in one node in RAM. Have a
look at the wiki and the list archives for more info.
Good luck!
Matt
Hi Felipe,
Do note that the memcached build on Solaris works best when using Sun's
cc, not gcc. Last I checked, it was still freely available (but
required registration).
Which version of libevent did you use? Solaris 10 has libevent built in
over in the SFW repository, and that one has been
Hi Nathan,
On 3/3/11 1:42 PM, Nathan Nobbe wrote:
Hi all,
I know I'll get blasted for not googling enough, but I have a quick
question.
Here's a dime. Get yourself a web browser and bring me back $0.10
change. :) (said jokingly...)
I was under the impression memcached servers
On 1/21/11 6:19 AM, vickycc wrote:
Besides brutis and memslap, do you know of any other well-known
benchmarks for memcached?
I don't know if it's well known, but:
https://github.com/ingenthr/memcachetest
(let me know if you want a dist tarball, that'd be easier to build)
There's also:
Hi Vitold,
On 12/31/10 3:54 PM, Vitold S wrote:
Hello,
I am Web developing at Winows platform and I am want tu use Memcache,
but I am cant use last version with all interesting function...
Plaease make at memcache.org build or port to Wienows...
memcached.org provides only source.
Trond
On 1/4/11 6:06 AM, Gustavo Paixão wrote:
HI,
I'm new with memcached, I'l like to know hot to install in my server,
RHEL 5 with CPanel. I'm trying to install by CPanel, I found this module:
memcached 1.0.2 stable PHP extension for interfacing with
memcached via libmemcached library
On 1/4/11 6:13 AM, Shabam wrote:
I have installed a Magento in a Web Cluster(include two web server)
and Magento work fine in any independent server.
In order to improve performance and shared session between multiple
Web servers, I config Magento save session to memcache server. But
now, I
.
Regards,
Matt
On Tue, Jan 4, 2011 at 10:43 AM, Matt Ingenthron ingen...@cep.net wrote:
Hi Vitold,
On 12/31/10 3:54 PM, Vitold S wrote:
Hello,
I am Web developing at Winows platform and I am want tu use Memcache,
but I am cant use last version with all interesting function...
Plaease make
On 1/4/11 10:07 PM, Gustavo Paixão wrote:
Hi Matt,
I was looking for libmemcached inInstall a Perl Module page at WHM
and I found this *Memcached::libmemcached*, I try to install but I got
some error. The error message is attached. Do you know if i did
something wrong or if a need to install
Hi Jason,
On 12/7/10 2:05 AM, jason wrote:
We are running memcached version 1.2.8 on Solaris 10 118833-36. We are
running with the following options:
memcached -c 256 -u nobody -d -m 256 -l 127.0.0.1 -p 11211
We are seeing the following errors:
RlsMemGet: cannot get object, error: SYSTEM
That appears to be using the bucket engine. Are you sure you're using
memcached, and not membase?
membase has a different mailing list: memb...@googlegroups.com
Hope that helps,
Matt
On 12/2/10 11:52 AM, sush wrote:
Hi everyone,
Here i am using wamp server and trying to run memcache, but it
On 10/29/10 1:36 AM, Obeyon wrote:
Dear memcached experts,
I was wondering what the best configuration of memcached is on a
server with a high amount of ram (in this case 20 gb for memcached)
and multiple cores (in this case 8).
Would it be better to use multiple smaller memcached instances
Hi Pavel,
On 10/19/10 12:00 AM, Pavel Kushnirchuk wrote:
Folks,
May be anybody know, when will be a next planned release of memcached.
Especially I am interested in a release of Win32 branch.
As dormando said, we're aiming to put some effort into this soon. I'm
curious though, what about
On 10/18/10 6:35 AM, Pavel Kushnirchuk wrote:
Sorry may be my question is a bit stupid.
I need to extend a memcached with very simple additional
functionality(allow to listen memcached on multiple IP addresses).
Could I do all necessary changes in Win32 branch? Will all my changes
to go to
On 9/24/10 12:10 AM, Paul Lindner wrote:
A good rule of thumb is one thread per core, but you should run your
own benchmarks on your hardware.
+1
This is a good general rule of thumb overall, though the old general
rule is go up to 4x number of CPUs if tuning for throughput, and just at
or
On 9/22/10 6:12 AM, ligerdave wrote:
MongoDB is actually cached db, meaning that, most of its records are
in memory.
I think there is also a memcached and DB hybrid which comes w/ a
persistent option. i think it's called memcachedDB, which runs a in-
memory db(like mongodb). this shares most
On 9/22/10 10:23 AM, Les Mikesell wrote:
On 9/22/2010 11:59 AM, Matt Ingenthron wrote:
On 9/22/10 6:12 AM, ligerdave wrote:
MongoDB is actually cached db, meaning that, most of its records are
in memory.
I think there is also a memcached and DB hybrid which comes w/ a
persistent option. i
On 9/22/10 1:41 PM, Ravi Chittari wrote:
We have memcached instances up and running in production. We want to
change our systems from one timezone ( Say EST) to UTC.
Does memcached instance automatically pick up new Timezone and what
happens to the cached items?
IIRC, times are tracked as
marrra wrote:
Hi,
I'm using memcached for caching search suggest box.
I've done this:
Set lifetime for all items to 30 hours and restart memcached.
After 24hours are stored about 87000 items in memcached and in last 2
hours was added only few items.
When I look at graf (bijk.com) I see cache
efficient, but the first step it seems in your case would be to add more
memory. Since you've done that, I bet it'll help.
- Matt
On Aug 18, 6:41 pm, Matt Ingenthron ingen...@cep.net wrote:
marrra wrote:
Hi,
I'm using memcached for caching search suggest box.
I've done
Chad wrote:
I am trying to find a way to check if the memcachedclient is still
alive or not but it seems to be there is no public api for me to do
so. Can someone clarify this?
Not really. You should be able to use system level tools (i.e. netstat
-a | grep 11211) to see connections in the
dormando wrote:
sto
I'm pretty sure he sent it only once. I think this is a problem with
Google's SMTP and MTAs if I recall correctly. This happened on a
majordomo based list I am on, and it died down after a little bit. I
Dagobert Michelsen wrote:
Hi Dustin,
Am 12.08.2010 um 18:25 schrieb Dustin:
We don't have anyone working on sparc at the moment. Would love
fixes. :)
You haven't? What happend to Trond Norbye?
Trond is still doing Solaris development, but has been working on other
stuff of late. Still
Hi Sergei,
For various reasons (performance, avoiding memory fragmentation),
memcached uses a memory allocation approach called slab allocation. The
memcached flavor of it can be found here:
http://code.google.com/p/memcached/wiki/MemcachedSlabAllocator
Chances are, your items didn't fit
Dilip wrote:
We read that memcached is Free open source, high-performance,
distributed memory object caching system Where as distirbuted is
not part of memcached servers. We have to have some client which knows
about all memcached servers and uses some hash based on key to
determine a server.
):
Implementing read-only methods in MemcachedNodeROImpl - issue86
Kristian Eide (1):
Allow user-specified wait time for availability of queue space.
Matt Ingenthron (14):
Invert the ConnectionFactoryBuilderTest to go with new logic.
Document unexpected incr/decr behavior. Issue 48
dormando wrote (among other things):
A number of us will be at MySQLConf (http://en.oreilly.com/mysql2010/)
next week.
I proposed a BoF at the MySQL Conference to get the memcached users,
client and server authors together. It has been accepted so Tuesday the
13th, we'll have a BoF and
dormando wrote:
Is there anyway to get the keys of the largest objects currently in my
memcached? I'm not concerned about locking up the server. I just wish
to be able to run a command one time which will give me the key of the
biggest objects that are currently stored.
Thanks
You could
Hi,
Alexandre Ladeira wrote:
I'm using memcached to store these data:
- user object - an java object consisting of username, password,
city...;
- user status info;
- counter,
so for every user login, I will make three memcached put operation.
After making 10.000 logins, I have these stats via
Chaosty wrote:
It runs on the same server, php memcached connects by 127.0.0.1 to it.
it close but not the same. i did kill and run clean memcached server,
each time it was close to 0.1 sec.
In that case, I totally agree this is suspicious.
Just to toss out another idea, it sounds like
Hi Yakuza,
yakuza wrote:
i have compile memcached + sasl support for testing it but all plugin
for wordpress or vbulletin don't support it ..
it's more new feature and none have write support?
Two of the most popular clients, libmemcached and spymemcached, have
SASL support in their
tvinod wrote:
im trying to run memcached on my windows 7 machine within a rails
project and it errors out..
936 connection closed.
940 new client connection
940 set mem-development:c222efbcfc08b4850198cd1eea610f76 0 0 217
940 STORED
Failed to write, and not due to blocking: Resource
Aaron Stone wrote:
On Wed, Jan 6, 2010 at 2:48 AM, pub crawler pubcrawler@gmail.com wrote:
(snip...)
Needless to say, permissions and authentication is a feature set that
is going to re-requested for addition now and in the future. It opens
the door for someone to create a
Aaron Stone wrote:
Authentication, at least, has been in the community memcached release for
the last two micro releases:
http://code.google.com/p/memcached/wiki/ReleaseNotes143
It's a reasonable effort at keeping someone from writing to your
cache. Surely they can still sniff the network
Stephen wrote:
Hi, everyone:
In my project, I execute the flush_all command with careless,
however, the data in the memcache is important for me, it has not to
be saved into database.
And I read the doc, it says flush_all doesn't actually free all
the memory taken up by existing items;
Hi JB,
Just a couple of quick thoughts, and others will likely jump in as well.
juanbackson wrote:
Hi,
I have two distributed clients that need to write stuff to memcached,
but each write will involve two records. These two records must be
sync. So, they must be changed together.
You
Hi David,
David H. wrote:
I notice that the standard way to build a Win64 port is to use MinGW/
Cygwin. I am interested in a native Win64 port which makes the
necessary calls directly, and I'm willing to create and maintain such
a port, so long as I get support from the owners to maintain it
dormando wrote:
Yo,
I'm debating a small patch for 1.4.2 that would add (more) commandline
warnings for memcached. You'd of course only see most of them if you fire
it up without the -d option, but hopefully in the course of testing
someone tries that.
For exampple, if someone sets `-m 12`
dormando wrote:
That's *kind* of what I thought. I'm unawrae of anyone having real
authoritative specifications on wikipedia?
Is there something to show otherwise?
Not that my opinion means that much, but Wikipedia, like the
encyclopedias they mirror in the treeware world (as opposed to
daugia247 wrote:
I have installed memcached using danga. But cannot connect to memcache
(using PERL).
Do I need to install more package or something else ? Can anyone give
instruction ?
You will need a client. There is a full list with links on the server's
project site:
Hi all,
Since a number of memcached contributors and client authors were in one
place at the Drizzle conference this week in Seattle we had a short
discussion about the release roadmap for stable and development
branches. I captured much of the discussion and it's posted on the wiki:
jim wrote:
Which RAM type(buffered, un-registered or FB DIMM) is better for
memcached server?
I'd venture to say for 99%+ deployments, it doesn't really matter. The
network is the largest limiting factor in both latency and throughput
for memcached performance. $/GB is probably your
Jay Paroline wrote:
Hello,
We've been having some intermittent memcached connection issues and I
noticed that we are a couple of releases behind. Our current version
is 1.2.6.
Before I nag our admin about upgrading, is there any reason why it
might be more wise to go to 1.2.8 rather than make
dormando wrote:
Yo,
Updates to the issue tracker should now all hit the mailing list. The
traffic over there is relatively low, but only a small handful of us
actively check it - I'd prefer all information go to the same place.
I think this is a good change...
A few
threads which should
blazah wrote:
What do folks do with the objects stored in memcached when a new
version of the software is deployed? There is the potential that the
data could be stale depending on the code changes so do people
typically just flush the cache?
The most common approach here is to add
lessmian2 wrote:
Thanks for reply. I have 32-bit kernel. I have no memory limits for
single process. Ulimit say:
You can look at ulimit as soft limits. There are always hard limits
based upon your system's architecture and the features of that
architecture you're using. One of these is
Dustin wrote:
On Jul 19, 4:29 pm, Gary Z g...@ironplanet.com wrote:
In order to make it work for Solaris10 x86 (not opensolaris), I had to
make following minor changes, two issues:
Hey, we have a Solaris 10 sparc builder and OpenSolaris x86
builders. Apparently that's not enough
Brian Moon wrote:
I may not be at the Gearman BoF but want to meet up with you guys. Do
we know the where part yet?
Yep, all confirmed.
Wednesday 7/22, we have a spot reserved at Gordon Biersch, 8pm. 33 E
San Fernando St., San Jose, CA 95113. I believe it's between 1st and
2nd
Thanks for kicking off the discussion on this.
dormando wrote:
I'd like to propose something mildly similar to the linux kernel schedule,
but inverted a little:
- 3 weeks after each new stable release, we release -rc1 for the next
release.
- New -rc's will be kicked out daily or bidaily if
Based on a discussion on the IRC channel and the mailing list, it seems
people aren't finding the release notes. I believe (partially because
one guy told me it was the case) this is because the release notes are
not linked from the danga.com/memcached/news.bml page
When walking around,
the release notes link on the news page on danga.com will probably help.
- Matt
On Jul 16, 2009, at 9:53 AM, Matt Ingenthron wrote:
Based on a discussion on the IRC channel and the mailing list, it
seems people aren't finding the release notes. I believe (partially
because one guy told me
the issue you were seeing.
Incidentially, how did the memory fragmentation manifest itself on your
system? I mean, could you see any effect on apps running on the system?
Thanks,
Mike
On Jul 13, 8:38 pm, Mike Lambert mlamb...@gmail.com wrote:
On Jul 10, 1:37 pm, Matt Ingenthron ingen
Hi all,
In the IRC channel the other day, it came up that a number of us will be
at OSCON. There are a number of IRC and mailing list regulars who
probably haven't met in person.
Is anyone interested in meeting up one evening? This would be a social
event (though we'll no doubt
with those working with/on Gearman, so
let's target 8:30 instead. Those who want to proceed from the Gearman
BoF can, and those who may be doing another BoF or something else
interesting will just know where/when to meet us.
Sound good?
On Tue, Jul 14, 2009 at 12:17:05AM -0700, Matt Ingenthron wrote
Mike Lambert wrote:
Currently the -L flag is only enabled if
HAVE_GETPAGESIZESHAVE_MEMCNTL. I'm curious what the motivation is
for something like that? In our experience, for some memcache pools we
end up fragmenting memory due to the repeated allocation of 1MB slabs
around all the other
hachi wrote:
Hi Jruiz,
I'll be at the booth for the entire time next week.
I had been planning this via dormando (who sent a message similar to
yours on the list a short while ago), and I have some supplies for the
booth already.
I manned the booth for a bit last year, and I'd be glad to
Qiangning Hong wrote:
The manpage says:
-k Lock down all paged memory. This is a somewhat
dangerous option
with large caches, so consult the README and memcached
homepage
for configuration suggestions.
README says:
Also, be warned that the -k (mlockall)
tongueroo wrote:
Thats a good point. Um. maybe thats swap is whaat is happening.
Note there is a -k flag to memcached which, depending on underlying
OS, can lock down the pages so they won't page out to swap space. Since
your mongrel memory usage will be variable, you may be able to
Toru Maesaka wrote:
oops, clicked send before I finished the email :(
ASFAIK, Trond and Matt has been experimenting quite a bit with what
I've mentioned above.
True, more Trond than I. I've been working on a method of testing, and
have a good workload generator. We're actually not
91 matches
Mail list logo