Hi Darpan, Exactly, I am looking for trace which has similar format *<timestamp> <server id> GET|PUT|operations..., key, other parameters* * * My intention is to replay these traces to generate workload to the cache and see the performance. I am trying to characterize memcached specific real world workloads. Following are the specific questions that I want to answer in broad category:
a) spikes in load: peak load vs normal load? b) Key hot spots (i.e if there is a particular set of keys which is really popular)? c) What is the time order of change of these hotspots (do different keys get popular at different time)? I understand answers to these questions are heavily dependent on application and traffic to the particular site. But a real implementation trace is far better than simulated lab settings. Rishi On Tue, Jul 12, 2011 at 3:55 PM, Darpan Dinker <darpandin...@gmail.com>wrote: > Hi Rishi, > > (1) Are you looking for a trace such as follows: > *<timestamp> GET|PUT|operations..., key, other parameters* > > Defining the trace may make it simpler for other members on this mailing > list to respond with a "yes, I have it". > > (2) Regarding load spikes: are you simulating a cache or characterizing the > workload using a real implementation? > > Darpan > > -- > Darpan Dinker, VP Engineering > Schooner Information Technology, Inc. http://www.schoonerinfotech.com/ > MySQL and NoSQL for Mission-Critical Applications > > > > On Tue, Jul 12, 2011 at 9:12 AM, Roberto Spadim <robe...@spadim.com.br>wrote: > >> hum... maybe you should search "benchmark memcache" at google >> >> at dev.mysql have some informations about nosql and mysql: >> >> http://dev.mysql.com/tech-resources/articles/nosql-to-mysql-with-memcached.html >> >> since you are a Phd student... i think it's better test yourself what >> is each software do >> memcache protocol can be used for many data storages >> memcached software is designed with cache in mind, check the first >> memcached page, it's a cache system (i don't know but i think that all >> key-value ram 'databases' are cache systems) >> >> some tests/benchmarks? google it... you will find many benchmarks >> about php+mysql+memcached as a cache+database solution and only >> php+mysql+(mysql query cache) as other solution, i didn't found many >> benchmarks about what's key-value database is better, at what >> overload, but since they don't do locks (they only get/set/delete) i >> think you will not find a big difference between one and other >> implementation (must check) >> you will find more benchmarks about web scenario because many web app >> use mysql as database and after 'memcache boom' many clients start >> using it as a cache system, before memcached some app used apc (php >> extension) and others cache systems (pear cache), but they aren't for >> network, some used filesystems too (samba network filesystem, nfs and >> others), but there's a bigger overhead using a network filesystem than >> a memcached cache system >> >> maybe there's others protocols/nosql databases that you could study >> too check this at wikipedia: >> http://en.wikipedia.org/wiki/NoSQL >> >> check that they are cache solutions, not database solutions... read this: >> Key-value >>>>>cache<<<<< in RAM >> Citrusleaf database >> memcached >> Oracle Coherence >> Redis >> Tuple space >> Velocity >> >> >> 2011/7/12 Rishi <rkapoor.ri...@gmail.com>: >> > Let me rephrase my statement >> > " research on "in memory" key-value stores particularly memcached, >> > with key focus on characterizing performance >> > in case of load spikes. For data analysis, I am looking for realistic >> > traces of memcached operations." >> > >> > It would be really great if some of the memcached users in industrial >> > setting can share their traces. >> > >> > >> > On Jul 11, 7:25 pm, Roberto Spadim <robe...@spadim.com.br> wrote: >> >> you forgot the first paragraph >> >> >> >> What is Memcached? >> >> >> >> Free & open source, high-performance, distributed memory >> object>>caching system<<, generic in nature, but intended for use in >> >> >> >> speeding up dynamic web applications by alleviating database load. >> >> >> >> for database (nosql) you should use this:http://memcachedb.org/ >> >> or thishttp://www.couchbase.org/membase >> >> >> >> some ports/patchs allow others sql databases to use nosql memcache >> >> protocol to get information about database check innodb-memcache and >> >> nbd-memcache from mysql database >> >> >> >> 2011/7/11 Gabriel Sosa <sosagabr...@gmail.com> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> > wait wait wait... >> >> >> >> > from memcached.org >> >> >> >> > "Memcached is an in-memory key-value store for small chunks of >> >> > arbitrary data (strings, objects) from results of database calls, API >> >> > calls, or page rendering." >> >> >> >> > I think caching is a particular use of memcache. In my case I usually >> >> > use it as a set of counters where you can do atomic operations. >> >> >> >> > saludos. >> >> >> >> > On Mon, Jul 11, 2011 at 8:43 PM, Roberto Spadim < >> robe...@spadim.com.br> wrote: >> >> > > hum... it´s no a key-value store >> >> > > it´s a cache >> >> > > if you want a nonsql database, check membase, or memcachedb >> >> >> >> > > 2011/7/11 Rishi <rkapoor.ri...@gmail.com> >> >> >> >> > >> Hi, >> >> >> >> > >> I am a PhD student and currently doing research on key-value >> stores >> >> > >> particularly memcached, with key focus on characterizing >> performance >> >> > >> in case of load spikes. For data analysis, I am looking for >> realistic >> >> > >> traces of memcached operations. >> >> >> >> > >> I was wondering if anyone is aware of any repository of such >> publicly >> >> > >> available traces? >> >> >> >> > >> - >> >> > >> Rishi >> >> >> >> > > -- >> >> > > Roberto Spadim >> >> > > Spadim Technology / SPAEmpresarial >> >> >> >> > -- >> >> > Gabriel Sosa >> >> > Si buscas resultados distintos, no hagas siempre lo mismo. - Einstein >> >> >> >> -- >> >> Roberto Spadim >> >> Spadim Technology / SPAEmpresarial >> >> >> >> -- >> Roberto Spadim >> Spadim Technology / SPAEmpresarial >> > >
