Guarantee of Riak generated key size

2012-11-06 Thread Olav Frengstad
Hey, I'm using keys generated by Riak and have come over some random failure in my test cases. I have naively assumed that the 160bit hash would always return a base62 encoded value with the length of 27. On that point I'm obviously wrong as the shell session below shows. My question is this by

if_not_modified

2012-11-06 Thread Elias Levy
The description of if_not_modified is lacking in the documentation. What guarantees if_not_modified provides is a question that has been asked in the list a few times, but for which no satisfactory answer has been given. Its something I've been wanted answered as well, so I did a bit of digging

Re: How to make Riak work faster (writing)

2012-11-06 Thread Uruka Dark
First of all, thank you for your reply. Well, if you tell me that I can beat myself up trying to get what another person gets in a benchmark, then I don't understand what's the whole point in post your results here. I thought that you were trying to tell me that in an similar setup, you could do m

Cluster on startup.

2012-11-06 Thread Kevin Burton
This is probably an FAQ but I was unable to find an answer so hopefully there will be some patient people. The "Quick Start" builds a simple cluster all on the same machine (called dev1, dev2, and dev3). It assigns the ports, IP addresses, etc. I would like to do something similar but I would l

Re: How to make Riak work faster (writing)

2012-11-06 Thread Jared Morrow
Uruka, Well at least now your numbers make sense. I wasn't trying to be snide in my response, that wasn't my intention, so sorry if I appeared that way. I was attempting, poorly, to say that Memory and Bitcask shouldn't be close to each other so you have other issues. Now that you have apparent

Re: avg write io wait time regression in 1.2.1

2012-11-06 Thread Matthew Von-Maszewski
Dietrich, I finally reviewed your LOG.all today. The basic analysis is: - you have a really fast disk subsystem, and - your machine is bored. I make the first comment based upon the fact that your Level-0 file creations take less than 200 ms on files of 40Mbyte with 10,000 keys (or more). I w

Re: avg write io wait time regression in 1.2.1

2012-11-06 Thread Dietrich Featherston
Thanks for the feedback. We haven't noticed any drop in riak responsiveness--quite the opposite. We were just alarmed at some of the iostat information we were seeing which may very well result from, as you pointed out, greater concurrency in layers above the disk subsystem. It's not of concern at

Re: avg write io wait time regression in 1.2.1

2012-11-06 Thread Matthew Von-Maszewski
Would you paste the data for one core from /proc/cpuinfo? And do you know the brand of controller running the SSD drives? Thank you, Matthew On Nov 6, 2012, at 7:04 PM, Dietrich Featherston wrote: > Thanks for the feedback. We haven't noticed any drop in riak > responsiveness--quite the oppo

Re: avg write io wait time regression in 1.2.1

2012-11-06 Thread Matthew Von-Maszewski
Dietrich, I forgot to mention that I noticed your app.config has the cache size at 500M. That will work against you in 1.2.x. I personally introduced a bug that hurts performance on that setting. My apologies. I recommend you take it below 100M until release notes publish that the bug is fi

Re: avg write io wait time regression in 1.2.1

2012-11-06 Thread Dietrich Featherston
We had adjusted it down to 0.5GB from the recommended 2GB based on some older guidelines and had noticed the the page cache was outperforming level's own cache as we dialed it down. Will let you know what we see after dropping the cache size, but it probably won't be this week. Any recommendations

Re: avg write io wait time regression in 1.2.1

2012-11-06 Thread Dietrich Featherston
Our raid controller is --> 03:00.0 RAID bus controller: LSI Logic / Symbios Logic LSI MegaSAS 9260 (rev 05) Here's one processor from /proc/cpuinfo processor : 0 > vendor_id : GenuineIntel > cpu family : 6 > model : 44 > model name : Intel(R) Xeon(R) CPU X5647 @ 2.93GHz > stepping : 2

Riak Recap for November 1 - 5

2012-11-06 Thread Mark Phillips
Evening, Morning, Afternoon to All - For today's Recap: slides, talks, meetup, blogs, and more. Enjoy. Mark twitter.com/pharkmillups Riak Recap for November 1 - 5 === 1) Dataomic announced Riak support. * Details here ---> http://blog.datomic.com/2012/11/riak-and-couchbas

Re: if_not_modified

2012-11-06 Thread Reid Draper
Elias, There's quite a few questions in here, but hopefully I'll answer the meat of what you're trying to find out. Using `if_not_modified` is _not_ equivalent to a distributed atomic compare-and-swap (CAS). As you've correctly identified, concurrent writers on different coordinators can all suc

Re: Cluster on startup.

2012-11-06 Thread Reid Draper
On Nov 6, 2012, at 5:43 PM, Kevin Burton wrote: > This is probably an FAQ but I was unable to find an answer so hopefully there > will be some patient people. > > The “Quick Start” builds a simple cluster all on the same machine (called > dev1, dev2, and dev3). It assigns the ports, IP addre

RE: Cluster on startup.

2012-11-06 Thread Kevin Burton
I installed from source and I had directories dev1, dev2, dev3, and dev4. Each of those directories had sub-directories of bin and etc. I am assuming that I need the contents of these directories. What is the bare minimum that I need to start up a cluster like the Quick Start? Each of these dire

Re: Guarantee of Riak generated key size

2012-11-06 Thread Kelly McLaughlin
Hi Olav. As you have observed the key length of the generated keys is not guaranteed. riak_core_util:unique_id_62 generates a 20 byte SHA hash and that value is converted to a base 62 representation and that representation, converted to a string, becomes the key. The length of the generated k

Re: if_not_modified

2012-11-06 Thread Elias Levy
Sent from my iPhone On Nov 6, 2012, at 7:34 PM, Reid Draper wrote: > Elias, > > There's quite a few questions in here, but hopefully I'll answer the meat of > what you're > trying to find out. Using `if_not_modified` is _not_ equivalent to a > distributed atomic > compare-and-swap (CAS). As yo